Apps like the Mail app can use push data to refresh, but keeping push email turned on can also use quite a lot of juice, particularly in areas with poor signal.

To turn it off, go to Settings, select the Mail option, then Accounts. Press Fetch New Data, turn off Push at the top of the screen, then scroll down and set Fetch to Manually.

To receive email with Push switched off, just open the Mail app.