When you exit an application by pressing your home button on the device, the application will not be shutdown, but instead will be placed in the background.  To force an application to quit, double press the home button to list all running apps at the bottom of the screen. 

All of the running apps are displayed in a flow layout.  Close an application by flicking the app up.

You can now restart the application as you normally would.