No, you don't need to have the app open or running in the background to receive calls. As long as you're logged in, you can receive calls. Please note that it is not unusual for it to take a while before you receive your first call, because of the high number of volunteers.