Some people buy enough batteries to rotate them through a charger in their car, but flying continuously (apart from battery changes) may overheat components in the quad, and some quads have other things that need charging, like cameras.
If you're staying with the Phantom, three is fine, more is...