Future $\gamma $ -ray survey instruments, such as COSI, newASTROGAM and AMEGO-X, will significantly improve previous and current all-sky surveys at MeV energies. In this paper we discuss the continuum emission from the Milky Way, two prominent large extended sources, the Fermi bubbles and Loop I, and the extragalactic $\gamma $ -ray background. We highlight the importance of measurements in the MeV to GeV energy range for understanding CR production and propagation in the Galaxy, for the determination of the nature of the Fermi bubbles and Loop I, and for exploring the origin of the extragalactic $\gamma $ -ray background.