Foundation Models and Generative AI
摘要
This chapter begins by defining the scope of foundation models and generative AI and discussing their differences. We then highlight the unique machine learning paradigms by introducing the neural scaling laws and emerging capabilities of foundation models. We explore the landscape of foundation models through the lens of the AI lifecycle and common practices, and present some canonical examples of foundation models. Finally, we provide our perspective on foundation models.