Generative Deep Learning

Generative AI has captured the interest of a large section of our society of late. This interest has been created by the impressive results obtained by AI tools like ChatGPT, DallE, and Stability.ai. While the application domains for these tools differ significantly, and the details of the algorithms within them are also different, they share a common feature in that they are generative algorithms. Although we may have some intuitive feel for what the word generative implies, it is worth defining it with some rigor in order to make progress in understanding these algorithms. This is the main focus of this chapter.