In the present era, Artificial Intelligence (AI) plays a crucial role by offering effective solution across various domains. AI is a broad area that includes both Machine Learning (ML) and Deep Learning (DL) as its key branches. In this chapter, we discussed applications of DL in the field of optical cryptography. It provides a cost-effective and powerful solution to various cryptographic challenges based on supervised and unsupervised learning approach. The chapter begins by introducing optical cryptosystems and their connection to DL algorithms. Some of the characteristics of DL along with its different architectures are discussed for better understanding of readers. Further, the integration of various DL models with optical image encryption techniques is discussed, followed by an overview of practical applications. The chapter also discusses future directions, existing challenges, and potential solutions in this field. Finally, the chapter concludes with key insights and contributions to ongoing research in DL-based optical encryption.