Core Technologies in Data Engineering

This chapter is designed to get you started. As we begin our journey into advanced data engineering practices, it is important to build a solid foundation in key concepts and tools. This chapter is designed to provide a refresher on Python programming and software version control using GitHub and a high-level review of structured query language (SQL). While these may seem not connected and different from each other, they play an important role in developing effective data engineering pipelines. Python’s data ecosystem, software version controlling systems using Git, and working with relational database systems using SQL will certainly solidify your foundations and help you tackle data engineering challenges. These are challenging and complex topics, especially reviewing them together; I hope you persist, learn, and practice on your own.