Data Ingestion in Lakehouse

Organizations have a wealth of information siloed in various data sources. It could be relational databases, on-prem data warehouses, big data storage like Hadoop systems, ERP/CRM systems, or real-time streaming sources. A significant number of analytics use cases need to not only process this data efficiently but also do it in a unified manner to produce meaningful reports and predictions. So to start this journey, organizations need to ingest data from different sources to a single location. In this chapter, we will look into how you can ingest data from various sources incrementally and efficiently into your Delta Lake layer.