Programmable Data Pipelines
摘要
Though SQL is a fundamental skill for data engineers, one might need to go beyond plain SQL often in today’s world. Using programming languages (like Python) and other frameworks like Spark provides the flexibility to write complex programmatic constructs within their data pipeline.