In this chapter, I describe the differences between a data lake and a data mesh strategy and explain why a data mesh may be a better architectural strategy for enterprises. I’ll introduce Amazon DataZone and describe how it simplifies the implementation and management of a data mesh with features for catalog management, data product publishing and subscription management, data lineage, and data discovery. I’ll highlight data governance features, including the integration of generative AI for metadata management. I’ll address how the organizational structure should change to support a data mesh strategy. Finally, I’ll dive deep into the design and implementation of a data mesh with Lake Formation and DataZone.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Data Mesh Design with Amazon DataZone

  • Justin J. Leto

摘要

In this chapter, I describe the differences between a data lake and a data mesh strategy and explain why a data mesh may be a better architectural strategy for enterprises. I’ll introduce Amazon DataZone and describe how it simplifies the implementation and management of a data mesh with features for catalog management, data product publishing and subscription management, data lineage, and data discovery. I’ll highlight data governance features, including the integration of generative AI for metadata management. I’ll address how the organizational structure should change to support a data mesh strategy. Finally, I’ll dive deep into the design and implementation of a data mesh with Lake Formation and DataZone.