Book Profile
Data Mesh Delivering Data-Driven Value at Scale (Final Release)
Dehghani, Zhamak · 2022
A decentralized sociotechnical approach for managing analytical data at scale that shifts ownership to business domains, treats data as a product, and is supported by a self-serve platform and federated computational governance.
Get the book →Traditional, centralized data architectures like data warehouses and data lakes are failing to deliver value at scale in complex, growing organizations. This book introduces Data Mesh, a paradigm shift that decentralizes data ownership to business domains and treats analytical data as a first-class product. This approach, supported by a self-serve data platform and a federated computational governance model, aims to increase agility, respond gracefully to change, and unlock greater value from data by aligning data management with the distributed nature of modern businesses, ultimately enabling organizations to become truly data-driven.
What it argues
This model describes the causal pathway proposed by the book 'Data Mesh'. It posits that implementing the four core principles of Data Mesh (Design Levers) leads to improved intermediate states like team autonomy, data usability, and reduced bottlenecks (Mediators), which in turn drive the ultimate business outcomes of organizational agility and increased return on data investment.
Key ideas it contributes
- Decentralized Domain Ownership — The organizational and architectural principle of assigning long-term responsibility for analytical data to the cross-functional business domains that are closest to it, either as the source or primary consumer.
- Data as a Product Orientation — The principle and set of practices for treating domain-owned analytical data as a first-class product, focusing on consumer needs, usability characteristics (discoverable, addressable, trustworthy, etc.), and explicit quality guarantees.
- Self-Serve Data Platform — The provision of a domain-agnostic, self-service platform that provides tools and services to abstract technical complexity and enable domain teams to autonomously manage the full lifecycle of their data products.
- Federated Computational Governance — An operating model for data governance that balances domain autonomy with global interoperability through a federated decision-making body and automated, computationally-enforced policies embedded within the platform and data products.
- Domain Team Autonomy and Accountability — The degree to which domain-aligned teams possess the freedom, capability, and end-to-end responsibility to independently manage, evolve, and serve their analytical data products to meet consumer needs.
- Data Product Usability — The perceived quality of data products by consumers, encompassing attributes such as discoverability, addressability, understandability, trustworthiness, security, and ease of access.
- Developer Productivity and Enablement — The ease and efficiency with which generalist developers can build, deploy, and maintain data products, facilitated by the reduction of cognitive load and abstraction of underlying technical complexity.
- Mesh Interoperability — The degree to which data from different, independently-owned data products can be easily discovered, connected, and composed to generate higher-order insights, enabled by global standards and common protocols.