Design-Driven Data Engineering From Business Design to Database Architecture and Analytics Systems
-
Front Matter
- Title Page
- Copyright
- Dedication
- Acknowledgments
- About the Author
- Preface
- How to Use This Book
-
Introduction
- Why Design Matters
- From Requirements to Results
- Overview of the Design-Driven Framework
-
Part I — Business Design
-
Chapter 1 — Discovering Decisions
- Interview Techniques that Reveal Decisions
- Mapping Actors, Actions, and Outcomes
-
Chapter 2 — Value Chains & Decision Flows
- Value Chain Mapping
- Decision Workflows and KPIs
-
Chapter 3 — Domain Language & Concept Maps
- Capturing Vocabulary and Business Rules
- Building Concept Maps
-
Chapter 4 — From Narratives to Questions
- Translating Business Narratives into Analytical Questions
- Prioritizing Use Cases
-
Chapter 1 — Discovering Decisions
-
Part II — Information Design
-
Chapter 5 — Canonical Models & Boundaries
- Canonical vs Operational Models
- Bounded Contexts
-
Chapter 6 — Dimensional & Event Modeling
- Fact and Dimension Design
- Event-Driven Models and State Machines
-
Chapter 7 — Semantic Layers & Information Products
- Designing a Semantic Layer
- Packaging Data as Products
-
Chapter 8 — Integration Strategies
- Cross-Domain Integration Patterns
- Handling Duplication and Conflicts
-
Chapter 5 — Canonical Models & Boundaries
-
Part III — System Design
-
Chapter 9 — Architecture Patterns
- Medallion / Lakehouse Architectures
- Batch, Micro-batch, and Streaming
-
Chapter 10 — Ingestion & Transformation
- Source Patterns and Connectors
- Transformations, Idempotency, and CDC
-
Chapter 11 — Governance, Quality & Lineage
- Data Contracts and Schemas
- Lineage, Observability and Testing
-
Chapter 12 — Automation & CI/CD for Data
- Infrastructure-as-Code
- Reusable Pipelines and Templates
-
Chapter 13 — Analytics, Semantic Models & Self-Service
- Designing Semantic Models (Power BI, Looker, etc.)
- Enabling Self-Service Without Chaos
-
Chapter 14 — AI-Ready & Real-Time Architectures
- Model Inputs, Feature Stores, and MLOps Basics
- Designing for Real-Time Decisioning
-
Chapter 9 — Architecture Patterns
-
Practical Tools, Templates & Patterns
- Business Design Blueprints
- Canonical Entity Templates
- Dimensional Modeling Guidelines
- Pipeline & Orchestration Blueprints
- DevOps / DataOps Automation Scripts
- Governance & Observability Checklists
-
Case Studies
- Retail Analytics — From Concept to Production
- Financial Services — Real-Time Risk Monitoring
- Healthcare — Secure Interoperable Models
-
Appendices
- Appendix A — Glossary
- Appendix B — Tools & References
- Appendix C — Companion Course Overview
- Appendix D — Suggested Reading
- Appendix E — Templates & Sample Code Index
-
Back Matter
- Notes
- References
- Index
- Credits
Generated Table of Contents — adapt chapter titles and ordering as needed for your manuscript.