In this podcast, Daniel Bryant sat down with Zhamak Dehghani, principal consultant, member of technical advisory board, and portfolio director at ThoughtWorks. Topics discussed included: the motivations for becoming a data-driven organization; the challenges of adapting legacy data platforms and ETL jobs; and how to design and build the next generation of data platforms using ideas from domain-driven design and product thinking, and modern platform principles such as self-service workflows.
Why listen to this podcast:
- Becoming a data-driven organization remains one of the top strategic goals of many organizations. Being able to rapidly run experiments and efficiently analyse the resulting data can provide a competitive advantage.
- There are several “architecture failure modes” within existing enterprise data platforms. They are centralized and monolithic. The composition of data pipelines are often highly-coupled, meaning that a change to the data format will require a cascade of changes throughout the pipeline. And finally, the ownership of data platforms is often siloed and hyper-specialized.
- The next generation of enterprise data platform architecture requires a paradigm shift towards ubiquitous data with a distribute…
===
Original video: https://soundcloud.com/infoq-channel/zhamak-dehghani-on-data-mesh-domain-oriented-data-and-building-data-platforms
Downloaded by http://huffduff-video.snarfed.org/ on Wed Sep 7 11:06:43 2022
Available for 30 days after download