TEQnation 2023: Implementing a large scale Data Mesh @PostNL – Patrick Dronk

PostNL, the largest parcel carrier of the Benelux, initially implemented a monolithic data architecture. This architecture made it difficult for engineering teams to make changes to data pipelines without coordinating with other teams, resulting in delays and other challenges. PostNL started researching alternatives and finally chose to implement a data mesh. This is a relatively new concept, but it is gaining traction in the industry as more organizations look for ways to improve the scalability, security, and governance of their data-driven systems.Implementing a data mesh isn’t straightforward. I’ll talk you through how we use a combination of techniques such as a synchronous, asynchronous and raw data API and how we build a data mesh with those techniques that is self-service, semi governed, decentralized, resilient, and scalable. Finally, I’ll also address the challenges we faced while building this.