data mesh

Archi & Techno

POV: A streaming/communication platform for the data mesh

In 2021, a rich set of data is the soil that empowers the business of all the Internet Giants (GAFAM, NATU, …). Meanwhile, traditional companies are striving to remain competitive. Therefore, the mandatory acceleration of their business goes through a massive digitalization of their operations and assets. Amongst the most valuable digital assets are the data. Big data’s promises are attractive. However, the “data” organizational unit is commonly separated from the core business in the wild. Even if many of those departments provide much effort…

Lire la suite
Data

Data+AI Summit 2020 – be Zen in your lakehouse

In case you missed it, last week was held the first Data+AI Summit (formerly Spark+AI Summit) and we had a chance to participate. The talks will be published online but if you don’t want to wait, take a shortcut and learn our key insights! TL;DR Are you wondering why that title? It summarizes the major announcements from a data engineering perspective. Apache Spark will become more Pythonic thanks to the Project Zen initiative, and very probably, it will work on top of a lakehouse architecture.…

Lire la suite