Activity
Mon
Wed
Fri
Sun
Sep
Oct
Nov
Dec
Jan
Feb
Mar
Apr
May
Jun
Jul
Aug
What is this?
Less
More
Data Innovators Exchange

760 members • Free

Data and Ai Automations

2.3k members • Free

Max Business School™

266k members • Free

Mason’s Mastermind

276 members • Free

Freedom Forge (Lite)

2.5k members • $2/month

Meta Ads For Low & High Ticket

5.8k members • Free

Kickstarter Challenge

27.1k members • Free

The AI Advantage

127.9k members • Free

Free Skool Course

71.4k members • $1

1 contribution to Data Innovators Exchange
The format war is over. Your next lock-in moved upstairs. 🧊
Every Iceberg pitch lands the same way: your data, your object storage, an open format, queryable from anywhere. The demo genuinely works. The trouble starts about two weeks into production, when someone asks who is allowed to see column seven — and the answer turns out to live somewhere that isn't open at all. In this edition of datapro.news, we cover the fight nobody announced. A directory of Parquet files in a bucket is inert; it is storage, not a database. Something has to tell an engine which metadata pointer is the current valid state of a table, and whether the querying principal may read it. That something is the catalog. By commoditising the file format, the industry did not eliminate the vendor lock-in it spent a decade complaining about — it relocated it, from the storage layer where it was visible and much-discussed to the governance layer where it is neither. Your Parquet files stay portable. The 5,000 grants, masking rules and policy tags you authored do not. Here are the 3 catalogs the decision actually comes down to: - 🧭 Apache Polaris: Learn why graduating to Apache Top-Level Project in March 2026 is worth more to you than any feature comparison, and why the neutrality you get with it is also an on-call rota — self-hosting means owning HA for the one service every pipeline and dashboard in the company stops without. - 🌿 Project Nessie: Discover the most elegant idea in the field — Git branching, tagging and merging across your entire lakehouse state — plus the due-diligence detail that should stop you adopting it as a destination, because its own sponsor has stated it will fold those capabilities into Polaris and retire the project. - 🔗 Unity Catalog: See why the criticism you have probably repeated in an architecture review is now out of date, and where the real asymmetry sits instead: outbound it is a well-behaved Iceberg REST server, inbound a reluctant client, and that is a design choice rather than a missing feature.
The format war is over. Your next lock-in moved upstairs. 🧊
0 likes • 3h
Exactly. The open format solves the portability problem, but not necessarily the governance problem. Once production workloads need fine-grained access control, identity, permissions, and policy enforcement, the “open storage” story gets a lot more complicated. The interesting battle may not be over file formats anymore—it’s over who controls the layer above them.
1-1 of 1
Golam Qauser
1
5 points to level up
@golam-qauser-5102
Stop living your fear and start living your dream.

Active 3h ago
Joined Aug 19, 2026
Rajshahi, Bangladesh
Powered by