Bronze layer data ingestion
Hi All, I just got out of a meeting and was asked the question - if you are sourcing data from an on perm Oracle or SQL Server database why load the data into files instead of tables in the bronze layer? Doesn’t this cause extra work by reapplying the schema, data types to the files going to the silver layer? Aren’t the tables easier to work with and since they are stored as files in DataLake anyways? What the key reasons to pick files instead of tables in bronze? All courses I’ve read always load to files. I’d really appreciate the communities thoughts. Thanks all
0
11 comments
James Slebodnick
2
Bronze layer data ingestion
Learn Microsoft Fabric
skool.com/microsoft-fabric
Helping passionate analysts, data engineers, data scientists (& more) to advance their careers on the Microsoft Fabric platform.
Leaderboard (30-day)
Powered by