Pipeline design from source to bronze · Learn Microsoft Fabric

Pipeline design from source to bronze

Hi everyone,

I need to get data from an on prem sql server to my bronze layer. Would you recommend loading the files as parquet in the files section or as tables in my Lakehouse?

I initially opted for tables seeing i'm dealing with structured data, but after seeing the video on data validation I am in doubt whether I need to use files instead. Was thinking I could also build a data validation notebook in my silver Lakehouse. That I can perform the validation in Silver instead of in Bronze.

2 comments