Interesting Fabric experience · Learn Microsoft Fabric

Sep '24 • General

Interesting Fabric experience

I wanted to share experience, I am working on Fabric on POC, POC was 80% done and i was loading my gold data into delta table, since I wanted to filter delta table i decide to create view in Warehouse and calling delta table within view so i can use lookup or script task or copy activity so i can filter data before sending to destination tables. destination was sql server which was in azure VM.

After that i created pipeline and use copy activity source was view and destination was sql server db tables. when i was running it was giving me firewall error. i started investigating and in couple of days found out some how fabric is not able to pull data from view if i am calling delta table within view if you are using copy activity. huh it was insane. then i step back and created logic to load data directly from delta table as source and it started working great.

Anyone went through this situation?

3 comments