Activity
Mon
Wed
Fri
Sun
Jan
Feb
Mar
Apr
May
Jun
Jul
Aug
Sep
Oct
Nov
Dec
What is this?
Less
More

Memberships

Learn Microsoft Fabric

14.3k members • Free

3 contributions to Learn Microsoft Fabric
SQL Endpoint Synchronization Issue in Lakehouse After Data Load
I am frequently facing synchronization issues with the SQL Endpoint in the Lakehouse. After loading data into the Lakehouse, I typically run a query to get the maximum date and record count from the pipeline. However, I often notice that immediately after the load, no records are returned. To work around this, I’ve had to introduce a 2-minute wait activity before querying the metrics. Has anyone else experienced similar issues? Is there a more efficient way to resolve this synchronization delay, or a setting that can ensure immediate data availability? Any advice or suggestions would be greatly appreciated. Thanks!
Challenges in Cross-Workspace Orchestration for Multi-Layer Data Pipelines
We plan to maintain the bronze and silver layers in one workspace and the gold layer in a separate workspace for reasons related to maintenance, security, and capacity. However, this setup presents a challenge: implementing a master orchestration that includes pipelines from both workspaces. Currently, I'm unable to directly invoke a pipeline from another workspace. Is there any workaround available to address this issue?
0 likes • Aug '24
@Will Needham I recall that it was available in preview earlier, but it seems to have disappeared. Now, I need to find a workaround to address this issue, as I can't wait for Microsoft to reintroduce it. I'm looking for a workaround using APIs or web services to trigger the pipeline across workspaces. If you have any suggestions or ideas, please share them.
0 likes • Aug '24
@Paul Craft This is for security reasons. The gold layer will be accessible to business users, and we want to abstract the data in the bronze and silver layers.
Consuming Tables Across Lakehouses Without ADFS Paths or Shortcuts
Is there a way to consume tables from a different lakehouse within our existing lakehouse without using ADFS paths or creating shortcuts?
1 like • Jul '24
@Will Needham Thanks, Will, for your comment and exploration. It has been very helpful. This lakehouse schema enablement seems like a much-needed feature. Hopefully, they will also incorporate it in the SQL endpoint version to achieve full capability.
1-3 of 3
Vignesh Mm
1
3points to level up
@vignesh-mm-5592
Data Engineer

Active 43d ago
Joined Jun 26, 2024
Powered by