Hi, I have a table containing around 5m rows. i am connecting to that table through OData feed. i need help with the following: when connecting to it with a dataflow gen2, it takes around 7-8 hours which then fails due to the timeout. when i tried connecting through a data pipeline, i create a cloud gateway following the documentation on Set up your OData connection from microsoft. i set the authentication method to OAuth2 and set up the organizational credentials, the same ones i used to connect within my dataflow gen2. when i tried connecting on my pipeline, i could not find that created connection gateway. how can i achieve a sucessful connection?

I've coded this to create a lakehouse using a "service principal" token and Fabric API, but I got an unknown error. Howerver, If I use an Entra account it works. Have you done something alike successfully? Any ideas to troubleshoot the error. Or alternatives. ----/ A code fragment /--- fabric_base_url = 'https://api.fabric.microsoft.com/v1/' url_lakehouse = fabric_base_url+f"workspaces/{dest_workspaceid}/lakehouses" scope = 'https://api.fabric.microsoft.com/.default' client_secret_credential_class = ClientSecretCredential(tenant_id=tenant_id, client_id=client_id, client_secret=client_secret) access_token_class = client_secret_credential_class.get_token(scope) token_string = access_token_class.token headers = {'Content-Type':'application/json','Authorization': f'Bearer {token_string}'} payload = f'{{"displayName": "LakehouseTEST1"}}' response = requests.request("POST", url_lakehouse, headers=headers, data=payload) ----/ Error /--- <Response [400]> {"requestId":"45544588-914f-4d84-97c5-56f3a414cc59","errorCode":"UnknownError","moreDetails":[{"errorCode":"DatamartCreationFailedDueToBadRequest","message":"Datamart creation failed with the error 'Required feature switch disabled'."}],"message":"An unexpected error occurred while processing the request"} 🙄

Leave a comment with the scariest thing you can say to a Microsoft Fabric Data Engineer / Data Analyst / Data Scientist / Fabric Security Engineer 👀 Scariest saying wins 🎃

How have you dealt with shortcut security regarding this MS note, below? I think this could become a security issue. How can u secure right access permissions to data in a remote workspace from a local workspace? Delegated access could be harmful in semantic models and SQL endpoints. It's scarry that a local workspace user can access remote data via internal shortcuts when they shouldn't. This seems like sql linked service issues. Have someone struggled with this? Plz share your insights and workarounds.

Can anyone provide feedback on Mindhub Practice tests? Are these relevant and how far does it help in your preparation?