What is needed for notebook permissions for shortcut tables between workspaces

I have two workspaces each with a lakehouse in it. I have my master data in edw workspace edw lakehouse. In the second workspace called analytics I have a lakehouse called analytics. The analytics lakehouse tables are all shortcuts to the tables in the edw lakehouse. I am an admin in both workspaces. I can reference tables in notebooks like this:

df = spark.sql("SELECT * FROM dwp_Account LIMIT 1000")

Recently we rolled out access to the analytics workspace to Data Analyst and Scientist. Currently the group they belong to is Contributor in analytics and viewer in edw. We keep getting the following error message when they try to run the same code in analytics

"An operation with ADLS Gen2 has failed. This is typically due to a permissions issue. 1. Please ensure that for all ADLS Gen2 resources referenced in the Spark job, that the user running the code has RBAC roles "Storage Blob Data Contributor" on storage accounts the job is expected to read and write from. 2. Check the logs for this Spark application. Inspect the logs for the ADLS Gen2 storage account name that is experiencing this issue."

I have given the group my user is a member of "Storage Blob Data Contributor" roles for both storage accounts in our Azure Tenant. Still doesn't work. Anybody have any ideas?

Also, I looked at the logs but was unable to tell what storage account it was trying to use, does anybody know where I can find this out? Thanks.

3 comments