Is it possible to run the data pipelines with App Identity, not user identity?

Jun '24 (edited) • Technical

I have couple of notebooks and data pipelines. When the pipelines are manually initiated or scheduled run, it takes my identity to run the data pipeline. Let's say the notebook in the data pipeline is connecting to a KeyVault to read sensitive info then if I have access to the resource it runs.

The problem is, if one of my resources who create this data pipeline no longer in the team or organization then those pipelines are not at all running.

Hence, I wanted to understand if there is a way to use app identity instead of user identity.

@Will Needham

your help here is highly appreciated. Thanks in advance.

6 comments