OneLake File Explorer? · Learn Microsoft Fabric

OneLake File Explorer?

https://learn.microsoft.com/en-us/fabric/onelake/onelake-file-explorer

Hey Fabric Friends!

I was curious if anyone has been utilizing the preview feature above and what your experience/opinions of it are.

My team just started using it and it's more efficient than using the Copy activity in a data pipeline.

Our use case is that we have a VM running and script that downloads flat files from an S3 bucket daily. We need to ingest them into our bronze layer in fabric. We started out using pipelines and the process was taking over 1.5-2 hours to complete.

We're trialing a process where we use the OneLake file explorer (basically like a sync between the VM's file browser and our OneLake in fabric) and load the files into our lakehouse directly from OneLake.

It took our processing time down to 30 min. Which is amazing. BUT... we try not to use preview features in production as a general rule because they can still have bugs or MS could always decide not to move forward or CHANGE how they work.

But this improvement in efficiency is REALLY alluring.

Has anyone else been playing around with it? Thoughts?

4 comments