From Sharepoint to DW or Lakehouse with Dataflow gen2

I successfully transferred data from SharePoint to Fabric DW using Dataflow Gen2. Currently, each time I run the Dataflow, I retrieve all the files (with the same schema) from a specific folder and append only the updated rows using Power Query. However, I'm wondering if it's possible to create a pipeline that uses parameters to retrieve only specific files from the folder and append them. Is there anyone might have had a similar experience?? 😭

3 comments