Hello everyone,
I am trying to use a pipeline (Data Engineering) to load excel files that are stored in blob container and then eventually load as table in the Lakehouse.
1) I have the shortcut for the above files In Lakehouse in file section.
2) I have about 3 excel files with about 180 columns and 60k rows.
The data gets loaded successfully but the column names are loaded as Prop_1,Prop_2 etc.
I lose the column names but have all the data loaded.
Another pipeline -
So, I changed the excel files to csv (also removed the space in the column names just to be sure) and ran the pipeline. Though it fails but it did create the empty table with the same column names as in excel files unlike the other pipeline.
Did anyone work on loading multiple excel or csv using pipeline? any insights on this will be helpful.