Hello Everyone,
I have a shortcut which creates a folder for each year and it contains subfolders which contains json files. I want to append all these json files and want to load into Tables in lakehouse. How i can achieve this using Notebooks. I am new to Pyspark, any help would be much appreciated :)