Removing duplicates from the SQL-endpoint of a Lakehouse

In the latest video (Transforming data | PySpark, T-SQL & Dataflows in Microsoft Fabric) @ 8.57

it says that after deduplication of the revenue data set, the results can be saved into another table or another downstream activity. I know the sql-endpoint of a lakehouse is "read" only. So, how would I save the results of a deduplication query to another file in the Lakehouse. Even tried to a DW but the command is always rejected.

-- deduplication

CREATE TABLE [LH_BRONZE].[dbo].[dedup_revenue]

(

SELECT [Dealer_ID]

,[Date_ID]

,max([Revenue]) 'Revenue'

FROM [LH_BRONZE].[dbo].[revenue]

GROUP BY [Dealer_ID],[Date_ID]

)

This command is rejected, says "CREATE TABLE AS SELECT command is not supported"

1 comment