Hi, I have a SCD table named targets and the following columns id, product, target, version, startdate and enddate. Currently, i look-up my sales data by doing a inner join to targets table and linked like this sales.sales_date between target.startdate and target.enddate. I feel that this is not optimal due to size of SCD(around 150k rows per version and changes 3 to 5 times per week). what is the best approach to achieve optimal performance?

New blog post: Mirroring SQL Server Database to Fabric I know quite a few of you have on-prem sql db's that you want to Mirror. This approach seems to be a bit of a workaround (replicating to Azure SQL), whilst they build the full feature, but might be interesting for some people. Thoughts on this? Is this something you're going to try?

Hi There. Is there a way to share my powerbi report with users in my company that do not have powerbi pro lic like for them to view the report i'm sharing? If so how? How can Power Automate or SSIS help?

Hi, We are planning to load csv files from Azure Data Lake Gen 2 to our fabric lakehouse. Every hour, it is expected that new file will be added. In using Fabric Lakehouse, how can we ensure that only new files will be added to our lakehouse instead of doing full load every hour? Ant

Hi everyone, I'm working on a project that involves multiple query transformations. Here's an example of one such transformation: QUERY: SELECT col1 AS name, col2 AS price FROM warehouse_name.schema_name.table_name1 UNION SELECT col3 AS name, col8 AS price FROM warehouse_name.schema_name.table_name2 I need to execute these queries from a Fabric Spark notebook. This step is crucial for my validation criteria. Currently, I have 140 transformation queries that I need to validate by checking counts and performing manual difference calculations. This process is very time-consuming. If I can query these transformations and store the results as a DataFrame, it will significantly simplify the validation process. Could anyone guide me on how to achieve this in a Fabric Spark notebook? Any suggestions or best practices would be greatly appreciated. Thanks in advance for your help!