Hello everyone, I hope you are doing well. I am looking for suggestions on setting up an environment to retrieve stock data using a streaming strategy. The data source will be the Bloomberg service/terminal. I would like to keep this pipeline simple. The key requirements are: 1. Read and save the data. 2. Make the data available for use. 3. Partition the data by year, month, and day. Could you please provide recommendations for the architecture and services I should use? Thank you!

Hi everyone, I just conducted a test and would like to hear your opinions. I created two distinct pipelines: one using Dataflow (PowerQuery) and the other using notebooks with Spark. The task is quite simple, but I am using two large tables in this process. Basically, I perform a join (merge) and expand the columns, unifying the two tables. The problem is that this simple process takes 30 minutes to run in Dataflow, while it only takes 3 minutes using notebooks. My question is: if we consider that an analyst has the option to use either Dataflow or notebooks to build this pipeline, I understand that the performance of notebooks will always be better. Is my assumption correct? What is your opinion? Thank you.

Hello, Anyone has a definitive answer between if we should use parquet or delta ?

My MS Fabric license just extended from 6 days left to 29 days! More time to enjoy... 😄 how about you guys?

My 60-day free trial is coming to an end... after 383 days (thanks Microsoft) 😂 Yours probably is too. The question is, are you prepared? What are your options? 1. You can purchase a F-SKU capacity from the Azure Portal, and reassign your existing workspaces to that new capacity. Or, 2. If you're still not ready to buy an F-SKU yet, the documentation states you can create a new trial capacity with a new user, and reassign your workspaces to that new trial capacity. 3. Any others? Let me know! Important things to note: - If you don't upgrade to a paid Fabric capacity before the end of the trial period, non-Power BI Fabric items are removed according to the retention policy upon removal (I believe this is 7 days soft delete, but double check, and also don't let it get to this!)