Hey everyone, happy Monday! I'm currently planning out future content for the YouTube channel, and want to always produce the content that is most relevant/helpful to you! So, some questions: - What are your biggest pain points currently with Fabric? - Anything you're struggling to understand? - Things you think are important, but don't quite grasp yet? It's this kind of engagement that led to the Power BI -> Fabric series, and then the DP-600 series, so I thought I'd open it up to you again! Look forward to hearing from you - thank you! Here's some potential things: - Delta file format - integrating AI/ ML/ Azure AI / Open AI - copilot - Git integration / deployment pipelines / CI/CD - data modelling / implementing SCDs - medallion implementation - more advanced pyspark stuff - data pipelines - metadata driven workflows - dataflows (and optimising dataflows) - lakehouse achitectures - real-time - data science projects - semantic link - migrating semantic models - using python to manage semantic models - administration/ automation - fabric api - other...?

This could be quite a fun week of announcements - including this one - a new Data Factory item for creating Airflow DAGs. What's Airflow? It's a python-based orchestration framework (similar-ish to data pipelines, but python-based and open-source). Any Airflow wizards out there??

Not sure if anyone can relate but here goes: I've started using chatgpt extensively to get up the learning curve on spark & python specifically (coming from a reasonable sql base). What started off has mere curiosity morphed into full blown multi-hour gpt sessions querying and re-querying code with heavy in-line formatting to help me understand what does what within a library or specific transformation. It's been great, but I've started to pick up a bit of scorn from the more 'traditional' data engineers in our business. I don't actually mind too much, but this category of assisted learning is quite incredible, and strange to think it didn't exist even 6-months ago. It makes me wonder about the future of this space given how fast things are moving 😅

I'm excited to share that I've passed the DP-600 exam. Thanks to @Will Needham for all the great content he created to help us. I will keep on checking this community to keep on learning and all the video's on Youtube. Have a great weekend!

Hey Guys! Just found this new tab in Fabric. It's called "Real-time hub". It looks like a really interesting place to kind of manage all the streaming data sources for Fabric [Image attached]. It has segregated all sources into 3 further sections, you can see what each of them is for in the image. Also, one more thing I noticed is Fabric events has got integration with Data activator, and we can set alerts on Fabric events, and it provides us 3 options for action. [Image attached]