Real Time data to dashboard · Learn Microsoft Fabric

Real Time data to dashboard

Hi Fabric Community,

If you're interested in exchanging ideas about real-time data, welcome!

I've been grappling with real-time analysis for the past few days and am hoping someone might be working on similar issues or can share best practices.

Goal:

Store and transform streaming data in a way that allows display on an embedded Power BI Dashboard. Since this is intended for a B2B SaaS solution, it adds a layer of complexity.

Currently, I see two main challenges. First, the event stream contains deeply nested JSON with varying arrays, and the transformation possibilities within the event stream are very limited. I'm unsure if KQL update policies would suffice. Ideally, I would need to integrate other data sources at this stage as well.

Second, I aim to create a single dashboard for both real-time and historic data, but I can't think of an effective way to integrate multiple data storages. I don't want to end up with separate dashboards, such as one KQL-based for recent data and another for transformed and stored historic data.

Please feel free to start a discussion on any of these topics. I'd love to exchange approaches and ideas. Honestly, there may be better tools available to solve this issue.

2 comments