Activity
Mon
Wed
Fri
Sun
Jan
Feb
Mar
Apr
May
Jun
Jul
Aug
Sep
Oct
Nov
Dec
What is this?
Less
More
Memberships
Learn Microsoft Fabric
14.3k members • Free
4 contributions to Learn Microsoft Fabric
Apr '24 •
Deployment pipelines, medallion architecture and dev/test/prod data sources
Hi team, I am currently looking to use Fabric to build an enterprise data analytics platform and I would like to use deployment pipelines to manage my dev, test and prod workspaces. Within each workspace I am keen to adopt the medallion architecture to assist with implementing a data quality framework. My question is when deploying from the dev workspace to the test workspace (or test to prod) I also want to migrate all my artifacts from the dev data sources to the test data sources, is there an easy way of automatically migrating the data sources for all of the pipelines, dataflows and notebooks in the workspace? Cheers Mark
1 like • May '24
@Will Needham, it's all good, I have a workaround, I'm happy again 🎉
2 likes • May '24
@Will Needham For now, I am using Power BI Desktop to connect to the Gold Layer Lakehouse tables and build the Semantic Model. Git versioning works, Data Factory Pipeline works with Pyspark Notebooks, and the Deployment Pipeline works. The final task is to add the Deployment Rules to change the default Lakehouse setting for each of the Pyspark Notebooks. Woo Hoo!
🚀
Mar '24 •
New to the community? INTRODUCE YOURSELF! 😊
Hey everyone! This community is growing FAST. It would be great for any new members to introduce yourselves so that we can get to know each other... to understand your goals so that we can offer good support in your Fabric learning journey 🙌 So if you haven't already, please introduce yourself, with the aid of the following questions: 1. Which part of the world are you signing in from? 2. What's your current role? And your dream role in say 5 years time? 3. What attracted you to this community? 4. What excites you most about Fabric? 5. I'm really interested in learning more about _______ ? 6. Are you looking to get Fabric certified (DP-600)? Thank you for engaging and joining us on this exciting learning journey! 🙏 Will
4 likes • Apr '24
Hi everyone, I am very excited to be joining you on the Fabric journey. 1. I am signing in from Adelaide in South Australia. 2. My current role is leading a small Business Intelligence and Data Analytics team in the State Revenue Office. 3. I was originally introduced to the community after watching one of Will’s excellent videos. 4. What excites me the most about Fabric is the potential for building a well-managed, extremely secure but easily accessible enterprise data platform that can deliver a truly federated solution that can be simply support by a dedicated centre of excellence team. 5. I am interested in learning about the best practice end-to-end lifecycle for developing and maintaining business intelligence, data analytics and machine learning solutions. 6. I have only just started the learning path for the Fabric certification. Looking forward to collaborating with all of you. Cheers Mark
0 likes • Apr '24
@Will Needham that is a great question. Currently our department is working on a digital transformation strategy, which is being driven by our central ICT team. So far, the team has delivered a number of valuable UX improvements but haven't had a real focus on data or AI. I work for one of the outer agencies and don't have any real influence over this team, so I am taking a bottom-up approach for now. I am looking to deliver a couple of quick wins with data related projects for our agency to demonstrate the value of a more data and AI focused program across the whole department. I am planning on using Fabric to bring the data from a couple of our main line of business systems together into the one workspace (using the medallion architecture methodology, data pipelines and notebooks). This should initially address many of our data quality issues and automate a number of our manual ETL processes. It will also create a single source of truth for our customer relationships which should result in more efficient processes for our staff and finally better outcomes for our customers. Well, that's the plan. 😁
Apr '24 •
Git Integration
Hey everyone, I was just wondering if anyone has started using Git integration with Power BI PBIP files?
0 likes • Apr '24
@Will Needham good to hear, I will be very interested in seeing the material you develop. I am not sure how to explain the issue I keep getting but I will try. We linked our Power BI workspace to an Azure DevOps repo which seemed to work correctly. Subsequently every time I need to update one of our existing reports (PBIX files), I create a new local branch and save the updated report to my local repo as a PBIP file. After I have finished all the required changes to the report I push the local branch to the Azure DevOps repo, someone will conduct a review and then merge the new branch with our main branch. However, for some reason we keep generating conflicts between the Azure DevOps repo and our Power BI workspace. The conflict is indicating that somehow, we have created a new sematic model and updated the report and the dataset. The only way we have been able to resolve the issue is by reverting the merge, deleting the existing report and sematic model from the workspace and DevOps repo, pulling the update main brain from the DevOps repo to the local repo and then re-saving the updated PBIP to a new local branch and re-pushing the new local branch. I assume this works because we deleted the report and model from the workspace and DevOps repo. I am sure we are doing something wrong to cause this problem but I don't know what. I hope this makes sense. 🤪
0 likes • Apr '24
Hi @Suresh Guddanti , you should be able to review all the old changes using Azure DevOps. I found this blog helpful. Microsoft Fabric Lifecycle Management – Getting started with Git Integration and Deployment Pipelines | Microsoft Fabric Blog | Microsoft Fabric
🚀
Feb '24 •
Welcome new joiners! 8 things to know to get started:
Thank you so much for joining this community! Here's 8 things you should know about this community: 1. The goal is to help you learn Fabric faster, by joining a community of people that is also on the same journey with support from others a bit further ahead on the same journey. You can read more about Why I started this community here. 2. Please read and follow the community guidlines before you get started. 3. The community rewards engagement. There is a leaderboard. You earn 'points' when you post valuable posts that people Like or Comment - one Like/Comment = one Point. Learn more about this here. You can earn your first points by introducing yourself here to say hello! 4. We have Classroom modules for learning new stuff about Fabric (I'll be adding more here shortly). 5. Some courses require you to have some 'points' - again to reward engagement in the community! 6. The Calendar includes events that I will be running for the community. 7. Please post! Ask good questions and feel free to share your experiences on other people's posts. Your experience and perspective is valuable. 8. Download the Skool mobile app to follow and contribute to conversations on the go! Download for: Android users | Apple iOS users)
1 like • Apr '24
I am enjoying the content so far and looking forward to getting more involved. 👍
1-4 of 4
@mark-spencer-1297
A passionate Data Scientist who has been working in Information Technology and Data Analytics for over three decades.
Active 11d ago
Joined Mar 27, 2024
Powered by