Activity
Mon
Wed
Fri
Sun
Jan
Feb
Mar
Apr
May
Jun
Jul
Aug
Sep
Oct
Nov
Dec
What is this?
Less
More

Memberships

Learn Microsoft Fabric

14.3k members โ€ข Free

3 contributions to Learn Microsoft Fabric
Connect MongoDB Atlas with Pyspark
Hi, I want to connect MongoDB Atlas with PySpark inside Microsoft Fabric Notebook. But, i am getting an error. Here is my stack overflow asked question link https://stackoverflow.com/questions/78681242/connect-mongodb-atlas-with-pyspark-inside-microsoft-fabric-notebook/78688902#78688902
0 likes โ€ข Jul '24
When i ask to chartgpt about the error it give me this response, To connect your Microsoft Fabric workspace to MongoDB Atlas, you need to ensure that the outbound network rules allow access to MongoDB Atlas endpoints. How can i check this.
How do you manage updates/deletes in batch processing
Hi all, I'm new here and in data engineering as well. We are trying Fabric for our organization and I need some advice/recommendations from you. I need to copy data from Azure SQL Database and Azure CosmosDb for Mongo into Microsoft Fabric for further analysis. I'm using Data Pipeline and the Copy action that runs every 12 hours and copies the data (where CreatedAt >= (now-21h). It copies the new data into Warehouse but what about updated data or deleted? How to keep my Warehouse in sync with the SQL and Mongo data? What are the best practices here? I'm not using Spark and want to avoid it if possible. Thank you in advance
0 likes โ€ข Jun '24
Hi @Will Needham , Currently, database mirroring is not supported for MongoDB. To copy data from MongoDB Atlas to our Lakehouse, I am using PySpark in a notebook environment. I installed the mongo-spark-connector_2.12-10.2.0 within the Fabric environment under custom libraries. However, when attempting to load the collection, I encountered an error. For additional details, please refer to my question on Stack Overflow stackoverflow.com/questions/78681242/connect-mongodb-atlas-with-pyspark-inside-microsoft-fabric-notebook Thank You in advance!
๐Ÿ‘‹ New joiner? Welcome! Start here ๐Ÿ‘‡
Welcome to all new members, here's some links and information to help you get started! ๐—ค๐˜‚๐—ถ๐—ฐ๐—ธ ๐—Ÿ๐—ถ๐—ป๐—ธ๐˜€ ๐˜๐—ผ ๐—ด๐—ฒ๐˜ ๐˜€๐˜๐—ฎ๐—ฟ๐˜๐—ฒ๐—ฑ - For an introduction to this community โ†’ Explore the Welcome Pack - New-ish to Fabric? โ†’ Check out our Fabric Foundation module - Studying for the DP-600? โ†’ Check out the DP-600 Module and the DP-600 category - Studying for the DP-700? โ†’ Check out the DP-700 Module and the DP-700 category - Want to get hands-on? โ†’ Check out Fabric Dojo ๐—›๐—ผ๐˜„ ๐˜๐—ผ ๐—ฒ๐—ป๐—ด๐—ฎ๐—ด๐—ฒ ๐˜„๐—ถ๐˜๐—ต ๐˜๐—ต๐—ฒ ๐—ฐ๐—ผ๐—บ๐—บ๐˜‚๐—ป๐—ถ๐˜๐˜†? - Share your knowledge and experience! Even if you're relatively new to Fabric, or the community, your opinion and experiences are valued here! A great way to earn your first point(s) is to introduce yourself in the thread below ๐Ÿ‘‡๐Ÿ˜€ Thank you for engaging and joining us on this exciting learning journey! ๐Ÿ™ Will
2 likes โ€ข Jun '24
Hi, I'm Dipti from India. I work as a SDE III (Data). I am passionate about leveraging analytical solutions to enhance the decision-making process within my organization. I am eager to explore and implement innovative data-driven strategies to drive business success.
1-3 of 3
Dipti R
1
3points to level up
@dipti-r-9617
Developer

Active 368d ago
Joined Jun 28, 2024
Powered by