I’m Trying to adjust communication settings for the on prem data gateway connecting to fabric tenant. I work on locked down environment. We need to just enable minimal outbound ports and endpoints where I connect from on prem data gateway to fabric tenant. I have sftp files in on prem which should sync to one lake. what endpoints i need to enable including required ones?

Ever curious about the differences between Data Lake, Data Warehouse, Data Factory, Delta Lake and Lakehouse? Let’s dive into these essential data concepts and explore how they contribute to modern data management. I’ll be using Microsoft services to provide practical examples for those familiar with these technologies, including OneLake, which unifies and centralizes data management in Microsoft Fabric. 1. Data Lake A large storage repository for all types of data—structured or unstructured—in its raw format. Example: Think of Azure Data Lake Storage (ADLS) as your central place to store everything from website logs to sensor data, without worrying about how it’s organized. 2. Data Warehouse A structured, clean storage system designed for reporting and analytics on historical data. Example: Azure Synapse Analytics helps you store processed sales data in an organized way, making it easier to run business intelligence reports. 3. Data Factory A tool for moving and transforming data between different sources and destinations. Example: With Azure Data Factory, you can automate the process of transferring data from an on-premises database to Azure Data Lake, ensuring it’s cleaned and ready for analysis. 4. Delta Lake An enhanced Data Lake offering reliability through ACID transactions and versioning. Example: In Microsoft Fabric, Delta Lake ensures your data is consistent and reliable, whether you're working with real-time streams or batch processes. 5. Lakehouse A hybrid of Data Lake and Data Warehouse, allowing you to work with both raw and structured data in one system. Example: The Microsoft Fabric Lakehouse lets you store unstructured social media data alongside structured sales data, enabling efficient analysis without needing multiple systems. OneLake is Microsoft's unified data lake within Microsoft Fabric, serving as the central hub where all data from different sources—structured, unstructured, and semi-structured—are stored, managed, and analyzed in one place. It integrates with services like Azure Synapse Analytics, Power BI, and Delta Lake, simplifying data management and providing a "single source of truth."

The DP-600 exam is great for giving you an appreciation for a wide range of topics, but does it really prepare you for life as an Analytics Engineer? From speaking with a few of you, it seems you don't feel ready or comfortable yet, which is completely understandable! The DP-600 tests your understanding of the theory, but in the real world, you are measured by your experience and ability to build solutions (how you can apply the theory). As such, I always advise for people to get hands-on as early and as frequently as possible. One of the best Microsoft resources is this list of hands-on exercises which guide you through a number of scenarios, and help you build confidence with the different tools that Fabric provides. Have you tried these resources yet? Let me know what you think! PS: I'm thinking about building a collection of hands-on tutorials which cover a lot of the core analytics engineering/ data engineering (and maybe wider?) tasks that you could expect in your career - would you find that useful?

Welcome to all new members, here's some links and information to help you get started! 𝗤𝘂𝗶𝗰𝗸 𝗟𝗶𝗻𝗸𝘀 𝘁𝗼 𝗴𝗲𝘁 𝘀𝘁𝗮𝗿𝘁𝗲𝗱 - For an introduction to this community → Explore the Welcome Pack - New-ish to Fabric? → Check out our Fabric Foundation module - Studying for the DP-600? → Check out the DP-600 Module and the DP-600 category - Studying for the DP-700? → Check out the DP-700 Module and the DP-700 category - Want to get hands-on? → Check out Fabric Dojo 𝗛𝗼𝘄 𝘁𝗼 𝗲𝗻𝗴𝗮𝗴𝗲 𝘄𝗶𝘁𝗵 𝘁𝗵𝗲 𝗰𝗼𝗺𝗺𝘂𝗻𝗶𝘁𝘆? - Share your knowledge and experience! Even if you're relatively new to Fabric, or the community, your opinion and experiences are valued here! A great way to earn your first point(s) is to introduce yourself in the thread below 👇😀 Thank you for engaging and joining us on this exciting learning journey! 🙏 Will