Goodbye, Export to Data Lake. Hello, Azure Synapse for Dataverse!
In November 2024, the Export to Data Lake feature we have all come to love and rely on in our Microsoft Dynamics 365 environment will be taking its final bow. Currently, the Export to Data Lake feature lets us, as a company, copy data from our Dynamics 365 instance into our own data lake (Azure Data Lake Storage Gen2). Is this functionality lost forever? Where do we go from here?
Azure Synapse for Dataverse has Arrived
Our legacy data integration services.
- Data Export Service (DES)
- Bring your own DB (BYOD)
- Export to Data Lake
Microsoft has introduced Azure Synapse Link for Dataverse service build into the Power Apps, enabling data export from Dynamics 365 apps to Azure Synapse Analytics or Azure Data Lake Storage Gen2. Previously, technologies like Bring Your Own Database (BYOD) and ‘Export To DataLake’ are now recommended to be transitioned to “Synapse Link for Dataverse”. Microsoft’s goal is to unify data export from the Dynamics 365 platform, regardless of whether it’s D365CE or D365 Finance and Supply Chain.
Does That Mean My Data Can Only Come From the Dataverse?
Absolutely not. The Azure Synapse Link for Dataverse enables you to select both standard and custom finance and operations entities and tables. It supports continuous replication of entity and table data, including create, update, and delete transactions (CUD).
Azure Synapse Link Features:
- Entity and Table Selection
- You can choose both standard and custom finance and operations entities and tables.
- Continuous replication of entity and table data is supported.
- Integration with Azure Services
- Easily link or unlink the environments to Azure Synapse Analytics and/or Data Lake Storage Gen 2 within you Azure subscription.
- Data Exploration
- Explore data using Azure Synapse without the need for additional configuration tools.
- All features of Azure Synapse Link for Dataverse are supported.
- Storage and Query Optimization
- Available in all regions.
- Data can be saved as Parquet Delta Files.
- Restricted storage accounts.
Where Do I Begin with Azure Synapse Link?
- Sign in to Power Apps and select your environment.
- In the left navigation pan, click on Azure Synapse Link.
- On the command bar of Synapse Link page, choose + New link to data lake.
- Connect to your Azure Synapse Analytics workspace, specifying the subscription, resource group, a workspace name.
- Select Use Spark pool for processing and pick the procreated Spark pool and storage account.
- Click Next.
- Add the table you want to export. You can select finance and operation tables and Dataverse tables.
- For advance settings, choose Show advance configuration settings and set the time interval (in minutes) for incremental updates.
- Finally, click Save. The selected tables will be initialized and ready for reporting.
The Azure Synapse Link for Dynamics 365 provides a smooth data export solution for reporting, analysis, and integration. Its scalability ensures efficient handling of growing data volumes without affecting D365 performance. Enhanced performance capabilities enable real-time data processing, analysis, and integration.
On-Demand Virtual Session: Transitioning to Synapse Link for Dataverse
This major change may seem concerning on the surface, however, acting now and preparing your organization will ensure a smooth transition from the Export to Data Lake feature to Azure Synapse Link. To help you navigate this change seamlessly, we’re hosting ab on-demand virtual session that will cover:
- Synapse Link for Dataverse Service Overview
- New Available Features
- Known Limitations
- How Does Azure Synapse Link Fit into my Data Model?
- Accessing Your Data from the Synapse Workspace
- What About Microsoft Fabric and OneLake?
Don’t miss this opportunity to stay ahead with the latest in data integration and analytics – watch our on-demand virtual session on this topic here!
