Thanks Andy. Great vid. Have watched all 3 parts. Is there another option for Dynamics to write the data to ADLS2 without using Synapse Link - appreciate there would be no "partitioned" table etc? If so, would it also suffer from the potential locking when querying it? Cheers.
Hi, you could try using Data Factory/Synapse Pipelines learn.microsoft.com/en-us/azure/data-factory/connector-dynamics-crm-office-365?tabs=data-factory
Thank you so much! I have a question. What is retention period of snapshots? How to delete old snapshot files in storage? Do you have any guidance to automate this process?
A new snapshot file is created only if there's a data update. Only the latest five snapshot files are retained. Stagnant data is automatically removed from your Azure Data Lake Storage Gen 2 account.
We can still partition by either year or year-month in the synapse link config. It’s only when selecting Append Only that it defaults to year and cannot be changed.
Thank you. Is there a way to access the partition location information via synpase or spark pool?
Thanks Andy. Great vid. Have watched all 3 parts. Is there another option for Dynamics to write the data to ADLS2 without using Synapse Link - appreciate there would be no "partitioned" table etc? If so, would it also suffer from the potential locking when querying it? Cheers.
Hi, you could try using Data Factory/Synapse Pipelines learn.microsoft.com/en-us/azure/data-factory/connector-dynamics-crm-office-365?tabs=data-factory
Which option is good to go with ? Synapselink or direct dynamic access ?
Thank you so much! I have a question. What is retention period of snapshots? How to delete old snapshot files in storage? Do you have any guidance to automate this process?
A new snapshot file is created only if there's a data update. Only the latest five snapshot files are retained. Stagnant data is automatically removed from your Azure Data Lake Storage Gen 2 account.
Thank you so much Andy! Great Job as usual. Of course we cannot decide how we partition the data, it looks like it is by year now right?
We can still partition by either year or year-month in the synapse link config. It’s only when selecting Append Only that it defaults to year and cannot be changed.