Digital transformation and app modernization programs results in new applications developed in the cloud or legacy apps moved to cloud. Along with the apps the data is also generated, moved, collected and stored in the cloud. The cloud data also needs to integrate and work with the data in onsite data repositories. As new data sources gets created it create new challenges for enterprises to track and manage data.
 |
| Data storage and flows in hybrid cloud (image from Microsoft learn) |
The consumers of data need to know where the data source is and how to connect to it. They also need to be able to trust the source of data. Data reliability is a concern when the data is used for AI and machine learning models and business insights generation.
The data producers needs to annotate, classify and create documentation for the data. Data management and maintenance is quite a challenging task for an enterprise with multiplying sources of data.
The data security admins needs to discover, identify, protect and restrict access to new and existing data sources. They need to make sure that proper process is followed when accessing sensitive classified data. Ensuring data classification, security and reliability is a concern for the admin with the increasing data generation and usage.
Finally there is the compliance aspects that needs to be met with Corporate data policies. This includes GDPR, HIPPA, PCI and other regulatory and industry standards. Data reporting is needed to ensure compliance is met.
This exponential growth and complexity in enterprise data in the cloud requires a cloud data governance platform.
The benefits of having a data governance platform can be -
1. An enterprise data catalog provide easy access to different source of data and information on those sources. This helps in better data discovery.
2. Ability to make use of the data source and collaborate on the same with other users - for example asking for access
3. Help in compliance - to make sure there is proper policy and procedure for enterprise data - manage the producing, consuming, storage and archiving of enterprise data,
Microsoft has a cloud PaaS data governance platform called Azure Purview. Enterprise clients looking for Cloud data governance and compliance can benefit from using Azure Purview.
I will write more about it once I have got some hands on experience testing Azure Purview with Power BI and Dynamics 365. How are you planning to manage and govern your data in cloud and onsite? Do you know where is your data?
Thanks for reading.
@mihirCRM
365WithoutCode
