2024-10-23 - Data Contracts - take 1 - notify¶
Release¶
Data Contract Notifications: Keeping Your Data in Sync
We’re excited to announce a new feature designed to keep your data clean and consistent!
The Problem: Sometimes the source systems that send data to AgileData.io change the structure of their files, adding or removing columns. This can lead to inconsistencies and errors in your analysis.
The Solution: We’ve introduced Data Contract Notifications to help you stay on top of these changes. Now, when new data arrives that doesn’t match the expected structure, you’ll receive a notification. This gives you early warning and the opportunity to investigate and take action if needed.
How it Works: We’ve built a new cloud function called “check_data_contract” that runs automatically whenever new data arrives. This function compares the incoming data to your existing data contract and alerts you if there are any discrepancies.
What’s Next: This is the first step in our Data Contract management system. In the future, we’ll be introducing “Ask Adi,” a feature that will guide you through the process of updating your data contract if necessary.
Benefits:
Early Warning: Be alerted immediately when data changes occur, preventing potential errors and inconsistencies.
Data Integrity: Maintain the accuracy and reliability of your data by ensuring it conforms to your defined structure.
Proactive Management: Take control of your data by being notified of changes and making informed decisions.
We’re committed to providing you with the tools you need to manage your data effectively. Stay tuned for more exciting updates on Data Contract management in the coming months!
Last Refreshed¶
Doc Refreshed: 2025-01-15