2024-10-23 - Data Contracts - take 1 - notify¶

Release¶

Status: Available

Type: App-Features

Date: 2024-10-23

Problem¶

Sometimes the source systems that send us files to load, change the structure of the file - for example adding or removing columns

Solution¶

Part 1 of implementing data contracts is to notify users when new data does not meet the data contract because a column has been added or removed from the data. After running in this mode for awhile we will enable ‘Ask Adi’ to guide users with the steps they need to take to update the data contract (if required).

Leverage the Magic¶

We leverage notifications and a new check_data_contract cloud function that runs whenever new data arrives.

ADI¶

Now thats magical !

Last Refreshed¶

Doc Refreshed: 2024-11-21