Table Of Contents

2024-10-23 - Prototype flow for non yyyy-mm-dd dates

Release

Status: Available

Type: App-Features

Date: 2024-10-23

Problem

When prototype files are dropped into AgileData, quite often then contain date and timestamp formats that aren’t supported by BigQuery.

Solution

We now check every prototype file and if dd/mm/yyyy dates are detected we notify the user with a sample of the data and the fields that wont meet the data contract for ongoing production loads.

Leverage the Magic

We leverage the existing file_header_parser and include a check for invalid date formats (only for prorotype loads)

ADI

Now thats magical !

Last Refreshed

Doc Refreshed: 2024-11-21

Table Of Contents

• 2024-10-23 - Prototype flow for non yyyy-mm-dd dates
  • Release
  • Problem
  • Solution
  • Leverage the Magic
  • ADI
  • Last Refreshed

arrow_back

Previous

2024-10-23 - Rebuild Consume Tiles

arrow_forward

Next

2024-10-23 - Data Contracts - take 1 - notify