2023-07-18 - Catalog - Profile shared tiles to determine business effective date¶
Problem¶
When including shared tiles in change rules as the Given step, the data magician doesn’t always know what the partitioning or business effective date of the History data is, as they didn’t create the History rule for this data..
We default to current_date() as the effective date of the records, which doesn’t pick up the actual business effective date of the Shared Tile.
Solution¶
Get the Business Effective Date for the Shared Tile checking for partitioned columns and existing columns that contain business effective dates for the records.
Reuse the same pattern used for dropped files to magically identify columns that can be used as the effective date.
Leverage the Magic¶
Last Refreshed¶
Doc Refreshed: 2024-03-02