2025-08-23 - Loading YouTube data¶

ADI¶

We’ve rolled out an important enhancement to improve the reliability and completeness of your data, particularly for sources that can sometimes experience delays, such as YouTube.

Previously, data from sources like YouTube could sometimes arrive slower than expected. This occasionally led to situations where combined datasets might not be fully complete, as our system would process data before all components were available.

To address this, our platform now intelligently checks for the earliest available data from all shared sources. This means that even if a data source is delayed, AgileData.io will automatically adjust its loading window to ensure all necessary data is present before processing. You’ll always get a complete and accurate picture.

This enhancement ensures greater data integrity and reduces the need for manual checks or re-runs, providing you with more reliable insights and a smoother data operations experience.

Problem¶

youtube data is slower than GA4, slipping past 4 days, need a separate check for shared data to rollback load window …..

Solution¶

check for shared source with latest partition outside our rolling three day window and use the earliest date to load from.

Leverage the Magic¶

small extension to our existing check_load_position() pattern

Last Refreshed¶

Doc Refreshed: 2025-08-23