2023-03-27 - Orchestration Iteration¶

Problem¶

Using a wait pattern inside a serverless cloud function is not a very efficient pattern.

Solution¶

Use a log event trigger (bigquery job completed), so instead of waiting for something to finish we shut down all cloud functions and the log event triggers the next function to start.

Leverage the Magic¶

A behind the curtain feature, no action by Data Magicians required.

ADI¶

Boom!, as an AgileData Data Ops Engineer, I like simplicity in the patterns that we depend on to safely move data through the layers.

Customer¶

Hurrah!, it’s great to know the platform is constantly being improved to make it simpler and more efficient.