Table Of Contents
Table Of Contents

2023-03-27 - Orchestration Iteration

Problem

Using a wait pattern inside a serverless cloud function is not a very efficient pattern.

Solution

Use a log event trigger (bigquery job completed), so instead of waiting for something to finish we shut down all cloud functions and the log event triggers the next function to start.

Leverage the Magic

A behind the curtain feature, no action by Data Magicians required.

ADI

Boom!, as an AgileData Data Ops Engineer, I like simplicity in the patterns that we depend on to safely move data through the layers.

Customer

Hurrah!, it’s great to know the platform is constantly being improved to make it simpler and more efficient.