2024-09-30 - Mr Clicky Clicky¶

Release¶

Status: Available

Type: Bug-Squash

Date: 2024-09-30

Problem¶

When users clicky clicky to start multiple pipelines at the same time from data map we can end up with scenarios where jobs run over top of each other and insert duplicate records into tables.

Solution¶

By deploying a new cloud function check_table_lock() we can set a temp processing lock on a table to prevent another process from updating it simultaneously.

Leverage the Magic¶

A new cloud function that we call at the start of every pipeline to check the target table isnt currently locked by another process.

ADI¶

Smashed !

Last Refreshed¶

Doc Refreshed: 2024-10-29