Table Of Contents
Table Of Contents

2023-09-18 - Converting Spanner payloads to BQ format payloads

Release

Status: Available

Type: DataOps

Date: 2023-09-18

Problem

Currently the app renders spanner (config) results differently to BQ (data) results.

We have a whole series of components for data preview and field preview and profile results etc , but for Spanner logging or config results, we just dump the raw data into simple html tables (not very pretty)

Solution

Develop a new pattern in the api layer which lets us return config in the same json format as BQ results so we can pass it straight into components like TablePreview and get nicely formatted tables with column headers, shading, styling etc

Leverage the Magic

Extend the the logging api endpoints with a simple feature flag that lets us choose between raw json data, or formatted json for displaying in preview components

Last Refreshed

Doc Refreshed: 2024-03-02