Query Builder Metadata

Overview

Query Builder includes a set of metadata that are available to add as columns to any Dataset Table. They are added when you select columns in the Query Builder.

Metadata Fields

Nine metadata fields are available. These include the Osmos internal ID, date create, date modified, user ID, dataflow ID, job ID, uploader ID, raw source data JSON and write index.

Field Details

Osmos Internal ID: A unique identifier is generated for each row in the table. Randomly generated the first time the row is inserted. Will not change in the case of upserts or edits.
Date Created: A timestamp of when the row was first inserted into the table. Stays the same through the life of that row.
Date Modified: A timestamp of the last time that any data in the row was edited, upserted, or changed in any way. Will be updated in the case of upserts even if no data changes in the row.
User ID: The internal ID of the user that initiated the insert/upload/job/edit/etc. updated the row to have its most recent value, or that created the row.
Dataflow ID: The ID of the dataflow which updated or inserted the row. If data is uploaded via Osmos Uploader, this value will be equivalent to the Uploader ID. For pipelines, this will represent Pipeline ID. Will be updated in the case of upserts even if no data changes in the row.
Job ID: The ID of the job which created or updated the row.
Uploader ID: The ID of the Uploader that created or updated the row.
Raw Source Data JSON: A JSON object containing the full data from the source side that was used to map data to this output, if this row was created or updated via an uploader or pipeline. The JSON is returned as a string.
Write Index: Every time data is inserted, upserted, or edited in a dataset table, a unique monotonically increasing write index is associated with it. For each row, the write index will be set to the write index of the insert/upsert/update operation that sets the most recent version of data in this row. This will be updated in the case of upserts even if no data in the row changes.

PreviousDatasets Query Builder NextPerforming Look Ups

Last updated 4 months ago

Metadata Fields

Nine metadata fields are available. These include the Osmos internal ID, date create, date modified, user ID, dataflow ID, job ID, uploader ID, raw source data JSON and write index.

Field Details

Osmos Internal ID: A unique identifier is generated for each row in the table. Randomly generated the first time the row is inserted. Will not change in the case of upserts or edits.

Date Created: A timestamp of when the row was first inserted into the table. Stays the same through the life of that row.

Date Modified: A timestamp of the last time that any data in the row was edited, upserted, or changed in any way. Will be updated in the case of upserts even if no data changes in the row.

User ID: The internal ID of the user that initiated the insert/upload/job/edit/etc. updated the row to have its most recent value, or that created the row.

Dataflow ID: The ID of the dataflow which updated or inserted the row. If data is uploaded via Osmos Uploader, this value will be equivalent to the Uploader ID. For pipelines, this will represent Pipeline ID. Will be updated in the case of upserts even if no data changes in the row.

Job ID: The ID of the job which created or updated the row.

Uploader ID: The ID of the Uploader that created or updated the row.

Raw Source Data JSON: A JSON object containing the full data from the source side that was used to map data to this output, if this row was created or updated via an uploader or pipeline. The JSON is returned as a string.

Write Index: Every time data is inserted, upserted, or edited in a dataset table, a unique monotonically increasing write index is associated with it. For each row, the write index will be set to the write index of the insert/upsert/update operation that sets the most recent version of data in this row. This will be updated in the case of upserts even if no data in the row changes.