LogoLogo
Back to OsmosDeveloper DocsOsmos BlogWhat's New
  • Welcome to Osmos
  • 👋Getting Started with Osmos
    • Terminology
  • 🎉What's New
  • 🧩Osmos API Reference
  • ⌨️Osmos Chat
  • 👩‍💻Developer Docs
    • Manage API Keys
    • Embedding an Osmos Uploader
    • Embedding Uploader Jobs Table
    • Turning on Advanced Mode Uploader
    • Customizing Uploader Styling
    • Passing Parameterized Fields
    • Configuring Uploader's "Recall" functionality
    • Optional Uploader Settings
    • Uploader Submission Callback
    • Configuring AutoClean for your Uploader
    • Uploader Client-Side Validation
      • Data Validators
      • Checking for Duplicate values in a field
      • Creating Dropdown-Controlled Fields
      • Dynamic Dropdown Options
      • Dropdown Interaction with Validation Functions
    • Validation and Transformation Webhooks
      • OpenAPI Validation Webhook Testing
    • Parser Webhook for file based connectors
  • 🔠Datasets
    • Osmos Datasets
      • Uploading Data to your Table
      • Creating Primary and Foreign keys
      • Osmos Dataset Destination Connector
      • Osmos Dataset Source Connector
      • Dataset Edits
    • Datasets Query Builder
      • Query Builder Metadata
    • Performing Look Ups
      • Performing Joins
        • Types of Joins
  • ⏏️Uploader
    • Creating an Osmos Uploader
      • Testing your Osmos Uploader
    • Uploader Validation Summary
    • Advanced Mode
      • Overview
      • Process
    • Standard Mode
      • Overview
      • AutoClean
      • Process
    • AI AutoMapping
    • Uploaders Page
    • Uploader Details Page
  • 🔀Pipelines
    • Step 1. Select the Source
    • Step 2. Select a Destination
    • Step 3. Map & Transform Data
    • Step 4. Schedule the Pipeline
    • Step 5. Review & Confirm
    • Pipelines Page
    • Pipeline Details Page
  • ⏩Data Transformations
    • AutoMap
    • Column Mapping & Data Cleanup Panel
    • QuickFixes
    • AI Value Mapping
    • AI AutoClean
    • Lookups
      • Performing Lookups
    • SmartFill
    • Formulas
      • Date & Time Formulas
        • DateTime Format Specifiers
        • Timezone specifiers
      • Math Formulas and Operators
      • Logical Formulas & Operators
        • True & False Casting
      • Text Formulas
      • Other Formulas
    • Deduplication
  • ↘️Source Connectors
    • Amazon S3
    • Azure Blob Storage
    • BigQuery
    • Email
    • FTP
    • Google Cloud Storage (GCS)
    • Google Drive
    • Google Sheets
    • HTTP API (Call an Osmos API)
    • HTTP API (Osmos Calls Your API)
    • Osmos Dataset
    • Snowflake
    • Accessing Sources behind firewall
  • ↖️Destination Connectors
    • Amazon S3
    • BigQuery
    • FTP
    • Google Cloud Storage (GCS)
    • Google Drive
    • Google Sheets
    • HTTP API (Call an Osmos API)
    • HTTP API (Osmos Calls Your API)
      • Passing Dynamic Tokens in the API Header
    • MySQL
    • Osmos Dataset
    • PostgreSQL
    • Snowflake
    • Accessing Destinations behind firewall
  • 🗂️Projects
  • ⚙️Administration
    • Email Notifications
  • 🔒Security
  • 📞Support
  • Back to Osmos.io
Powered by GitBook
On this page
  • Overview
  • Creating an Osmos Dataset
  • Adding a Table to your Osmos Dataset
  • Dataset Actions
  • Create Table
  • Query your Dataset
  • Cloning your Osmos Dataset

Was this helpful?

  1. Datasets

Osmos Datasets

In this section you will learn the basics of how to create a new Osmos Dataset and Dataset Tables.

PreviousDatasetsNextUploading Data to your Table

Last updated 8 months ago

Was this helpful?

Overview

This page outlines the initial process for creating a new Osmos Dataset.

Creating an Osmos Dataset

Step 1: Click the Datasets icon and select Create Dataset.

Step 2: In the New Dataset Window, enter the name of your Dataset.

Step 3: Hit Save.

Adding a Table to your Osmos Dataset

Step 1: Click the Dataset icon, and select your newly created Osmos Dataset.

Step 2: Select Add New Table.

Step 3: Enter the Table Name.

Step 4: Enter the Schema.

Design the output schema via two options, either import the schema or build it within Osmos.

Option 1: Schema Import

Upload or drag & drop the schema file.

Import a file with the headers along with one row of sample data. This data is used only in schema creation.

Option 2: Building the Schema for the Destination Connector

Use the schema designer to build the output schema for your table.

Parameter

Description

Field Name

Provide a field name for the output fields. These names will be used as the column headers or field names in the output file you are writing to.

Type

Define the type of each field. The field types will be used to enforce rules when you send data to this Connector.

Required

Check this box if the field is nullable. If the field is not nullable, you will be required to provide values for this field when sending data to this Connector.

Actions

Deletes the field.

Add Field

Adds another field to the schema.

Upload Schema

Upload schema or drag & drop header fields

Add Foreign Key

Add a foreign key column to be used in a lookup & join criteria when the data from a related table is combined

A Primary key can be associated with this table. The key field must be required and unique.

Select Save Table.

Dataset Actions

You can take four actions in a Dataset.

  1. Create Table

  2. Access QueryBuilder

  3. Clone a Dataset

  4. Edit a Dataset

Here is a drill down on the Dataset options:

Create Table

Query your Dataset

Drill directly into the Query Builder to build your table filters, joins, and aggregations.

Step 1: Click the cylinder icon from your Osmos Dataset

Cloning your Osmos Dataset

Cloning will duplicate a Dataset. Note, that this process will move the existing tables but will not clone the data in each table.

Step 1: Click the clone icon from your Osmos Dataset.

Step 2: Select the Project.

Step 3: Enter the new Dataset Name.

Step 4: Click on Clone.

See for more detail

For more guidance on

🔠
Key Fields
the Query Builder.
See above