LogoLogo
Back to OsmosDeveloper DocsOsmos BlogWhat's New
  • Welcome to Osmos
  • 👋Getting Started with Osmos
    • Terminology
  • 🎉What's New
  • 🧩Osmos API Reference
  • ⌨️Osmos Chat
  • 👩‍💻Developer Docs
    • Manage API Keys
    • Embedding an Osmos Uploader
    • Embedding Uploader Jobs Table
    • Turning on Advanced Mode Uploader
    • Customizing Uploader Styling
    • Passing Parameterized Fields
    • Configuring Uploader's "Recall" functionality
    • Optional Uploader Settings
    • Uploader Submission Callback
    • Configuring AutoClean for your Uploader
    • Uploader Client-Side Validation
      • Data Validators
      • Checking for Duplicate values in a field
      • Creating Dropdown-Controlled Fields
      • Dynamic Dropdown Options
      • Dropdown Interaction with Validation Functions
    • Validation and Transformation Webhooks
      • OpenAPI Validation Webhook Testing
    • Parser Webhook for file based connectors
  • 🔠Datasets
    • Osmos Datasets
      • Uploading Data to your Table
      • Creating Primary and Foreign keys
      • Osmos Dataset Destination Connector
      • Osmos Dataset Source Connector
      • Dataset Edits
    • Datasets Query Builder
      • Query Builder Metadata
    • Performing Look Ups
      • Performing Joins
        • Types of Joins
  • ⏏️Uploader
    • Creating an Osmos Uploader
      • Testing your Osmos Uploader
    • Uploader Validation Summary
    • Advanced Mode
      • Overview
      • Process
    • Standard Mode
      • Overview
      • AutoClean
      • Process
    • AI AutoMapping
    • Uploaders Page
    • Uploader Details Page
  • 🔀Pipelines
    • Step 1. Select the Source
    • Step 2. Select a Destination
    • Step 3. Map & Transform Data
    • Step 4. Schedule the Pipeline
    • Step 5. Review & Confirm
    • Pipelines Page
    • Pipeline Details Page
  • ⏩Data Transformations
    • AutoMap
    • Column Mapping & Data Cleanup Panel
    • QuickFixes
    • AI Value Mapping
    • AI AutoClean
    • Lookups
      • Performing Lookups
    • SmartFill
    • Formulas
      • Date & Time Formulas
        • DateTime Format Specifiers
        • Timezone specifiers
      • Math Formulas and Operators
      • Logical Formulas & Operators
        • True & False Casting
      • Text Formulas
      • Other Formulas
    • Deduplication
  • ↘️Source Connectors
    • Amazon S3
    • Azure Blob Storage
    • BigQuery
    • Email
    • FTP
    • Google Cloud Storage (GCS)
    • Google Drive
    • Google Sheets
    • HTTP API (Call an Osmos API)
    • HTTP API (Osmos Calls Your API)
    • Osmos Dataset
    • Snowflake
    • Accessing Sources behind firewall
  • ↖️Destination Connectors
    • Amazon S3
    • BigQuery
    • FTP
    • Google Cloud Storage (GCS)
    • Google Drive
    • Google Sheets
    • HTTP API (Call an Osmos API)
    • HTTP API (Osmos Calls Your API)
      • Passing Dynamic Tokens in the API Header
    • MySQL
    • Osmos Dataset
    • PostgreSQL
    • Snowflake
    • Accessing Destinations behind firewall
  • 🗂️Projects
  • ⚙️Administration
    • Email Notifications
  • 🔒Security
  • 📞Support
  • Back to Osmos.io
Powered by GitBook
On this page
  • Contents
  • Argument
  • Pipelines
  • Destination Connector
  • Uploader
  • Formulas
  • Source Connector
  • Transformation
  • SmartFill
  • QuickFixes

Was this helpful?

  1. Getting Started with Osmos

Terminology

Here is a primer to some Osmos terms!

Contents

  • Argument

  • Pipelines

  • Uploader

  • Formula

  • Source Connector

  • Destination Connector

  • Transformation

  • SmartFill

  • QuickFixes

Argument

An argument is an independent input in a formula that is used to determine the value of the formula output.

Pipelines

Osmos Pipelines equip your onboarding teams to send data from a Source Connector to a Destination Connector. You can also clean up and restructure the data before it is sent to the Destination Connector using training examples, column mapping, and formulas. Osmos Pipelines can be set up on a recurring schedule or manually triggered to run.

Destination Connector

A Destination Connector is used to send data to a specific system. You can connect to various systems using Osmos, such as Amazon S3, BigQuery, Google Drive and more. Once you create a Destination Connector, you can connect it to one of your Source Connectors using an Osmos Pipeline, and send data from that Source Connector to the Destination Connector. You can also connect it to one of your Osmos Uploaders, and allow your end-users to upload clean data directly into the Destination Connector.

Uploader

Osmos Uploader enables product teams to quickly build upload buttons and embed them into any web property. These smart uploaders come pre-integrated with Destination Connectors, including databases, SaaS applications, and filestores. Any data uploaded by the end user is saved directly into the destination system, post cleanup. The uploader also comes with an intuitive interface for your end-users to quickly clean the data using training examples, column mapping, and formulas.

Formulas

Formulas are used to quickly transform and map your source data to columns in the output table. We have several predefined formulas (such as CONCAT, DATE, ADD, etc.) that can be used together to complete complex transformations. You can also use simple formulas to directly map source columns to output columns.

Source Connector

A Source Connector is used to access source data within a specific system. You can connect to various systems using Osmos, such as Amazon S3, BigQuery, Google Drive, and more. Once you create a Source Connector, you can connect it to one of your Destination Connectors using a Pipeline, and send data from the Source Connector to the Destination Connector.

Transformation

A data transformation is the process of mapping and cleaning up your data using simple formulas or tools like AutoClean, AI Value Mapping, Lookups and QuickFixes to ensure that source data fits the format of the destination system.

SmartFill

SmartFill is used to quickly transform and map your source data to the columns in the output table. It involves providing examples of the desired output to teach our AI to detect a pattern and create a program that auto-populates the remaining cells for that column with the transformed data. You can provide several training examples for a given column to increase the complexity of the program learned by our AI.

QuickFixes

QuickFixes are one-click data clean-up buttons that allow you to easily clean up your data for the most common scenarios for that data type. Update your columns to fit common, standardized formats for Date, Text, and Numeric data.

PreviousGetting Started with OsmosNextWhat's New

Last updated 11 months ago

Was this helpful?

👋