LogoLogo
Back to OsmosDeveloper DocsOsmos BlogWhat's New
  • Welcome to Osmos
  • 👋Getting Started with Osmos
    • Terminology
  • 🎉What's New
  • 🧩Osmos API Reference
  • ⌨️Osmos Chat
  • 👩‍💻Developer Docs
    • Manage API Keys
    • Embedding an Osmos Uploader
    • Embedding Uploader Jobs Table
    • Turning on Advanced Mode Uploader
    • Customizing Uploader Styling
    • Passing Parameterized Fields
    • Configuring Uploader's "Recall" functionality
    • Optional Uploader Settings
    • Uploader Submission Callback
    • Configuring AutoClean for your Uploader
    • Uploader Client-Side Validation
      • Data Validators
      • Checking for Duplicate values in a field
      • Creating Dropdown-Controlled Fields
      • Dynamic Dropdown Options
      • Dropdown Interaction with Validation Functions
    • Validation and Transformation Webhooks
      • OpenAPI Validation Webhook Testing
    • Parser Webhook for file based connectors
  • 🔠Datasets
    • Osmos Datasets
      • Uploading Data to your Table
      • Creating Primary and Foreign keys
      • Osmos Dataset Destination Connector
      • Osmos Dataset Source Connector
      • Dataset Edits
    • Datasets Query Builder
      • Query Builder Metadata
    • Performing Look Ups
      • Performing Joins
        • Types of Joins
  • ⏏️Uploader
    • Creating an Osmos Uploader
      • Testing your Osmos Uploader
    • Uploader Validation Summary
    • Advanced Mode
      • Overview
      • Process
    • Standard Mode
      • Overview
      • AutoClean
      • Process
    • AI AutoMapping
    • Uploaders Page
    • Uploader Details Page
  • 🔀Pipelines
    • Step 1. Select the Source
    • Step 2. Select a Destination
    • Step 3. Map & Transform Data
    • Step 4. Schedule the Pipeline
    • Step 5. Review & Confirm
    • Pipelines Page
    • Pipeline Details Page
  • ⏩Data Transformations
    • AutoMap
    • Column Mapping & Data Cleanup Panel
    • QuickFixes
    • AI Value Mapping
    • AI AutoClean
    • Lookups
      • Performing Lookups
    • SmartFill
    • Formulas
      • Date & Time Formulas
        • DateTime Format Specifiers
        • Timezone specifiers
      • Math Formulas and Operators
      • Logical Formulas & Operators
        • True & False Casting
      • Text Formulas
      • Other Formulas
    • Deduplication
  • ↘️Source Connectors
    • Amazon S3
    • Azure Blob Storage
    • BigQuery
    • Email
    • FTP
    • Google Cloud Storage (GCS)
    • Google Drive
    • Google Sheets
    • HTTP API (Call an Osmos API)
    • HTTP API (Osmos Calls Your API)
    • Osmos Dataset
    • Snowflake
    • Accessing Sources behind firewall
  • ↖️Destination Connectors
    • Amazon S3
    • BigQuery
    • FTP
    • Google Cloud Storage (GCS)
    • Google Drive
    • Google Sheets
    • HTTP API (Call an Osmos API)
    • HTTP API (Osmos Calls Your API)
      • Passing Dynamic Tokens in the API Header
    • MySQL
    • Osmos Dataset
    • PostgreSQL
    • Snowflake
    • Accessing Destinations behind firewall
  • 🗂️Projects
  • ⚙️Administration
    • Email Notifications
  • 🔒Security
  • 📞Support
  • Back to Osmos.io
Powered by GitBook
On this page
  • Osmos Dataset Destination Connector Overview
  • Automatic Creation
  • Manual Creation
  • Prerequisites
  • Creating an Osmos Dataset Destination Connector
  • Viewing Uploaded Data
  • Osmos Dataset Connector

Was this helpful?

  1. Datasets
  2. Osmos Datasets

Osmos Dataset Destination Connector

In this section you will learn how more about the Osmos Dataset Destination Connector.

PreviousCreating Primary and Foreign keysNextOsmos Dataset Source Connector

Last updated 10 months ago

Was this helpful?

Osmos Dataset Destination Connector Overview

The Osmos Dataset Destination Connector is used to store records in an Osmos Dataset. The Osmos Dataset Destination Connector can be created via two methods. First, it can be automatically created from a Osmos Dataset Table. When you select create Osmos Uploader from your Table, it will create both an Osmos Uploader and a new Osmos Dataset Connector. The second method is through the standard connector creation process. This connector can be leveraged with both an Uploader or a Pipeline.

Automatic Creation

When you select create Osmos Uploader from your Table, it will create both an Osmos Uploader and a new Osmos Dataset Connector. The Osmos Dataset Connector will populate the fields, including schema, based on your Table layout.

Note: Automatic creation is the recommended method over Manual Creation

Manual Creation

An Osmos Dataset Destination Connector can be created through the standard connector creation process.

Prerequisites

Required information:

Creating an Osmos Dataset Destination Connector

Step 1: After selecting + New Connector, under the System prompt, click Osmos Dataset.

Step 2: Provide a Connector Name.

Step 3: Select Destination Connector.

Step 4: Select the Dataset.

Step 5: Select the Table.

Step 6: Check the box if you wish for the data to Upsert.

Insert/Upsert

By default, Osmos Uploaders created automatically will be configured to insert data and fail in the case that Primary Keys overlap. If an uploader should be configured to upsert data, an uploader should be manually created with this configuration.

Step 7: Hit Save.

Note: The Osmos Dataset Connector will be linked to your Osmos Table

Resulting Connector detail:

Note the original Inventory table from the Master Records Dataset:

Viewing Uploaded Data

You can view the imported Dataset data directly from the Uploader. You can link directly from clicking on the Status field or the Actions, on the right side of the job detail.

Osmos Dataset Connector

Osmos

Osmos

🔠
Dataset
Table