LogoLogo
Back to OsmosDeveloper DocsOsmos BlogWhat's New
  • Welcome to Osmos
  • 👋Getting Started with Osmos
    • Terminology
  • 🎉What's New
  • 🧩Osmos API Reference
  • ⌨️Osmos Chat
  • 👩‍💻Developer Docs
    • Manage API Keys
    • Embedding an Osmos Uploader
    • Embedding Uploader Jobs Table
    • Turning on Advanced Mode Uploader
    • Customizing Uploader Styling
    • Passing Parameterized Fields
    • Configuring Uploader's "Recall" functionality
    • Optional Uploader Settings
    • Uploader Submission Callback
    • Configuring AutoClean for your Uploader
    • Uploader Client-Side Validation
      • Data Validators
      • Checking for Duplicate values in a field
      • Creating Dropdown-Controlled Fields
      • Dynamic Dropdown Options
      • Dropdown Interaction with Validation Functions
    • Validation and Transformation Webhooks
      • OpenAPI Validation Webhook Testing
    • Parser Webhook for file based connectors
  • 🔠Datasets
    • Osmos Datasets
      • Uploading Data to your Table
      • Creating Primary and Foreign keys
      • Osmos Dataset Destination Connector
      • Osmos Dataset Source Connector
      • Dataset Edits
    • Datasets Query Builder
      • Query Builder Metadata
    • Performing Look Ups
      • Performing Joins
        • Types of Joins
  • ⏏️Uploader
    • Creating an Osmos Uploader
      • Testing your Osmos Uploader
    • Uploader Validation Summary
    • Advanced Mode
      • Overview
      • Process
    • Standard Mode
      • Overview
      • AutoClean
      • Process
    • AI AutoMapping
    • Uploaders Page
    • Uploader Details Page
  • 🔀Pipelines
    • Step 1. Select the Source
    • Step 2. Select a Destination
    • Step 3. Map & Transform Data
    • Step 4. Schedule the Pipeline
    • Step 5. Review & Confirm
    • Pipelines Page
    • Pipeline Details Page
  • ⏩Data Transformations
    • AutoMap
    • Column Mapping & Data Cleanup Panel
    • QuickFixes
    • AI Value Mapping
    • AI AutoClean
    • Lookups
      • Performing Lookups
    • SmartFill
    • Formulas
      • Date & Time Formulas
        • DateTime Format Specifiers
        • Timezone specifiers
      • Math Formulas and Operators
      • Logical Formulas & Operators
        • True & False Casting
      • Text Formulas
      • Other Formulas
    • Deduplication
  • ↘️Source Connectors
    • Amazon S3
    • Azure Blob Storage
    • BigQuery
    • Email
    • FTP
    • Google Cloud Storage (GCS)
    • Google Drive
    • Google Sheets
    • HTTP API (Call an Osmos API)
    • HTTP API (Osmos Calls Your API)
    • Osmos Dataset
    • Snowflake
    • Accessing Sources behind firewall
  • ↖️Destination Connectors
    • Amazon S3
    • BigQuery
    • FTP
    • Google Cloud Storage (GCS)
    • Google Drive
    • Google Sheets
    • HTTP API (Call an Osmos API)
    • HTTP API (Osmos Calls Your API)
      • Passing Dynamic Tokens in the API Header
    • MySQL
    • Osmos Dataset
    • PostgreSQL
    • Snowflake
    • Accessing Destinations behind firewall
  • 🗂️Projects
  • ⚙️Administration
    • Email Notifications
  • 🔒Security
  • 📞Support
  • Back to Osmos.io
Powered by GitBook
On this page
  • Overview
  • AutoMap
  • Input and Output Columns
  • Column Mapping Filters
  • Fill with Constant Value
  • Adding File Name Mapping
  • Data Cleanup Panel

Was this helpful?

  1. Data Transformations

Column Mapping & Data Cleanup Panel

PreviousAutoMapNextQuickFixes

Last updated 10 months ago

Was this helpful?

Overview

With Osmos, you can clean up and restructure your data using , , , , and single-cell edits.

AutoMap

Data Transformation begins with column mapping. Our AutoMap makes –typically a manual process–faster (and more accurate) than before by automatically suggesting mappings. uses generative AI to significantly reduce the need for manual column mapping that is required during data ingestion. AutoMap takes that task and automatically maps your columns quickly and more accurately. Immediately map things like “MSRP” to “Price” and “Energy” to “Calories”. No additional setup is required.

On the left, you will see the column mapping panel. This is where you map the relationship between the input and output columns.

Note: You can map one or more input (uploaded) columns to each output column. Leverage the + column icon to add additional input fields.

Input and Output Columns

After an input column (uploaded column) to an output column (cleaned column), you will see the data that corresponds to the selected columns to the right of the mapping section.

When you select a different output column in the mapping section, the section to the right will update to display the corresponding data for those columns.

Column Mapping Filters

To streamline the mapping process, you can filter fields by several factors. These include mapped vs unmapped, required vs optional, field errors, warnings, skipped rows, fields with formulas, SmartFill, or QuickFixes. In addition, you can filter by field type, specific fields themselves, or simply search for fields.

Fill with Constant Value

Adding File Name Mapping

The originating file name field is available to add to an Our Field (destination) column. This field is available at the end of the Your Columns (source) column list.

Data Cleanup Panel

The left side panel toggles between column mapping and data cleanup. You can access this panel on the left by clicking on any cell in the destination column.

To set a constant value for the destination column, leave the Your Column (source) column blank and select Fill with Constant Value. This will take you into the to enter your value.

In the Data Cleanup panel, you can use tools that help you quickly clean up the data being sent to the output column you are working on. These tools include , , , , and single-cell edits.

⏩
formula window
AI Value Mapping
Lookups,
QuickFixes
SmartFill
formulas
Lookups,
QuickFixes
SmartFill
formulas
column mapping
AutoMap
AutoMap AI,
column mapping