LogoLogo
Back to OsmosDeveloper DocsOsmos BlogWhat's New
  • Welcome to Osmos
  • 👋Getting Started with Osmos
    • Terminology
  • 🎉What's New
  • 🧩Osmos API Reference
  • ⌨️Osmos Chat
  • 👩‍💻Developer Docs
    • Manage API Keys
    • Embedding an Osmos Uploader
    • Embedding Uploader Jobs Table
    • Turning on Advanced Mode Uploader
    • Customizing Uploader Styling
    • Passing Parameterized Fields
    • Configuring Uploader's "Recall" functionality
    • Optional Uploader Settings
    • Uploader Submission Callback
    • Configuring AutoClean for your Uploader
    • Uploader Client-Side Validation
      • Data Validators
      • Checking for Duplicate values in a field
      • Creating Dropdown-Controlled Fields
      • Dynamic Dropdown Options
      • Dropdown Interaction with Validation Functions
    • Validation and Transformation Webhooks
      • OpenAPI Validation Webhook Testing
    • Parser Webhook for file based connectors
  • 🔠Datasets
    • Osmos Datasets
      • Uploading Data to your Table
      • Creating Primary and Foreign keys
      • Osmos Dataset Destination Connector
      • Osmos Dataset Source Connector
      • Dataset Edits
    • Datasets Query Builder
      • Query Builder Metadata
    • Performing Look Ups
      • Performing Joins
        • Types of Joins
  • ⏏️Uploader
    • Creating an Osmos Uploader
      • Testing your Osmos Uploader
    • Uploader Validation Summary
    • Advanced Mode
      • Overview
      • Process
    • Standard Mode
      • Overview
      • AutoClean
      • Process
    • AI AutoMapping
    • Uploaders Page
    • Uploader Details Page
  • 🔀Pipelines
    • Step 1. Select the Source
    • Step 2. Select a Destination
    • Step 3. Map & Transform Data
    • Step 4. Schedule the Pipeline
    • Step 5. Review & Confirm
    • Pipelines Page
    • Pipeline Details Page
  • ⏩Data Transformations
    • AutoMap
    • Column Mapping & Data Cleanup Panel
    • QuickFixes
    • AI Value Mapping
    • AI AutoClean
    • Lookups
      • Performing Lookups
    • SmartFill
    • Formulas
      • Date & Time Formulas
        • DateTime Format Specifiers
        • Timezone specifiers
      • Math Formulas and Operators
      • Logical Formulas & Operators
        • True & False Casting
      • Text Formulas
      • Other Formulas
    • Deduplication
  • ↘️Source Connectors
    • Amazon S3
    • Azure Blob Storage
    • BigQuery
    • Email
    • FTP
    • Google Cloud Storage (GCS)
    • Google Drive
    • Google Sheets
    • HTTP API (Call an Osmos API)
    • HTTP API (Osmos Calls Your API)
    • Osmos Dataset
    • Snowflake
    • Accessing Sources behind firewall
  • ↖️Destination Connectors
    • Amazon S3
    • BigQuery
    • FTP
    • Google Cloud Storage (GCS)
    • Google Drive
    • Google Sheets
    • HTTP API (Call an Osmos API)
    • HTTP API (Osmos Calls Your API)
      • Passing Dynamic Tokens in the API Header
    • MySQL
    • Osmos Dataset
    • PostgreSQL
    • Snowflake
    • Accessing Destinations behind firewall
  • 🗂️Projects
  • ⚙️Administration
    • Email Notifications
  • 🔒Security
  • 📞Support
  • Back to Osmos.io
Powered by GitBook
On this page
  • Contents
  • What are QuickFixes?
  • Getting Started
  • Types of QuickFixes
  • Value Mapping QuickFix
  • Address QuickFix
  • Number-related QuickFixes
  • Date related QuickFixes
  • QuickFix Error

Was this helpful?

  1. Data Transformations

QuickFixes

PreviousColumn Mapping & Data Cleanup PanelNextAI Value Mapping

Last updated 10 months ago

Was this helpful?

Contents

  1. What are QuickFixes?

  2. Getting Started

  3. Types of QuickFixes

What are QuickFixes?

QuickFixes are one-click buttons designed to enable complex transformations, including AI Value Mapping, which uses advanced Large Language Models (LLMs) to automatically map source data to its nearest semantic match in the destination schema, eliminating tedious manual alignment and enhancing productivity. Additionally, AI Auto Clean empowers users to perform complex tasks, like formatting phone numbers, using natural language commands, and making data cleanup fast and intuitive. QuickFixes also include scenarios to clean up common data types like Lookups, Date, Text, and Numeric values. Combine multiple QuickFixes to clean and resolve data errors with ease.

Getting Started

Step 1: Once you have mapped the input (source) column(s) to the output (destination) column, click on any cell in the output column to open the Data Cleanup panel on the left.

The left side panel toggles between column mapping and data .

Step 2: From here you will see a list of potential QuickFixes that you can use to transform your data for the selected output column.

Step 3: If you want to use one or multiple QuickFixes, click on each of the QuickFixes in the order you want them applied.

Note: If you are uploading a file to clean up (i.e. not using Osmos Pipelines) and you need to make edits to specific cells in the output column after applying QuickFixes, click on any cell in the output column and provide a single-cell edit.

Step 4: To remove a specific QuickFix, click on the applied QuickFixes in the right panel.

Step 5: Once you are done, go to the bottom of the left panel and click Save, then move the next output column in the panel. If you want to restart and choose a different Data Cleanup method for this column, click Start Over.

Types of QuickFixes

There are several QuickFixes that populate based on a destination field value. These QuickFixes include AI Value Mapping and AI AutoClean, both use natural language commands to streamline data transformations. Additional Quick Fixes include lookups, address handling, number, and date defaults. For all QuickFixes, you have a variety of methods to handle QuickFix errors.

Value Mapping QuickFix

AI Value Mapping allows you to map end-user data into categories with your organization’s internal representation (commonly known as enumerations “enums”). Leveraging advanced Large Language Models (LLMs), this QuickFix automatically maps source data to its nearest semantic match in the destination schema. This saves your data operations teams hours of manual work while dynamically adapting to evolving source data without requiring updates to formulas or webhooks.

AI Value Mapping QuickFix in Action

Address QuickFix

There are several QuickFixes related to addresses. These include Extract City, Extract State, and Extract Address Line 1.

Address QuickFix in Action

Number-related QuickFixes

There are several QuickFixes related to numbers. These include strip non-numeric characters, drop decimal, round, and round down.

Date related QuickFixes

There are many ways to default date layouts via QuickFixes.

QuickFix Error

If a QuickFix “QF” error occurs, you have five different settings to handle these errors.

  1. Do nothing - The QF error will continue to present itself as an error until it is resolved

  2. Ignore error - Do not treat the QF error as an error but instead ignore it

  3. Skip row - If a QF error exists, the row will be skipped

  4. Fill cell with a custom value - If a QF error exists, it will be populated with the custom value entered in the text box

  5. Original value - If a QF error exists, the original value will be populated to the destination field.

⏩