LogoLogo
Back to OsmosDeveloper DocsOsmos BlogWhat's New
  • Welcome to Osmos
  • 👋Getting Started with Osmos
    • Terminology
  • 🎉What's New
  • 🧩Osmos API Reference
  • ⌨️Osmos Chat
  • 👩‍💻Developer Docs
    • Manage API Keys
    • Embedding an Osmos Uploader
    • Embedding Uploader Jobs Table
    • Turning on Advanced Mode Uploader
    • Customizing Uploader Styling
    • Passing Parameterized Fields
    • Configuring Uploader's "Recall" functionality
    • Optional Uploader Settings
    • Uploader Submission Callback
    • Configuring AutoClean for your Uploader
    • Uploader Client-Side Validation
      • Data Validators
      • Checking for Duplicate values in a field
      • Creating Dropdown-Controlled Fields
      • Dynamic Dropdown Options
      • Dropdown Interaction with Validation Functions
    • Validation and Transformation Webhooks
      • OpenAPI Validation Webhook Testing
    • Parser Webhook for file based connectors
  • 🔠Datasets
    • Osmos Datasets
      • Uploading Data to your Table
      • Creating Primary and Foreign keys
      • Osmos Dataset Destination Connector
      • Osmos Dataset Source Connector
      • Dataset Edits
    • Datasets Query Builder
      • Query Builder Metadata
    • Performing Look Ups
      • Performing Joins
        • Types of Joins
  • ⏏️Uploader
    • Creating an Osmos Uploader
      • Testing your Osmos Uploader
    • Uploader Validation Summary
    • Advanced Mode
      • Overview
      • Process
    • Standard Mode
      • Overview
      • AutoClean
      • Process
    • AI AutoMapping
    • Uploaders Page
    • Uploader Details Page
  • 🔀Pipelines
    • Step 1. Select the Source
    • Step 2. Select a Destination
    • Step 3. Map & Transform Data
    • Step 4. Schedule the Pipeline
    • Step 5. Review & Confirm
    • Pipelines Page
    • Pipeline Details Page
  • ⏩Data Transformations
    • AutoMap
    • Column Mapping & Data Cleanup Panel
    • QuickFixes
    • AI Value Mapping
    • AI AutoClean
    • Lookups
      • Performing Lookups
    • SmartFill
    • Formulas
      • Date & Time Formulas
        • DateTime Format Specifiers
        • Timezone specifiers
      • Math Formulas and Operators
      • Logical Formulas & Operators
        • True & False Casting
      • Text Formulas
      • Other Formulas
    • Deduplication
  • ↘️Source Connectors
    • Amazon S3
    • Azure Blob Storage
    • BigQuery
    • Email
    • FTP
    • Google Cloud Storage (GCS)
    • Google Drive
    • Google Sheets
    • HTTP API (Call an Osmos API)
    • HTTP API (Osmos Calls Your API)
    • Osmos Dataset
    • Snowflake
    • Accessing Sources behind firewall
  • ↖️Destination Connectors
    • Amazon S3
    • BigQuery
    • FTP
    • Google Cloud Storage (GCS)
    • Google Drive
    • Google Sheets
    • HTTP API (Call an Osmos API)
    • HTTP API (Osmos Calls Your API)
      • Passing Dynamic Tokens in the API Header
    • MySQL
    • Osmos Dataset
    • PostgreSQL
    • Snowflake
    • Accessing Destinations behind firewall
  • 🗂️Projects
  • ⚙️Administration
    • Email Notifications
  • 🔒Security
  • 📞Support
  • Back to Osmos.io
Powered by GitBook
On this page
  • Contents
  • What is SmartFill?
  • Getting Started
  • Color Coding
  • Training Examples
  • Flagged for Review
  • Provide Example, Timeout, or Error
  • Editing or Deleting Training Examples
  • Inserting a Training Example with No Data

Was this helpful?

  1. Data Transformations

SmartFill

PreviousPerforming LookupsNextFormulas

Last updated 10 months ago

Was this helpful?

Contents

  1. What is SmartFill?

  2. Getting Started

  3. Color Coding

  4. Editing or Deleting Training Examples

  5. Inserting a Training Example with No Data

What is SmartFill?

SmartFill involves transforming your input data by providing examples of the clean data in the output column.

We automatically create a program to fill the remaining cells in the output column as we sense a pattern across the provided examples.

Getting Started

Step 1: Once you have mapped the input column(s) to the output column, click on any cell in the output (cleaned) column to open the Data Cleanup panel on the left.

The left side panel toggles between column mapping and data clean up.

Step 2: Select Use SmartFill at the bottom of the panel.

Step 3: Click into any cell in the output (cleaned) column and provide an example of the clean data for that specific row. Press enter or click the purple enter button to submit the training example. We will learn from this example and output values for each cell based on your training example(s).

Sometimes the transformation is simple enough to output the correct value for each cell, but you may need to provide additional training examples to refine the program.

Step 4: Use the toggles at the top of the page to filter for rows with errors and/or rows flagged for review and provide additional training examples where required.

Step 5: Once you are done, go to the bottom of the left panel and click Save, then move onto the next output column in the panel. If you want to restart and choose a different Data Cleanup method for this column, click Start Over.

Color Coding

Training Examples

Training examples have black borders. If you want to adjust the SmartFill program for that column, click on these cells to delete or edit them.

Flagged for Review

Cells that have been flagged for review have orange borders. We automatically detect potential values that are incorrect. Review these cells and provide another training example if they are incorrect.

Provide Example, Timeout, or Error

Cells that have validation errors, timeouts, or cells that require an additional training example have red borders. Click on these cells and provide another training example to resolve the errors and improve the SmartFill program.

Editing or Deleting Training Examples

If you want to edit a training example, click on the cell that contains the training example, edit the training example, then press enter to submit the revised example.

If you want to delete a specific training example, click on the cell that contains the training example, then click on the delete button to the right of that cell. You can also hover over the cell and click “Delete Example” in the tool tip.

Note: if you want to clear all training examples for a specific column, open the Data Cleanup panel and click Start Over. From here you can select SmartFill again and provide new training examples.

Inserting a Training Example with No Data

If you want to provide a training example for a row that does not have data, click on the output cell, leave the cell blank, then press enter.

⏩