LogoLogo
Back to OsmosDeveloper DocsOsmos BlogWhat's New
  • Welcome to Osmos
  • πŸ‘‹Getting Started with Osmos
    • Terminology
  • πŸŽ‰What's New
  • 🧩Osmos API Reference
  • ⌨️Osmos Chat
  • πŸ‘©β€πŸ’»Developer Docs
    • Manage API Keys
    • Embedding an Osmos Uploader
    • Embedding Uploader Jobs Table
    • Turning on Advanced Mode Uploader
    • Customizing Uploader Styling
    • Passing Parameterized Fields
    • Configuring Uploader's "Recall" functionality
    • Optional Uploader Settings
    • Uploader Submission Callback
    • Configuring AutoClean for your Uploader
    • Uploader Client-Side Validation
      • Data Validators
      • Checking for Duplicate values in a field
      • Creating Dropdown-Controlled Fields
      • Dynamic Dropdown Options
      • Dropdown Interaction with Validation Functions
    • Validation and Transformation Webhooks
      • OpenAPI Validation Webhook Testing
    • Parser Webhook for file based connectors
  • πŸ” Datasets
    • Osmos Datasets
      • Uploading Data to your Table
      • Creating Primary and Foreign keys
      • Osmos Dataset Destination Connector
      • Osmos Dataset Source Connector
      • Dataset Edits
    • Datasets Query Builder
      • Query Builder Metadata
    • Performing Look Ups
      • Performing Joins
        • Types of Joins
  • ⏏️Uploader
    • Creating an Osmos Uploader
      • Testing your Osmos Uploader
    • Uploader Validation Summary
    • Advanced Mode
      • Overview
      • Process
    • Standard Mode
      • Overview
      • AutoClean
      • Process
    • AI AutoMapping
    • Uploaders Page
    • Uploader Details Page
  • πŸ”€Pipelines
    • Step 1. Select the Source
    • Step 2. Select a Destination
    • Step 3. Map & Transform Data
    • Step 4. Schedule the Pipeline
    • Step 5. Review & Confirm
    • Pipelines Page
    • Pipeline Details Page
  • ⏩Data Transformations
    • AutoMap
    • Column Mapping & Data Cleanup Panel
    • QuickFixes
    • AI Value Mapping
    • AI AutoClean
    • Lookups
      • Performing Lookups
    • SmartFill
    • Formulas
      • Date & Time Formulas
        • DateTime Format Specifiers
        • Timezone specifiers
      • Math Formulas and Operators
      • Logical Formulas & Operators
        • True & False Casting
      • Text Formulas
      • Other Formulas
    • Deduplication
  • β†˜οΈSource Connectors
    • Amazon S3
    • Azure Blob Storage
    • BigQuery
    • Email
    • FTP
    • Google Cloud Storage (GCS)
    • Google Drive
    • Google Sheets
    • HTTP API (Call an Osmos API)
    • HTTP API (Osmos Calls Your API)
    • Osmos Dataset
    • Snowflake
    • Accessing Sources behind firewall
  • ↖️Destination Connectors
    • Amazon S3
    • BigQuery
    • FTP
    • Google Cloud Storage (GCS)
    • Google Drive
    • Google Sheets
    • HTTP API (Call an Osmos API)
    • HTTP API (Osmos Calls Your API)
      • Passing Dynamic Tokens in the API Header
    • MySQL
    • Osmos Dataset
    • PostgreSQL
    • Snowflake
    • Accessing Destinations behind firewall
  • πŸ—‚οΈProjects
  • βš™οΈAdministration
    • Email Notifications
  • πŸ”’Security
  • πŸ“žSupport
  • Back to Osmos.io
Powered by GitBook
On this page
  • Contents
  • How are Formulas Used in Osmos?
  • Supported Formulas
  • Getting Started
  • Escape Characters

Was this helpful?

  1. Data Transformations

Formulas

PreviousSmartFillNextDate & Time Formulas

Last updated 10 months ago

Was this helpful?

Contents

  1. How are Formulas Used in Osmos?

  2. Supported Formulas

  3. Getting Started

How are Formulas Used in Osmos?

Formulas can be used to complete complex transforms on data from one or more input columns. We have several predefined formulas (such as CONCAT, DATE, ADD, IF, IFERROR, etc.) that can be used together.

Supported Formulas

Our formulas fall into one of the following four categories noted below. For more information about a specific formula, navigate to one of the pages below.

Getting Started

Step 1: Once you have mapped the input (uploaded) column(s) to the output (cleaned) column, click on any cell in the output column to open the Data Cleanup panel on the right.

Step 2: Select Use Formulas at the bottom of the panel.

Step 3: Click into the formula bar to see the list of available formulas.

Step 4: Continue typing the name of the formula, or scroll through the list of formulas to find the one you are looking for, then select the formula.

Step 5: Provide formula inputs according to the format shown in the helper box for that specific formula. Ensure that the formula is complete and closing parentheses are included.

Note: Inputs within square brackets are optional.

Step 6: After providing the input(s) for the formula, press enter to submit the formula. The formula will output values for each cell in the output column.

Note: If you are uploading a file to clean up (i.e. not using Osmos Pipelines) and you need to make edits to specific cells in the output column after applying a formula, click on any cell in the output column and provide a single-cell edit.

Step 7: Use the toggles at the top of the page to filter for rows with errors and/or rows flagged for review, and edit the formula or add the β€œiferror” formula to resolve any errors.

Note: If you are uploading a file to clean up (i.e. not using Osmos Pipelines) you can also resolve errors by manually skipping that row using the row level checkboxes, or by providing a single-cell edit by clicking on any cell in the output column and editing the value.

Step 8: Once you are done, click Save and move onto the next output column. If you want to restart and choose a different Data Cleanup method for this column, click Start Over.

Escape Characters

Osmos allows the use of escape characters in formulas to allow the inclusion of characters in a string when those characters already serve a specific function in the formula engine. Specifically, if a user wished to write a formula which references a field which contains double quotes, escape characters are necessary. See examples:

  • $"Quantity" references the field Quantity

  • $"/"Quantity/"" references the field "Quantity"

  • $""Quantity"" Is syntactically incorrect, and will cause a formula to break

⏩
Date & Time Formulas
Math Formulas
Logical Formulas
Text Formulas