Step 3. Map & Transform Data
After selecting the Source and Destination Connectors for an Osmos Pipeline the next step is to transform the source data into a format that aligns with the Destination Connector's schema.
You can clean up and restructure the data using column mapping, QuickFixes, SmartFill, formulas, and single-cell edits.
On the left, you will see the column mapping panel. This is where you start, and where you map the relationship between the input (uploaded) and output (cleaned) columns.
Each card in this section represents an output column for your Destination Connector. You can map one or more uploaded columns to each cleaned column.
After you map an input (uploaded) column to an output (cleaned) column, you will see the data that corresponds to the selected columns to the right of the mapping section.
When you select a different cleaned column in the mapping section, the section to the right will update to display the corresponding data for those columns.
To the right of uploaded and cleaned columns, you can access the data cleanup panel. Here you can use tools that help you quickly cleanup the data being sent to the output column you are working on. These tools include QuickFixes, SmartFill, and formulas. You can get to this panel by clicking on any cell in the destination column.
Step 1: Start in the left Column Mapping panel. Select the column(s) that contain the data for the first output column listed.
Step 2: If you want to cleanup or modify the data in the cleaned (output) column (or resolve errors), click on any cell in the destination column to open the Data Cleanup panel.
Step 3: Review the available options in the Data Cleanup panel and select one that best fits your data cleanup needs for this column:
- 1.QuickFixes - One-click, data-cleanup buttons that allow you to easily clean up your data for the most common scenarios for that data type (i.e. Date, Text, Numeric, etc.).
- 2.SmartFill- Simple to use AI-powered data cleanup that learns and detects a pattern from examples of the clean data.
- 3.
If you are uploading a file to cleanup (i.e. not using Osmos Pipelines) and you need to make edits to specific cells in the output column after applying QuickFixes, click on any cell in the output column and provide a single-cell edit.
Step 4: Use the tabs at the top of the page to filter for rows with errors and/or rows flagged for review to confirm all issues with your data have been addressed.
Step 5: Once you have repeated Steps 1 through 4 for each of the required output columns (and any of the optional columns you want to include in this Osmos Pipeline), you can proceed to the next step.
Last modified 3mo ago