LogoLogo
Back to OsmosDeveloper DocsOsmos BlogWhat's New
  • Welcome to Osmos
  • 👋Getting Started with Osmos
    • Terminology
  • 🎉What's New
  • 🧩Osmos API Reference
  • ⌨️Osmos Chat
  • 👩‍💻Developer Docs
    • Manage API Keys
    • Embedding an Osmos Uploader
    • Embedding Uploader Jobs Table
    • Turning on Advanced Mode Uploader
    • Customizing Uploader Styling
    • Passing Parameterized Fields
    • Configuring Uploader's "Recall" functionality
    • Optional Uploader Settings
    • Uploader Submission Callback
    • Configuring AutoClean for your Uploader
    • Uploader Client-Side Validation
      • Data Validators
      • Checking for Duplicate values in a field
      • Creating Dropdown-Controlled Fields
      • Dynamic Dropdown Options
      • Dropdown Interaction with Validation Functions
    • Validation and Transformation Webhooks
      • OpenAPI Validation Webhook Testing
    • Parser Webhook for file based connectors
  • 🔠Datasets
    • Osmos Datasets
      • Uploading Data to your Table
      • Creating Primary and Foreign keys
      • Osmos Dataset Destination Connector
      • Osmos Dataset Source Connector
      • Dataset Edits
    • Datasets Query Builder
      • Query Builder Metadata
    • Performing Look Ups
      • Performing Joins
        • Types of Joins
  • ⏏️Uploader
    • Creating an Osmos Uploader
      • Testing your Osmos Uploader
    • Uploader Validation Summary
    • Advanced Mode
      • Overview
      • Process
    • Standard Mode
      • Overview
      • AutoClean
      • Process
    • AI AutoMapping
    • Uploaders Page
    • Uploader Details Page
  • 🔀Pipelines
    • Step 1. Select the Source
    • Step 2. Select a Destination
    • Step 3. Map & Transform Data
    • Step 4. Schedule the Pipeline
    • Step 5. Review & Confirm
    • Pipelines Page
    • Pipeline Details Page
  • ⏩Data Transformations
    • AutoMap
    • Column Mapping & Data Cleanup Panel
    • QuickFixes
    • AI Value Mapping
    • AI AutoClean
    • Lookups
      • Performing Lookups
    • SmartFill
    • Formulas
      • Date & Time Formulas
        • DateTime Format Specifiers
        • Timezone specifiers
      • Math Formulas and Operators
      • Logical Formulas & Operators
        • True & False Casting
      • Text Formulas
      • Other Formulas
    • Deduplication
  • ↘️Source Connectors
    • Amazon S3
    • Azure Blob Storage
    • BigQuery
    • Email
    • FTP
    • Google Cloud Storage (GCS)
    • Google Drive
    • Google Sheets
    • HTTP API (Call an Osmos API)
    • HTTP API (Osmos Calls Your API)
    • Osmos Dataset
    • Snowflake
    • Accessing Sources behind firewall
  • ↖️Destination Connectors
    • Amazon S3
    • BigQuery
    • FTP
    • Google Cloud Storage (GCS)
    • Google Drive
    • Google Sheets
    • HTTP API (Call an Osmos API)
    • HTTP API (Osmos Calls Your API)
      • Passing Dynamic Tokens in the API Header
    • MySQL
    • Osmos Dataset
    • PostgreSQL
    • Snowflake
    • Accessing Destinations behind firewall
  • 🗂️Projects
  • ⚙️Administration
    • Email Notifications
  • 🔒Security
  • 📞Support
  • Back to Osmos.io
Powered by GitBook
On this page

Was this helpful?

  1. Developer Docs

Optional Uploader Settings

There are a number of additional options that can be modified in the initial osmos.configure function call to customize the uploader further. Below is a configured sample Osmos Uploader with a single field:

  Osmos.configure({
    schema: {
      fields: [
        {
          name: "Sample Field",
          displayName: "Sample Field",
          description: "<a sample of a field>"
        },
      ],
    },
    token: "123abc",
    uploadDescription: "<Sample Uploader",
    // Set to false to show the schema for the destination connector in the uploader on the file upload screen.
    hideUploadSchema: true,
  
    // Set to false to show the uploader description on the file upload screen.
    hideUploadDescription: true,
  
    // Set to false to show the advanced version of the uploader, with formulas, SmartFill, and QuickFixes.
    disableAdvancedMode: true,
  
    // Maximum number of records displayed in the Uploader UI (User Interface).
    // This value is capped at 100,000 and higher values will default back to 100,000.
    // Can be lowered to increase UI performance when using expensive validators.
    // NOTE: Your file can have >100,000 rows and will be processed fully. There are no limits to how many records can be uploaded.
    // This setting only limits the number of rows displayed in the UI.
    maxRecords: 100000,
  
    // Set to true to hide the preview pane screen for CSV files in the uploader.
    hideCSVPreviewPane: false,
  
    // This function determines whether to show an "upload complete" Callback when the user upload has been completed.
    completionHandler: async () => {},
  
    // Set autoMapEnabled to false to disable automatic field mapping on new uploads.
    autoMapEnabled: true,
  
    // Set autoRecallEnabled to false to disable automatic field mapping and transformations based on previous uploads.
    autoRecallEnabled: true,
  
    // Set allowSubmissionWithErrors to true to allow uploads which contain errors.
    // Note that only rows which do not contain errors will be written to the destination.
    allowSubmissionWithErrors: false,
  
    // Set storeTransformsForRecall to false in order to prevent new mappings and transformations from being recalled in future uploads.
    storeTransformsForRecall: true,

  });

Adding Uploader Description text: uploadDescription: A standard output of the HTML snippet which must be configured. This function shows a description of the Uploader to a user.

The description will also appear on the column mapping.

Show/Hide Upload Description: hideUploadDescription: A standard output of the HTML snippet which defaults to true. This function determines whether to show the destination description when the user is uploading their file.

Show/Hide Upload Schema:hideUploadSchema: A standard output of the HTML snippet which defaults to true. This function will be called when the user closes the Uploader. It will be called with the following arguments:

  • originalFileUrl - string | undefined, the URL the submitted file was uploaded to or undefined if they closed the uploader before submitting

  • reachedTransformStep - boolean, whether the user reached the transform step

  • successfullySubmittedData - boolean, whether the user's data was successfully submitted or not

  • numRecordsSubmitted - number, the number of records submitted

  • skippedRowNumbers - number[], the indices of rows from the original file that were manually skipped by the user

Changing how many rows of data to show in the Uploader: maxRecords: Not a standard output of the HTML snippet. This function defines the maximum amount of records or rows to display and validate. This defaults to 100_000. This also limits the amount of records that will be sent to validation webhooks. Setting a lower limit can be useful if your users are encountering performance issues when uploading large files or if your validation webhooks fail with large payloads.

Turn On/Off PreviewPane when Uploading CSV Files: hideCSVPreviewPane: A standard output of the HTML snippet which defaults to false. This function determines whether to show the preview pane when the user is uploading a CSV File.

  • Set autoMapEnabled to false to disable automatic field mapping based on heuristics

  • Set autoRecallEnabled to false to disable automatic population of transforms based on previous uploads

Enabling Submission with Errors: In some cases, it can be beneficial to allow submitting uploads even if there are errors. To enable this, set the allowSubmissionWithErrors option to true.

Disabling Transform Recall Storage: By default, Osmos stores all data transformations (mappings, formulas, QuickFixes, etc.) submitted to uploaders for recall. Recall is the process by which transforms are auto-populated when the uploader is first opened during subsequent uploads.

If you want to disable this functionality and prevent the transforms for uploads to be saved for recall, you can set the storeTransformsForRecall option to false.

PreviousConfiguring Uploader's "Recall" functionalityNextUploader Submission Callback

Last updated 6 months ago

Was this helpful?

Turn On/Off Advanced Mode Uploader: disableAdvancedMode: Disables . true by default.

Turn On/Off Callback: completionHandler: Not a standard output of the HTML snippet. This function determines whether to show an "upload complete" when the user upload has been completed.

Enabling/Disabling Recall + Auto-Mapping: After loading, the uploader attempts to fields and apply some transforms based on heuristics and previously seen files. While this behavior is usually useful to speed up mapping and ease the upload process, there some scenarios where it is undesired.

For more information on Callback functionality, please see

👩‍💻
Advanced Mode
Callback
automatically map
Notifications: Callback
An example of upoadDescription in action
The information i will display the field description