Flat File Ingestion Overview

Flat File Ingestion is an alternative method to API integration to load data into Unit21. The key differences from the API are:

It utilizes ELT ingestion rather than ETL

  • Data can be landed before it is mapped, and processed after mapping is complete
  • Data mapping takes place in the Unit21 UI
  • Each file sent can be re-processed, validated, downloaded, and previewed

You can send a higher volume of data at once

  • 30 MB limit when uploaded through the UI
  • 300MB limit when uploaded through a pre-signed URL

Files will be ingested into Unit21 every 15 minutes if a valid schema mapping is present and the file is formatted correctly

Files can be formatted in one of the following conventions

  • JSON
  • JSONL
  • CSV
  • PARQUET