Historical Data Delivery Method

Data Delivery OptionsOne-off batch delivery

Continuous intervals (e.g., daily, weekly, monthly)

Primary Delivery MethodAs Mobito operates on AWS Cloud, historical data is primarily delivered via AWS S3 buckets.

What is AWS S3?

https://aws.amazon.com/s3/Amazon Simple Storage Service (S3) is a scalable, secure, and high-performance object storage service.

Mobito manages S3 bucket access, uploading data to a dedicated bucket for each client.

Security & Access

Access to each S3 bucket is restricted and controlled through unique secret keys, shared only with the respective client. Each secret key grants download permissions for the specified bucket only.

For each data delivery, Mobito provides:

S3 bucket name

Access key

Secret key

Using the above, clients can securely download their data.

Data Partitioning & File Format

Partitioning

Within each S3 bucket, data is organized by location and time, using a daily partition per country for efficient retrieval.

Example directory structure:

<S3 bucket name>/<project name>/<data product name>/country=<country code>/year=<year>/month=<month>/day=<day>

Example:

X/project_X1/probe/country=FR/year=2025/month=02/day=24

File Format

Data is delivered in the Parquet file format, an open-source, column-oriented format optimized for efficient storage and retrieval.* *

Apache Parquet enables high-performance data processing with advanced compression and encoding.

Snappy compression is applied to reduce file size while maintaining fast read and write speeds.