Skip to main content
Daily, we generate a new data set, which is synced with your data storage. To give you control about the versioning, each export is written to a new folder named after its creation time in UTC (YYYY-MM-DD-HH-MM-SS). Older folders stay in place. Each folder contains only the changes since the previous export, so the newest folder is not a complete data set: process every folder you have not imported yet, in timestamp order. For the AWS and Google Cloud exports, the folder structure looks like this:

Incremental Export for Positions

truemetrics provides daily incremental exports to keep your system updated with the latest position data. Each day, you will receive two Parquet files, one for entrances and one for parking places, containing the changes detected by truemetrics.

Contents of the Export

The daily Parquet files include:
  • Newly detected entrances or parking places
  • Updated positions, e.g., more reliable location data
  • Deletions, indicated by specific markers (see below)
You can use this file to update your database by iterating over each row and applying the changes to your data structure.

Handling Deletions

To signal that a previously provided location should be removed, truemetrics uses coordinates with latitude = 0 and longitude = 0. This serves as an instruction to delete or invalidate the previously sent position. Example Use Case: If truemetrics initially sent you an entrance location that was later determined to be invalid (e.g., through manual verification), the daily export will include a row with the same identifier but with lat = 0 and lon = 0. You should interpret this as a deletion request and the position should be either removed or ignore the from your system.

Integration Guidance

When processing the daily Parquet files: Iterate through each row. For each entry: If coordinates are 0/0, delete the corresponding record by the identifier from your database. Otherwise, insert or update the location in your database. Ensure that your import process is idempotent and can handle re-processing the same file if needed.

Export for Stops KPIS

For each delivery you have done so far, we provide the associated Stop KPIs, one recording day per export. The stops are in s3://true-shared-YOURCOMPANY/truemetrics-stops/incremental/{timestamp}/stops_*.parquet The schema of the data can be found in the same folder as schema file. s3://true-shared-YOURCOMPANY/truemetrics-stops/incremental/{timestamp}/schema_*.json

Time delay between recording and export

The export runs daily at around 00:15 UTC. Stops are exported two days after they were recorded; position changes one day after. Example: The export in folder 2024-01-05-00-10-00 contains the stops recorded on 2024-01-03 and the position changes from 2024-01-04.