YYYY-MM-DD-HH-MM-SS). Older folders stay in place. Each folder contains only the changes since the previous export, so the newest folder is not a complete data set: process every folder you have not imported yet, in timestamp order.
For the AWS and Google Cloud exports, the folder structure looks like this:
Incremental Export for Positions
truemetrics provides daily incremental exports to keep your system updated with the latest position data. Each day, you will receive two Parquet files, one for entrances and one for parking places, containing the changes detected by truemetrics.Contents of the Export
The daily Parquet files include:- Newly detected entrances or parking places
- Updated positions, e.g., more reliable location data
- Deletions, indicated by specific markers (see below)
Handling Deletions
To signal that a previously provided location should be removed, truemetrics uses coordinates with latitude = 0 and longitude = 0. This serves as an instruction to delete or invalidate the previously sent position. Example Use Case: If truemetrics initially sent you an entrance location that was later determined to be invalid (e.g., through manual verification), the daily export will include a row with the same identifier but with lat = 0 and lon = 0. You should interpret this as a deletion request and the position should be either removed or ignore the from your system.Integration Guidance
When processing the daily Parquet files: Iterate through each row. For each entry: If coordinates are 0/0, delete the corresponding record by the identifier from your database. Otherwise, insert or update the location in your database. Ensure that your import process is idempotent and can handle re-processing the same file if needed.Export for Stops KPIS
For each delivery you have done so far, we provide the associated Stop KPIs, one recording day per export. The stops are ins3://true-shared-YOURCOMPANY/truemetrics-stops/incremental/{timestamp}/stops_*.parquet
The schema of the data can be found in the same folder as schema file.
s3://true-shared-YOURCOMPANY/truemetrics-stops/incremental/{timestamp}/schema_*.json
Time delay between recording and export
The export runs daily at around 00:15 UTC. Stops are exported two days after they were recorded; position changes one day after. Example: The export in folder2024-01-05-00-10-00 contains the stops recorded on 2024-01-03 and the position changes from 2024-01-04.