HomepageCase studiesBook a demo

Data Structure and Types

Learn more how data is organized in AWS S3 Bucket

Key Points

  • Export frequency: Data is exported once per day to provide consistent and timely access.

  • Delta exports: Each export contains only the changes (delta) from the previous calendar day.

  • Single report per environment: One report set is generated per environment, regardless of the number of tenants. Each report includes a unique identifier (tenantId), which you can use to build pipelines and split the data by tenant if needed.

  • File naming convention:

    • Daily reports: filename_YYYY_MM_DD.csv - where YYYY_MM_DD is the date the report covers.

    • One-off reports (on request): filename_all_until_YYYY_MM_DD.csv - using the same naming format as daily reports.

  • Data mapping by IDs: Each file uses identifiers to link data across reports. For example, the members file contains full details for each memberId, while other reports reference only the memberId (without personal details).

Overall Structure

  • analytics/ This is the main folder within the bucket. All data related to analytics is organised under this folder.

Subfolders under analytics/

  1. Achievements/ Contains CSV data files related to achievements. These might include records of user milestones or progress indicators, as well as the overall configuration of the achievements. You can find out more about the file structure stored in this folder in these articles: Achievements Achievement Usage

  2. Campaigns/ Contains CSV data files related to campaigns, such as configuration files or performance metrics. You can find out more about the file structure stored in this folder in these articles: Campaigns Campaign Execution Campaign Calculated Effect Results

  3. CampaignsVisibility/ Contains CSV data files related to campaigns, such as configuration files or performance metrics. You can find out more about the file structure stored in this folder in these articles: Campaign Visibility

  4. CustomEvent/ Contains CSV data files related to all the custom events registered in the system. You can find out more about the file structure stored in this folder in this article: Custom Events

  5. Members/ Contains CSV data files related to all the members registered in the system, and the updates on their profiles. You can find out more about the file structure stored in this folder in this article: Members

  6. MemberTierChanges/ Contains CSV data files related to the tier changes (downgrades and upgrades) of members registered in the system at the end of each day. You can find out more about the file structure stored in this folder in this article: Member Tier Changes

  7. Points/ Contains CSV data files related to units accumulated by users, as well as used and expired transfers. You can find out more about the file structure stored in this folder in this article: Unit Transfers

  8. Rewards/ Contains CSV data files related to available rewards and redemption histories. You can find out more about the file structure stored in this folder in these articles: Rewards Rewards Redemption

  9. Tenant/ Contains CSV data files related to all the tenants (storeCodes) created in the system. You can find out more about the file structure stored in this folder in this article: Tenants

  10. Tiers/ Contains CSV data files related to different tier levels (e.g., Bronze, Silver, Gold) and the rules or requirements for each tier. You can find out more about the file structure stored in this folder in this article: Tiers

  11. Transactions/ Contains CSV data files related to all the transactions registered in the system. You can find out more about the file structure stored in this folder in this article: Transactions

Last updated

Was this helpful?