Set Up Integration

How to set up S3 Bucket integration for Open Loyalty data exports

We support seamless integration with the major cloud providers. You can choose the one that fits your current technology stack:

• Amazon Web Services (AWS): We can grant access to our S3 bucket or replicate data directly to yours.

• Google Cloud Platform (GCP): We upload files directly to your Google Cloud Storage buckets.

• Microsoft Azure: We upload files directly to your Azure Blob Storage containers.

Open Loyalty generates daily data exports, providing delta changes for the previous day in a CSV format. For detailed information about each export type, refer to the following article:

https://help.openloyalty.io/technical-guide/s3-bucket-data-exports/data-structure-and-types

The export frequency is set to daily to ensure consistent and timely access to the data for all our customers.

There is one report set for the environment, regardless of the number of tenants created. There is a unique identifier (tenantId) for all the reports. Then you can create pipelines to further split the data per tenant.

---

Key Considerations

• Security & Least Privilege: Regardless of the platform, ensure that the credentials you provide (Service Accounts, SAS Tokens, or IAM Roles) are configured with the principle of least privilege. You should grant only the specific "Write" or "Upload" permissions required for Open Loyalty to deliver the files, restricting read or delete access unless necessary for your internal processes.

• Cloud Infrastructure Costs: While Open Loyalty provides the data export feature, your cloud provider will bill you for the storage space and API write operations associated with receiving these files. We recommend monitoring your usage and configuring lifecycle rules (e.g., automatically moving older files to "Cold" or "Archive" storage tiers) to optimize expenses.

• Pipeline Timing: Exports are generated daily after midnight UTC (or another timezone, once you raise such a need with the Support Team). When setting up your downstream ETL pipelines or BI data refreshes, ensure they are scheduled to run after the data delivery window to capture the latest delta files.

Learn more about

Find detailed guides on how to configure the integration for data exports for one of the following cloud providers:

Amazon Web Services (AWS)

Google Cloud Platform (GCP)

Microsoft Azure