Scalability Improvements to the Usage Event Ingestion from AWS S3
We've made improvements to the infrastructure and scale of usage event ingestion from AWS S3, making it even easier than ever to migrate data, backfill usage, or integrate with complex data pipelines.
🌟 Feature Recap
Usage event ingestion from S3 allows you to:
- Ingest usage events directly from AWS S3 - Import raw usage events from a supported AWS S3 without building custom ingestion pipelines.
- Backfill historical usage at scale - Load months or even years of past events to support migrations, billing transitions, or customer onboarding.
- Sync of large volumes of events - Perfect for workloads that generate usage asynchronously, in batches, or from data processing pipelines.
- Leverage Stigg existing metering capabilities - Once ingested, events affect metering, consumption, entitlements, and credit burn without extra setup.
💡 Why This Matters
Our metering API is provisioned for 1000 events per second, which covers most workloads.
For extremely high-volume cases, our infrastructure can scale beyond 100,000 events per second and process terabytes of data by using a bring-your-own-bucket object storage setup with dedicated ingestion channels and isolated storage capacity.
Until now, turning such high volume data into billable usage required custom ETL jobs, scripts, or fragile data plumbing.
With this capability, you can:
- Accelerate migrations from legacy billing or metering systems
- Unify real-time and batch usage under a single metering logic
- Reduce engineering overhead by eliminating custom ingestion code
- Trust Stigg to handle processing and enrichment of events
- Ensure billing accuracy even when usage is delayed or generated in bulk
📦 Availability
Usage Event Ingestion from AWS S3 is available to all customers of the Scale plan. See Stigg's pricing for more details.
🛠 Get Started
Full documentation and integration guides are available here.