Amazon Kinesis Firehose logo

Amazon Kinesis Firehose

Amazon Kinesis Firehose

UpOpen Sourcecloudby Amazon Web Services62· JavaScript· MIT

Amazon Kinesis Data Firehose API auto-buffers and delivers streaming data to S3/Redshift/OpenSearch/Splunk — no code required.

Visit site ↗Source ↗Health checked 9h ago
Use it when

Truly zero ops (unlike Kinesis Data Streams which requires shard management)

Watch for

Minimum buffer time (60s) — not truly real-time

First check

CreateDeliveryStream — specify destination (S3/Redshift/OpenSearch/Splunk). PutRecord / PutRecordBatch to write data.

Auth
CORS
No
HTTPS
Yes
Signup
?
Latency
12 ms
Protocol
REST
Pricing
Stars
62

Uptime · 30-day window

Probes: 1Uptime: 100%Avg latency: 12ms

GitHub activity

62JavaScriptMIT17 open issuesLast commit 110d ago
01

About this API

Firehose is AWS's "ready-to-use" option for streaming data pipelines. The distinction from Kinesis Data Streams is key: Data Streams is the underlying streaming platform (manage shards, consumers, checkpoints) for custom stream processing; Firehose is a managed delivery service that only pushes data to fixed destinations (S3, Redshift, OpenSearch, Splunk, custom HTTP endpoint) per buffer rules. Most common use: "logs/events → Firehose → S3 data lake" — applications write JSON events to Firehose, which auto-buffers 5 minutes or 5MB (whichever comes first) then writes a file to S3, time-partitioned. With Lambda transform, also runs ETL before delivery (filter, enrich, format change). Fully zero-ops — best choice for "I have lots of small events to centralize in S3 without writing consumers".

02

What you can build

  • 1Stream logs to S3 data lake
  • 2Land real-time events in Redshift for analytics
  • 3Write app metrics to OpenSearch for visualization
  • 4Centralized archival of CloudTrail/VPC Flow Logs
03

Strengths & limitations

Strengths

  • Truly zero ops (unlike Kinesis Data Streams which requires shard management)
  • Auto-buffer + bulk write to downstream
  • Built-in Lambda transformation support
  • Pay by data volume

Limitations

  • Minimum buffer time (60s) — not truly real-time
  • No consumer re-read (data is gone after delivery)
04

Example request

Generic template — replace <endpoint> with the real path from the docs.
curl https://github.com/mermade/aws2openapi/<endpoint>
05

Getting started

CreateDeliveryStream — specify destination (S3/Redshift/OpenSearch/Splunk). PutRecord / PutRecordBatch to write data.

06

FAQ

Firehose vs. Kinesis Data Streams?+

Just need data in S3/Redshift/OpenSearch: Firehose. Need custom real-time processing: Data Streams.

Can it do true real-time (<1s)?+

No — Firehose minimum buffer is 60s. For sub-second, use Kinesis Data Streams + Lambda.

07

Technical details

CORS: NoHTTPS: YesSignup: ?Open source: Yes
Auth type
unknown
Pricing
unknown
Protocols
REST
SDKs
python, javascript, go, java, csharp
Response time
12 ms
Last health check
5/12/2026, 7:36:33 AM
08

Tags

09

More from Amazon Web Services