Amazon Kinesis Data Streams is a serverless streaming data service that makes it easy to capture, process, and store data streams at any scale.
-
Steam log and event data: Ingest and collect terabytes of data per day from application and service logs, clickstream data, sensor data, and in-app user events to power live dashboards, generate metrics, and deliver data into data lakes.
-
Run real-time analytics: Build applications for high-frequency event data such as clickstream data, and gain access to insights in seconds, not days, using AWS Lambda or Amazon Kinesis Data Analytics.
-
Power event-driven applications: Quickly pair with AWS Lambda to respond to or adjust immediate occurrences within the event-driven applications in your environment, at any scale.
-
With Amazon Kinesis Data Streams, there are no servers to manage. The on-demand mode eliminates the need to provision or manage capacity required for running applications.
-
Adjust your capacity to stream gigabytes per second of data with Kinesis Data Streams. Get automatic provisioning and scaling with the on-demand mode.
-
Pay only for what you use with Kinesis Data Streams, starting as low as $0.015 per hour. With the on-demand mode, you don't need to worry about over-provisioning.
-
Use built-in integrations with other AWS services to create analytics, serverless, and application integration solutions on AWS quickly.
-
Decouple producers & consumers
-
Persistent buffer
-
Collect multiple streams
-
Preserve client ordering
-
Parallel consumption
PK: Partition Key 예) b8e0745459d9a885f1b30541e28e0e6c
[Kinesis Data Stream에 입력한 결과의 예
kinesisResponse: {
"ShardId": "shardId-000000000000", "SequenceNumber": "49628968760419381815775185092326431149216009853023027202"
}
당근마켓: DynamoDB 데이터 변경 이벤트 파이프라인 구축하기
AWS Kinesis Data Stream 으로 대용량 데이터 수집을 편하게
AWS - Kinesis Data Stream - Hands On!
200 MiB/second, 200,000 records/second
400 MiB/second
AWS re:Invent 2020: Top 5 best practices for data streaming with Amazon Kinesis