DEV Community

Asanka Boteju
Asanka Boteju

Posted on

Amazon Kinesis for Near Realtime Streaming

Amazon Kinesis Data Streams

Collect and store streaming data such as clickstream data, IoT, metrics, and logs in real time with Amazon Kinesis Data Streams.

AWS fully manages the infrastructure required to run Kinesis
Pay-as-you-go pricing model where you are billed based on your usage.
Write your own producer and consumer codes using KPL and KCL libraries.
✅Shards to improve throughput.
✅Optionally, enable output data format conversions to Parquet or ORC with the support of Glue Catalogs.
✅Support for dynamic partitions.
✅Supports custom transformations with the use of lambda functions


Streaming
Image description

Destination
Image description

Output
Image description

Top comments (0)