Amazon Kinesis is a fully-managed system that lets you stream data into the cloud, highly useful for enterprises that need to stream data in real-time. Since AWS takes care of managing the infrastructure, developers get to spend more time working on their system than on maintaining their hardware.
AWS has just announced the following three new features for Amazon Kinesis.
Amazon ElasticSearch Integration
AWS ElasticSearch lets you run the search engine in the AWS cloud. By activating this feature in the AWS Management Console, you can run ElasticSearch on a Kinesis Firehose data stream.
This means you can index and analyze different types of data, such as logs, clickstreams, and user traffic. It removes the need to create a different program for data ingestion.
Enhanced Shard-level Metrics
Adding shards to a Kinesis stream increases that stream’s capacity. To help you keep track of a shard’s capacity, AWS has added shard-level metrics such as incoming and outgoing bytes and records, read/write throughput exceeded, and the age of the last record returned by a call on a shard.
Apps read a Kinesis stream by creating an iterator on a particular shard and using a starting point of your choice. Besides this, you may now also provide a timestamp of the oldest record you want to read and process.
If you want to learn how to apply these changes to your Amazon Kinesis, or wish to learn how Kinesis can improve your systems, contact our AWS cloud experts today at PolarSeven.