The Amazon Kinesis service is designed processing large data streams in real time. This allows you to capture and store terabytes from thousands of sources. You can couple Kinesis with other services such as AWS Lambda, VPC Flow Logs, and CloudTrail in order to monitor data and run code in response to these findings.
However, while data is vital to your business, it’s not useful unless presented in a way that you store, organise, and understand. As such, AWS has launched a feature that will allow you to create visuals using Kinesis and the new CloudWatch Log Subscription Consumer, a service that specializes in reading data streams from Kinesis.
- Initiate an Elastisearch cluster on Amazon EC2,
- Create a log subscription consumer to direct data streams to Elastisearch, and;
- Use Kibana to create a set of highly visual dashboards for you to use.
There already are customizable dashboards for VPC, Lambda, and CloudTrail. Of course, you can make your own. More information can be found at the CloudWatch Logs Subscription Consumer, or contact a PolarSeven AWS cloud expert for help.
[video_player type=”youtube” width=”560″ height=”315″ align=”center” margin_top=”0″ margin_bottom=”20″ border_size=”3″ border_color=”#20b3cf”]aHR0cHM6Ly93d3cueW91dHViZS5jb20vd2F0Y2g/dj04dTl3SUMxeE50OA==[/video_player]