AWS Kinesis Monitoring and Performance Management
AWS Kinesis is an analytical streaming engine to collect, process and analyze real time data streams. Given that real time data analytics is a mission critical component of today’s applications performance and health insights is important, therefore Instana’s AWS Kinesis Monitoring offers comprehensive performance and health management.
AWS Kinesis plays an important role in applications that process any kind of data stream, making Kinesis monitoring a critical need for IT Operations, DevOps and Engineering teams. Instana’s automatic Kinesis Monitoring goes beyond simple metrics to provide a comprehensive set of management and monitoring features:
- Discovery of AWS Kinesis configurations and data streams
- Visualization of Service dependency maps
- Tracing of requests across all systems (end-to-end traces)
- Application and service health monitoring
- Insight into running stream processing pipelines
Comprehensive AWS Kinesis Monitoring requires performance visibility for the Kineses Data Streams processes, data sources and sinks, as well as any applications and services using the data stream.
Instana is the quickest and easiest way to monitor AWS Kinesis Data Streams across the stack to deliver comprehensive application insights. The Instana agent automatically discovers all AWS Kinesis configurations, deploys the necessary monitoring sensors and begins tracing jobs, sources, sinks and requests. Instana also automatically determines the health of the processing jobs.
Monitoring AWS Kinesis Performance
Instana’s single monitoring Agent automatically identifies any and all running AWS Kinesis Data Streams configurations – then automatically deploys and configures Instana’s Kinesis Monitoring sensor. The sensor’s internal knowledge base contains what performance metrics are relevant for collection and how to collect them. This includes any metrics necessary to confirm Kinesis infrastructure health. Since Instana’s automatic configuration collects all relevant information, monitoring AWS Kinesis couldn’t be easier.
To determine overall service health, the Instana AWS Kinesis Monitoring sensor also collects KPIs on the monitored AWS environment, services and applications to determine overall health status.
Instana’s AI-assisted troubleshooting automatically detects issues in the streaming system, whether the problem is with individual AWS Kinesis configurations or processing pipelines and issues service incidents. Instana automates incident escalation and automatically identifies the probable root cause identification, helping you solve issues before users are impacted.
Monitoring AWS Kinesis Configurations
In addition to performance and health data, the AWS Kinesis Monitoring sensor also collects service and pipeline configuration data, allowing Instana to analyze and correlate configuration data and changes with application and service performance information.
The Kinesis Monitoring Dashboard displays summarized AWS KInesis performance and configuration information displaying all relevant AWS Kinesis information in a single place for easy problem-solving and performance optimization.
Any Kinesis configuration changes are detected automatically, in real-time. These change events are correlated to any Kinesis issues or application / service incidents, helping to facilitate even quicker problem resolution.
AWS Kinesis Data Streams performance monitoring centers around service and pipeline metrics, as well as their interactions with other services, data sources or data sinks. Instana automatically identifies and collects the relevant service metrics.
AWS Kinesis Monitoring Data
Instana AWS Kinesis Monitoring includes three types of data; Configuration Data, Performance Data and Health Signatures:
|Configuration Data||Performance Data||Health Signatures|
|Name||Iterator Age||Read Provisioned Throughput Exceeded|
|ARN||Latency||Write Provisioned Throughput Exceeded|
|Status||Records||Subscribe To Shard Rate Exceeded|
|Retention Period||Incoming Bytes|
|Creation Time||Incoming Records|
|Grouping Zone||Outgoing Bytes|
Further information on the different sensor information is available in the
Instana AWS Kinesis Management Documentation