instana_aws_kinesis_white AWS Kinesis Monitoring

AWS Kinesis Monitoring and Performance Management

AWS Kinesis is an analytical streaming engine to collect, process and analyze real time data streams. Given that real time data analytics is a mission critical component of today’s applications performance and health insights is important, therefore Instana’s AWS Kinesis Monitoring offers comprehensive performance and health management.

AWS Kinesis plays an important role in applications that process any kind of data stream, making Kinesis monitoring a critical need for IT Operations, DevOps and Engineering teams. Instana’s automatic Kinesis Monitoring goes beyond simple metrics to provide a comprehensive set of management and monitoring features:

  • Discovery of AWS Kinesis configurations and data streams
  • Visualization of Service dependency maps
  • Tracing of requests across all systems (end-to-end traces)
  • Application and service health monitoring
  • Insight into running stream processing pipelines

Comprehensive AWS Kinesis Monitoring requires performance visibility for the Kineses Data Streams processes, data sources and sinks, as well as any applications and services using the data stream.

Instana is the quickest and easiest way to monitor AWS Kinesis Data Streams across the stack to deliver comprehensive application insights. The Instana agent automatically discovers all AWS Kinesis configurations, deploys the necessary monitoring sensors and begins tracing jobs, sources, sinks and requests. Instana also automatically determines the health of the processing jobs.

Monitoring AWS Kinesis Performance

Instana’s single monitoring Agent automatically identifies any and all running AWS Kinesis Data Streams configurations – then automatically deploys and configures Instana’s Kinesis Monitoring sensor. The sensor’s internal knowledge base contains what performance metrics are relevant for collection and how to collect them. This includes any metrics necessary to confirm Kinesis infrastructure health. Since Instana’s automatic configuration collects all relevant information, monitoring AWS Kinesis couldn’t be easier.

To determine overall service health, the Instana AWS Kinesis Monitoring sensor also collects KPIs on the monitored AWS environment, services and applications to determine overall health status.

Instana’s AI-assisted troubleshooting automatically detects issues in the streaming system, whether the problem is with individual AWS Kinesis configurations or processing pipelines and issues service incidents. Instana automates incident escalation and automatically identifies the probable root cause identification, helping you solve issues before users are impacted.

Monitoring AWS Kinesis Configurations

In addition to performance and health data, the AWS Kinesis Monitoring sensor also collects service and pipeline configuration data, allowing Instana to analyze and correlate configuration data and changes with application and service performance information.

The Kinesis Monitoring Dashboard displays summarized AWS KInesis performance and configuration information displaying all relevant AWS Kinesis information in a single place for easy problem-solving and performance optimization.

Any Kinesis configuration changes are detected automatically, in real-time. These change events are correlated to any Kinesis issues or application / service incidents, helping to facilitate even quicker problem resolution.

AWS Kinesis Data Streams performance monitoring centers around service and pipeline metrics, as well as their interactions with other services, data sources or data sinks. Instana automatically identifies and collects the relevant service metrics.

AWS Kinesis Monitoring Data

Instana AWS Kinesis Monitoring includes three types of data; Configuration Data, Performance Data and Health Signatures:

Configuration Data Performance Data Health Signatures
Name Iterator Age Read Provisioned Throughput Exceeded
ARN Latency Write Provisioned Throughput Exceeded
Status Records Subscribe To Shard Rate Exceeded
Encryption Type Success  
Retention Period Incoming Bytes  
Creation Time Incoming Records  
Grouping Zone Outgoing Bytes  
  Outgoing Records  


Further information on the different sensor information is available in the Instana AWS Kinesis Management Documentation .

AWS Kinesis Sensor Installation: Getting Started

Ready to start? You’ll need an Instana Trial or Account first. Already got one? The best place to begin is Instana’s Getting Started Guide .