How Polystream Identifies and Fixes Performance Issues with Instana

Post

When you’re the world’s most scalable real-time 3D delivery platform, it’s critical to not only deliver a high-performance application but also be able to monitor that platform for any problems and solve them quickly. At Polystream we use a number of tools to help provide developers with these insights, with Instana making a critical part of that toolkit.

The Problem

One of my colleagues recently mentioned that he had noticed that our internal dashboard had started to feel slower after a recent release, although not a critical issue, any sudden change, especially after a release, is worth investigation.

The Investigation

The first step in investigating this issue was confirming that there was in fact a problem and it wasn’t just user perception. Very quickly I was able to generate a graph in Instana which clearly showed that it was a real problem and that our latency was well outside what we would deem to be acceptable.

From here Instana makes it very easy to drill down and see each of the individual requests which shows that it’s not every request that is slow.

Then we can dig into an individual call and get a trace to work out exactly where the time is going.

This makes it very clear, we have an issue with data getting over the network. The Polystream platform runs on Kubernetes and uses Istio for communication between pods so my first thought was “have we introduced something that is using a large amount of CPU causing the pods to get bottlenecked?” Fortunately, Instana makes it a couple of clicks to get from here to the actual infrastructure running the pod that serviced that request and that’s where I found the problem.

Although the CPU usage of the pod was extremely low it was being continuously throttled by the resource limits we had placed on the docker container.

Conclusion

In the end, this came down to a simple miss-configuration of the CPU limits we were placing on our docker containers, however, identifying that as the cause would have been much more difficult if it wasn’t for Instana clearly showing us the problem and easily allowing us to jump between individual requests and the infrastructure serving that request.

Insight to everything happening on the platform is fundamental to Polystream being able to offer a global platform and Instana not only gives us that insight, but it also makes it easily accessible to everyone on the team.

This blog post was originally published on Polystream.com

 

Play with Instana’s APM Observability Sandbox

Start your FREE TRIAL today!

As the leading provider of Automatic Application Performance Monitoring (APM) solutions for microservices, Instana has developed the automatic monitoring and AI-based analysis DevOps needs to manage the performance of modern applications. Instana is the only APM solution that automatically discovers, maps and visualizes microservice applications without continuous additional engineering. Customers using Instana achieve operational excellence and deliver better software faster. Visit https://www.instana.com to learn more.