OS Process

Configuration

Process Abnormal Termination

The Instana agent can automatically detect abnormal termination of processes (e.g., crashes) of relevant processes on the host, and their exit status code. The abnormal process termination of a process will be displayed on the dashboards of that process's dashboard, as well as in the Event view.

Abnormal process termination displayed on the process's dashboard.

Anomalies detected

  • Exit with erroneous status codes, e.g., exit 1
  • Kill of the process via kill, a.k.a. SIGKILL
  • Segmentation faults
  • Unhandled signals

Requirements

  • The detection of abnormal process termination is only supported on Linux on the AMD64 architecture. A 4.8 or later Linux kernel is required or, in the case of RHEL, a Linux kernel 3.10.0-957 or later.
  • debugfs to be mounted, which is the case for all Linux OSes supported by the Instana host agent, with the exception of Amazon Linux 1.

Deactivation

The detection of abnormal process termination can be disabled with the following setting in the configuration.yaml file:

com.instana.plugin.ebpf:
  enabled: false

Custom Processes

Instana will automatically monitor process metrics of higher level sensors like Java or MySQL by default. Should you want to monitor an OS process which is not covered by Instana automatically, you can configure it like this:

com.instana.plugin.process:
  processes:
  - 'sshd'
  - 'slapd'

Voluntary and non-voluntary context switches

Note: This functionality is supported only on Linux-based operating systems.

You can manually enable monitoring of context switches by editing the host's agent configuration file (/opt/instana/agent/etc/instana/configuration.yaml):

...
com.instana.plugin.process:
  ctx_switches_enabled: true

OS Process Environment Variables

Instana's process sensor automatically captures all the environment variables of any monitored process. Because environments often contains sensitive or secret data, the process sensor will take any configured secrets into account when filtering.

More about configuring secrets can be found at Agent Configuration secrets

configuring secrets

Windows Services

Instana supports monitoring of Windows Services and its child processes. You can configure it like this:

...
com.instana.plugin.process:
  services:
    - 'WindowsService1'
    - 'WindowsService2'

Metrics collection

Configuration data

  • PID
  • Executable
  • Started At
  • User
  • Group
  • Max Open Files
  • Arguments

Performance metrics

CPU usage

CPU usage values as a percentage; user and system. The values are displayed on a graph over a selected time period.

Data point: Filesystem

Granularity: 3 seconds

Memory

Memory usage values as a byte; virtual, resident and share. The values are displayed on a graph over a selected time period.

Data point: Filesystem

Granularity: 3 seconds

Open Files

Open files values used as a total number and current as a percentage. The values are displayed on a graph over a selected time period.

Open files current vs max will be visible when they are available on the operating system.

Data point: Filesystem

Granularity: 3 seconds

Number of context switches

Number of times the process was context-switched; voluntary and nonvoluntary. The values are displayed on a graph over a selected time period.

Data point: Filesystem

Granularity: 3 seconds

Health Signatures

For each sensor, there is a curated knowledgebase of health signatures that are evaluated continuously against the incoming metrics and are used to raise issues or incidents depending on user impact.

Built-in events trigger issues or incidents based on failing health signatures on entities, and custom events trigger issues or incidents based on the thresholds of an individual metric of any given entity.

For information about the built-in event for the OS process sensor, see the Built-in events reference.