While the above metrics focus on the application layer, monitoring infrastructure is equally important. Node availability and instance count are key infrastructure performance metrics.

Node availability
Node availability tracks the uptime of the servers or virtual machines (nodes) hosting your applications. High availability is critical for ensuring that users can always access the application. Any downtime or unavailability of nodes can lead to significant service disruptions.

Instance count
The instance count metric monitors the number of active application instances. It’s important for scaling applications based on demand. A low instance count may cause slow performance during traffic spikes, while an unnecessarily high count could lead to wasted resources.

Note: Some metrics, like CPU usage, throughput, and uptime, apply to both the application and infrastructure levels. These are critical to understanding both how your application performs and how the underlying infrastructure supports it.

CPU Usage
CPU usage at the infrastructure level measures how much processing power is being consumed by the servers or virtual machines (VMs) that host your applications. High CPU usage indicates that your infrastructure is working hard to meet the demands of the application. However, consistently high usage can strain resources, leading to slower performance, increased latency, and potential system crashes.

Monitoring CPU usage across your infrastructure helps ensure that you have adequate processing power to handle current workloads. It also allows IT teams to detect when additional resources are needed, whether through scaling out to additional instances or optimizing existing workloads. Key benefits of tracking CPU usage at the infrastructure level include:

• Identifying underutilized or overutilized resources.
• Preventing CPU bottlenecks that could degrade application performance.
• Making informed decisions on scaling infrastructure to meet demand.

Proactively monitoring CPU usage can prevent system failures and improve overall application reliability, especially during traffic spikes or peak usage times.

Throughput
Throughput at the infrastructure level refers to the amount of data or number of transactions processed by your servers, VMs, or cloud instances over a specific period. High throughput indicates that your infrastructure can efficiently handle multiple requests, while low throughput may point to performance bottlenecks, insufficient resources, or misconfigurations.

By tracking throughput at the infrastructure level, IT teams can gain a clearer understanding of how well the system is managing overall application load. If throughput starts to decline while traffic remains consistent, it can signal that the infrastructure is struggling to keep up, leading to increased latency or failed requests. Monitoring this metric helps ensure that your system can manage the application’s demand without compromising performance.

Key considerations for monitoring throughput include:

• Ensuring that throughput aligns with expected traffic levels.
• Identifying network or hardware limitations that could be impacting data flow.
• Scaling infrastructure based on throughput trends to maintain optimal performance.

Keeping a close eye on throughput enables teams to optimize the underlying infrastructure, ensuring the application remains responsive even as demand fluctuates.