Category Archives: Monitoring

Hardware, services and network monitoring systems

Kubernetes: namespace hangs in Terminating and metrics-server non-obviousness
0 (0)

1 April 2021

Faced with a very interesting thing during removal of a Kubernetes Namespace. After a kubectl delete namespace NAMESPACE is executed, the namespace hangs in the Terminating state, and any attempt to forcibly remove it didn’t help. First, let’s see how such a force-removal can be done, and then will check the real cause and a… Read More: Kubernetes: namespace hangs in Terminating and metrics-server non-obviousness0 (0) »

Loading

Opsgenie: integration with AWS RDS and alerting
0 (0)

18 March 2021

Let’s configure Opsgenie with AWS RDS. The idea is to get notifications from RDS about events and send them to Opsgenie which will send them to our Slack. To do so, we need to configure AWS Simple Notification Service and AWS RDS Event subscriptions. The official documentation is here>>>. Opsgenie confiuration Go to the Integrations… Read More: Opsgenie: integration with AWS RDS and alerting0 (0) »

Loading

Yandex.Tank: load testing tool – an overview, configuration, and examples
0 (0)

10 February 2021

Besides the Apache Bench and JMeter there is another utility – Yandex Tank. It’s used by our QA team and now it’s time for me to take a closer look on it to test one issue with our application running on a Kubernetes cluster. In this post a short overview of its capabilities and configuration.… Read More: Yandex.Tank: load testing tool – an overview, configuration, and examples0… »

Loading

Logz.io: collection logs from Kubernetes – fluentd vs filebeat
0 (0)

1 February 2021

We are using Logz.io to collect our Kubernetes cluster logs (also, there is a local Loki instance). Logs are collected and processed by a Fluentd pod on every WorkerNode which are deployed from a DaemonSet in its default configuration, see the documentation here – logzio-k8s. The problem we faced is that those pods are consuming… Read More: Logz.io: collection logs from Kubernetes – fluentd vs filebeat0 (0) »

Loading

Prometheus: Alertmanager Web UI alerts Silence
0 (0)

26 January 2021

Active alerts sending frequency via Alertmanager is configured via the repeat_interval in the /etc/alertmanager/config.yml file. We have this interval set to 15 minutes, and as result, we have notifications about alerts in our Slack each fifteen minutes. Still, some alerts are such a “known issues”, when we already started the investigation or fixing it, but… Read More: Prometheus: Alertmanager Web UI alerts Silence0 (0) »

Loading

Linux: LEMP set up – NGINX, PHP, MySQL, SSL, monitoring, logs, and a WordPress blog migration
0 (0)

6 November 2020

Finally got time to migrate the RTFM.CO.UA blog to a new server with Debian 10. This time manually, without any automation will set up a LEMP stack Wrote a similar at 2016 – Debian: установка LEMP — NGINX + PHP-FPM + MariaDB (Rus), but in time the post is more complete of the process and… Read More: Linux: LEMP set up – NGINX, PHP, MySQL, SSL, monitoring,… »

Loading

AWS Elastic Kubernetes Service: load-testing and high-load tuning – problems and solutions
0 (0)

4 September 2020

Actually, this post was planned as a short note about using NodeAffinity for Kubernetes Pod: But then, as often happens, after starting writing about one thing, I faced another, and then another one, and as a result – I made this long-read post about Kubernetes load-testing. So, I’ve started about NodeAffinity, but then wondered how… Read More: AWS Elastic Kubernetes Service: load-testing and high-load tuning – problems… »

Loading

Kubernetes: a cluster’s monitoring with the Prometheus Operator
0 (0)

13 August 2020

Continuing with the Kubernetes: monitoring with Prometheus – exporters, a Service Discovery, and its roles, where we configured Prometheus manually to see how it’s working – now, let’s try to use Prometheus Operator installed via Helm chart. So, the task is spin up a Prometheus server and all necessary exporter in an AWS Elastic Kubernetes… Read More: Kubernetes: a cluster’s monitoring with the Prometheus Operator0 (0) »

Loading

Kubernetes: HorizontalPodAutoscaler – an overview with examples
0 (0)

12 August 2020

Kubernetes HorizontalPodAutoscaler automatically scales Kubernetes Pods under ReplicationController, Deployment, or ReplicaSet controllers basing on its CPU, memory, or other metrics. It was shortly discussed in the Kubernetes: running metrics-server in AWS EKS for a Kubernetes Pod AutoScaler post, now let’s go deeper to check all options available for scaling. For HPA you can use three… Read More: Kubernetes: HorizontalPodAutoscaler – an overview with examples0 (0) »

Loading

Prometheus: yet-another-cloudwatch-exporter – collecting AWS CloudWatch metrics
0 (0)

23 July 2020

Currently, to collect metrics from the AWS CloudWatch we are using AWS’s own cloudwatch-exporter, see the Prometheus: CloudWatch exporter — сбор метрик из AWS и графики в Grafana post (in Rus), but it has a few gaps: it’s written in Java, so uses CPU/memory of the monitoring host doesn’t scrapes AWS tags from resources uses… Read More: Prometheus: yet-another-cloudwatch-exporter – collecting AWS CloudWatch metrics0 (0) »

Loading