Category Archives: Monitoring

Hardware, services and network monitoring systems

Grafana Loki: alerts from the Loki Ruler and labels from logs
0 (0)

12 March 2023

For general information on Grafana Loki, see the Grafana Loki: architecture and running in Kubernetes with AWS S3 storage and boltdb-shipper. Among other services that make up Loki, there is a separate service called ruler that is responsible for working with alerts that can be generated directly from logs. The idea is very simple: create… Read More: Grafana Loki: alerts from the Loki Ruler and labels from… »

Loading

Prometheus: Building a Custom Prometheus Exporter in Python
0 (0)

25 February 2023

Prometheus has many ready-to-use exporters, but sometimes you may need to collect your own metrics. For this, Prometheus provides client libraries that we can use to generate metrics with the necessary labels. Such an exporter can be included directly in the code of your application, or it can be run as a separate service that will poll one… Read More: Prometheus: Building a Custom Prometheus Exporter in Python0 (0) »

Loading

Kubernetes: Cluster Cost Monitoring – Kubernetes Resource Report and Kubecost
0 (0)

29 January 2023

The very useful thing is to monitor how efficiently the cluster is being used, especially if applications are deployed by developers who do not delve into requests much and set inflated values ​​”in reserve”. A reserve, of course, is needed – but simply requesting resources is a bad idea. For example, you have a WorkerNode… Read More: Kubernetes: Cluster Cost Monitoring – Kubernetes Resource Report and Kubecost0… »

Loading

Grafana Loki: alerts from Ruler and labels from logs
0 (0)

7 January 2023

For general information about Grafana Loki, see the Grafana Loki: architecture and running in Kubernetes with AWS S3 storage and boltdb-shipper post. Among other components of the Loki, there is a separate service called ruler that is responsible for working with alerts that can be generated directly from logs. The idea is very simple: create… Read More: Grafana Loki: alerts from Ruler and labels from logs0 (0) »

Loading

Grafana Loki: architecture and running in Kubernetes with AWS S3 storage and boltdb-shipper
0 (0)

7 January 2023

The last time I worked with Loki when it was still in Beta, and it looked much simpler then than it does now. In the new project, there is no logging system at all, and since we all love the Grafana stack, we also decided to use Loki for logging. Although to be honest, I… Read More: Grafana Loki: architecture and running in Kubernetes with AWS S3… »

Loading

Prometheus: Kubernetes endpoints monitoring with blackbox-exporter
0 (0)

11 December 2022

The blackbox-exporter is an exporter that can monitor various endpoints – URLs on the Internet, your LoadBalancers in AWS, or Services in a Kubernetes cluster, such as MySQL or PostgreSQL databases. Blackbox Exporter can give you HTTP response time statistics, response codes, information on SSL certificates, etc. What are we going to do in this… Read More: Prometheus: Kubernetes endpoints monitoring with blackbox-exporter0 (0) »

Loading

PostgreSQL: PostgreSQL Operator for Kubernetes, and its Prometheus monitoring
0 (0)

23 September 2022

So, we’ve launched Druid, see Apache Druid: Overview, Running in Kubernetes, and Monitoring with Prometheus . So far, a local Apache Derby database is used as the default storage for metadata . Next, we will switch Druid to PostgreSQL, and later we will remove ZooKeeper from the cluster setup. To begin with, let’s start a PostgreSQL cluster in Kubernetes, add… Read More: PostgreSQL: PostgreSQL Operator for Kubernetes, and its Prometheus monitoring0 (0) »

Loading

Apache Druid: overview, running in Kubernetes and monitoring with Prometheus
0 (0)

18 September 2022

Apache Druid is a columnar database, focused on working with large amounts of data, combining the features and benefits of Time-Series Database, Data Warehouse, and a search engine. The general task is to set up monitoring of the Druid cluster in Kubernetes, so at first, we will see what it is in general and how… Read More: Apache Druid: overview, running in Kubernetes and monitoring with Prometheus0… »

Loading

AWS: VPC Flow Logs – an overview and example with CloudWatch Logs Insights
0 (0)

19 July 2022

AWS VPC Flow Logs allow you to log traffic information between network interfaces in a VPC. Further, these logs can be stored in AWS S3 or sent to AWS CloudWatch Logs, while enabling traffic logging does not affect the performance of the network interface in any way. Let’s briefly review the basic concepts, and available… Read More: AWS: VPC Flow Logs – an overview and example with… »

Loading

Elastic Stack: an overview and ELK installation on Ubuntu 20.04
0 (0)

22 February 2022

The last time I’ve worked with the ELK stack about 7 years ago, see the ELK: установка Elasticsearch+Logstash+Kibana на CentOS. Currently, we are using Logz.io, but its costs going higher and higher, so we started looking at the self-hosted ELK solution to be running on our AWS Elastic Kubernetes Service clusters. So, the task, for… Read More: Elastic Stack: an overview and ELK installation on Ubuntu 20.040… »

Loading