Category Archives: Monitoring

Hardware, services and network monitoring systems

Prometheus: running Pushgateway on Kubernetes with Helm and Terraform
0 (0)

28 April 2023

We have a lot of AWS Lambda functions in the project, and developers want to be able to send metrics to our Prometheus to add their own alerts and graphs in Grafana. For this, the functions use the Prometheus library, which allows these metrics to be created (see Prometheus: Building a Custom Prometheus Exporter in… Read More: Prometheus: running Pushgateway on Kubernetes with Helm and Terraform0 (0) »

Loading

GitLab: monitoring – Prometheus, metrics, and Grafana dashboard
0 (0)

12 March 2023

So, let’s continue our journey with migrating GitLab to Kubernetes. See previous parts: GitLab: Components, Architecture, Infrastructure, and Launching from the Helm Chart in Minikube GitLab: Helm chart of values, dependencies, and deployment in Kubernetes with AWS S3 GitLab: міграція даних з GitLab cloud та процес backup-restore у self-hosted версії в Kubernetes In general, everything is working,… Read More: GitLab: monitoring – Prometheus, metrics, and Grafana dashboard0 (0) »

Loading

Grafana Loki: LogQL for logs and creating metrics for alerts
0 (0)

12 March 2023

Good – we learned how to launch Loki – Grafana Loki: architecture and running in Kubernetes with AWS S3 storage and bolted-shipper, we also figured out how to configure alerts – Grafana Loki: alerts from the Loki Ruler and labels from logs. Now it’s time to figure out what we can do in Loki using its… Read More: Grafana Loki: LogQL for logs and creating metrics for alerts0… »

Loading

Grafana Loki: alerts from the Loki Ruler and labels from logs
0 (0)

12 March 2023

For general information on Grafana Loki, see the Grafana Loki: architecture and running in Kubernetes with AWS S3 storage and boltdb-shipper. Among other services that make up Loki, there is a separate service called ruler that is responsible for working with alerts that can be generated directly from logs. The idea is very simple: create… Read More: Grafana Loki: alerts from the Loki Ruler and labels from… »

Loading

Prometheus: Building a Custom Prometheus Exporter in Python
0 (0)

25 February 2023

Prometheus has many ready-to-use exporters, but sometimes you may need to collect your own metrics. For this, Prometheus provides client libraries that we can use to generate metrics with the necessary labels. Such an exporter can be included directly in the code of your application, or it can be run as a separate service that will poll one… Read More: Prometheus: Building a Custom Prometheus Exporter in Python0 (0) »

Loading

Kubernetes: Cluster Cost Monitoring – Kubernetes Resource Report and Kubecost
0 (0)

29 January 2023

The very useful thing is to monitor how efficiently the cluster is being used, especially if applications are deployed by developers who do not delve into requests much and set inflated values ​​”in reserve”. A reserve, of course, is needed – but simply requesting resources is a bad idea. For example, you have a WorkerNode… Read More: Kubernetes: Cluster Cost Monitoring – Kubernetes Resource Report and Kubecost0… »

Loading

Grafana Loki: alerts from Ruler and labels from logs
0 (0)

7 January 2023

For general information about Grafana Loki, see the Grafana Loki: architecture and running in Kubernetes with AWS S3 storage and boltdb-shipper post. Among other components of the Loki, there is a separate service called ruler that is responsible for working with alerts that can be generated directly from logs. The idea is very simple: create… Read More: Grafana Loki: alerts from Ruler and labels from logs0 (0) »

Loading

Grafana Loki: architecture and running in Kubernetes with AWS S3 storage and boltdb-shipper
0 (0)

7 January 2023

The last time I worked with Loki when it was still in Beta, and it looked much simpler then than it does now. In the new project, there is no logging system at all, and since we all love the Grafana stack, we also decided to use Loki for logging. Although to be honest, I… Read More: Grafana Loki: architecture and running in Kubernetes with AWS S3… »

Loading

Prometheus: Kubernetes endpoints monitoring with blackbox-exporter
0 (0)

11 December 2022

The blackbox-exporter is an exporter that can monitor various endpoints – URLs on the Internet, your LoadBalancers in AWS, or Services in a Kubernetes cluster, such as MySQL or PostgreSQL databases. Blackbox Exporter can give you HTTP response time statistics, response codes, information on SSL certificates, etc. What are we going to do in this… Read More: Prometheus: Kubernetes endpoints monitoring with blackbox-exporter0 (0) »

Loading

PostgreSQL: PostgreSQL Operator for Kubernetes, and its Prometheus monitoring
0 (0)

23 September 2022

So, we’ve launched Druid, see Apache Druid: Overview, Running in Kubernetes, and Monitoring with Prometheus . So far, a local Apache Derby database is used as the default storage for metadata . Next, we will switch Druid to PostgreSQL, and later we will remove ZooKeeper from the cluster setup. To begin with, let’s start a PostgreSQL cluster in Kubernetes, add… Read More: PostgreSQL: PostgreSQL Operator for Kubernetes, and its Prometheus monitoring0 (0) »

Loading