Category Archives: Monitoring

Hardware, services and network monitoring systems

AWS: Grafana Loki, InterZone traffic in AWS, and Kubernetes nodeAffinity
0 (0)

19 August 2023

Traffic in AWS is generally quite an interesting and sometimes complicated thing, I once wrote about it in the AWS: Cost optimization – services expenses overview and traffic costs in AWS. Now, it’s time to return to this topic again. So, what’s the problem: in AWS Cost Explorer, I’ve noticed that we have an increase… Read More: AWS: Grafana Loki, InterZone traffic in AWS, and Kubernetes nodeAffinity0… »

Loading

VictoriaMetrics: deploying a Kubernetes monitoring stack
0 (0)

23 July 2023

Now we have VictoriaMetrics + Grafana on a regular EC2 instance, launched with Docker Compose, see the VictoriaMetrics: an overview and its use instead of Prometheus. It was kind of a Proof of Concept, and it’s time to launch it “in an adult way” – in Kubernetes and all the configurations stored in a GitHub… Read More: VictoriaMetrics: deploying a Kubernetes monitoring stack0 (0) »

Loading

VictoriaMetrics: an overview and its use instead of Prometheus
0 (0)

11 June 2023

I’ve heard a lot about VictoriaMetrics for a long time, and finally, it’s time to try it out. So, in a nutshell – VictoriaMetrics is “Prometheus on steroids” and is fully compatible with it – can use its configuration files, exporters, PromQL, etc. So for me who has always used Prometheus, the first question was… Read More: VictoriaMetrics: an overview and its use instead of Prometheus0 (0) »

Loading

Prometheus: GitHub Exporter – creating own exporter for GitHub API
0 (0)

11 June 2023

Recently, I got a new interesting task – to build a dashboard in Grafana that would display the status of our development process and its performance, that is, the efficiency of our DevOps processes. This is necessary because we are trying to build “true continuous deployment” so that the code automatically enters Production, and we… Read More: Prometheus: GitHub Exporter – creating own exporter for GitHub API0… »

Loading

Loki: collecting logs from CloudWatch Logs using Lambda Promtail
0 (0)

20 May 2023

Collecting logs in Grafana Loki with Kubernetes is very simple – we just launch Promtail in DaemonSet, configure it to read all data from /var/logs – and that’s it (in fact, we don’t specify anything at all – everything works out of the box from the Helm chart). But what about CloudWatch Logs? On my new project,… Read More: Loki: collecting logs from CloudWatch Logs using Lambda Promtail0 (0) »

Loading

Prometheus: running Pushgateway on Kubernetes with Helm and Terraform
0 (0)

28 April 2023

We have a lot of AWS Lambda functions in the project, and developers want to be able to send metrics to our Prometheus to add their own alerts and graphs in Grafana. For this, the functions use the Prometheus library, which allows these metrics to be created (see Prometheus: Building a Custom Prometheus Exporter in… Read More: Prometheus: running Pushgateway on Kubernetes with Helm and Terraform0 (0) »

Loading

GitLab: monitoring – Prometheus, metrics, and Grafana dashboard
0 (0)

12 March 2023

So, let’s continue our journey with migrating GitLab to Kubernetes. See previous parts: GitLab: Components, Architecture, Infrastructure, and Launching from the Helm Chart in Minikube GitLab: Helm chart of values, dependencies, and deployment in Kubernetes with AWS S3 GitLab: міграція даних з GitLab cloud та процес backup-restore у self-hosted версії в Kubernetes In general, everything is working,… Read More: GitLab: monitoring – Prometheus, metrics, and Grafana dashboard0 (0) »

Loading

Grafana Loki: LogQL for logs and creating metrics for alerts
0 (0)

12 March 2023

Good – we learned how to launch Loki – Grafana Loki: architecture and running in Kubernetes with AWS S3 storage and bolted-shipper, we also figured out how to configure alerts – Grafana Loki: alerts from the Loki Ruler and labels from logs. Now it’s time to figure out what we can do in Loki using its… Read More: Grafana Loki: LogQL for logs and creating metrics for alerts0… »

Loading

Grafana Loki: alerts from the Loki Ruler and labels from logs
0 (0)

12 March 2023

For general information on Grafana Loki, see the Grafana Loki: architecture and running in Kubernetes with AWS S3 storage and boltdb-shipper. Among other services that make up Loki, there is a separate service called ruler that is responsible for working with alerts that can be generated directly from logs. The idea is very simple: create… Read More: Grafana Loki: alerts from the Loki Ruler and labels from… »

Loading

Prometheus: Building a Custom Prometheus Exporter in Python
0 (0)

25 February 2023

Prometheus has many ready-to-use exporters, but sometimes you may need to collect your own metrics. For this, Prometheus provides client libraries that we can use to generate metrics with the necessary labels. Such an exporter can be included directly in the code of your application, or it can be run as a separate service that will poll one… Read More: Prometheus: Building a Custom Prometheus Exporter in Python0 (0) »

Loading