Tag Archives: monitoring

PostgreSQL: AWS RDS Performance and monitoring
0 (0)

10 February 2025

We are migrating our Backend API from DynamoDB to AWS RDS PostgreSQL, and several times RDS crashed. Actually, given that we took db.t3.small with two vCPUs and two gigabytes of memory to save money, it was quite expected, but I wondered why everything was crashing. A few days later, I started to debug the issue,… Read More: PostgreSQL: AWS RDS Performance and monitoring0 (0) »

Loading

VictoriaLogs: creating Recording Rules with VMAlert
0 (0)

11 January 2025

We continue the migration from Grafana Loki to VictoriaLogs, and the next task is to transfer Recording Rules from Loki to VictoriaLogs and update the alerts. Recording Rules and integration with VMAlert were brought to VictoriaLogs relatively recently, and I haven’t tested this scheme yet. Therefore, we will first do everything by hand to see… Read More: VictoriaLogs: creating Recording Rules with VMAlert0 (0) »

Loading

Vector.dev: introduction, AWS S3 logs, and integration with VictoriaLogs
0 (0)

21 December 2024

So, we’re back to the topic of AWS VPC Flow Logs, VictoriaLogs, and the Grafana dashboard. In the post VictoriaLogs: a Grafana dashboard for AWS VPC Flow Logs – migrating from Grafana Loki, we created a cool dashboard to display various statistics on AWS NAT Gateway traffic. But there is a small drawback: all the… Read More: Vector.dev: introduction, AWS S3 logs, and integration with VictoriaLogs0 (0) »

Loading

VictoriaLogs: an overview, run in Kubernetes, LogsQL, and Grafana
0 (0)

9 September 2024

VictoriaLogs is a relatively new system for collecting and analyzing logs, similar to Grafana Loki, but – like VictoriaMetrics compared to vanilla Prometheus – less demanding on CPU/Memory resources. Personally, I’ve been using Grafana Loki for about 5 years, but sometimes I have concerns about it – both in terms of documentation and the overall… Read More: VictoriaLogs: an overview, run in Kubernetes, LogsQL, and Grafana0 (0) »

Loading

Kubernetes: monitoring Events with kubectl and Grafana Loki
0 (0)

23 June 2024

In Kubernetes, in addition to metrics and logs from containers, we can get information about the operation of components using Kubernetes Events. Events usually store information about the status of Pods (creation, evict, kill, ready or not-ready status of pods), WorkerNodes (status of servers), Kubernetes Scheduler (inability to start a pod, etc.). Kubernetes Events types… Read More: Kubernetes: monitoring Events with kubectl and Grafana Loki0 (0) »

Loading

Kubernetes: tracing requests with AWS X-Ray, and Grafana data source
0 (0)

2 March 2024

Tracing allows you to track requests between components, that is, for example, when using AWS and Kubernetes we can trace the entire path of a request from AWS Load Balancer to Kubernetes Pod and to DynamoDB or RDS. This helps us both to track performance issues – where and which requests are taking a long… Read More: Kubernetes: tracing requests with AWS X-Ray, and Grafana data source0… »

Loading

Grafana Loki: LogQL and Recording Rules for metrics from AWS Load Balancer logs
0 (0)

24 February 2024

I didn’t plan this post at all as I thought I would do it quickly, but it didn’t work out quickly, and I need to dig a little deeper into this topic. So, what we are talking about: we have AWS Load Balancers, logs from which are collected to Grafana Loki, see. Grafana Loki: collecting… Read More: Grafana Loki: LogQL and Recording Rules for metrics from AWS… »

Loading

VictoriaMetrics: pushing metrics without Prometheus Pushgateway
0 (0)

18 November 2023

In the Prometheus: running Pushgateway on Kubernetes with Helm and Terraform post I wrote about how to add Pushgateway to Prometheus, which allows using the Push model instead of Pull, that is, an Exporter can send metrics directly to the database instead of waiting for Prometheus or VMAgent to come to it. With VictoriaMetrics, it’s… Read More: VictoriaMetrics: pushing metrics without Prometheus Pushgateway0 (0) »

Loading

Grafana: values ​​from records in Loki logs, and dual-Y-axes panels in Grafana
0 (0)

19 August 2023

We have a function in AWS Lambda, that is writing logs to CloudWatch Logs, from where with the lambda-promtail we are getting them to a Grafana Loki instance to use them in Grafana graphs. What the task is: in the logs, we have records about “Init duration” and “Max Memory Used” by Lambdas. There are no… Read More: Grafana: values ​​from records in Loki logs, and dual-Y-axes panels… »

Loading

Prometheus: GitHub Exporter – creating own exporter for GitHub API
0 (0)

11 June 2023

Recently, I got a new interesting task – to build a dashboard in Grafana that would display the status of our development process and its performance, that is, the efficiency of our DevOps processes. This is necessary because we are trying to build “true continuous deployment” so that the code automatically enters Production, and we… Read More: Prometheus: GitHub Exporter – creating own exporter for GitHub API0… »

Loading