Category Archives: HOWTO’s

VictoriaLogs: “rate limit exceeded” and monitoring ingested logs
0 (0)

13 September 2025

We use two systems for collecting logs in the project: Grafana Loki and VictoriaLogs, to which Promtail simultaneously writes all collected logs. We cannot get rid of Loki: although developers have long since switched to VictoriaLogs, some alerts are still created from metrics generated by Loki, so it is still present in the system. And… Read More: VictoriaLogs: “rate limit exceeded” and monitoring ingested logs0 (0) »

Loading

Terraform: AWS EKS Terraform module update from version 20.x to version 21.
5 (1)

6 August 2025

AWS EKS Terraform module version v21.0.0 added support for the AWS Provider Version 6. Documentation – here>>>. The main changes in the AWS EKS module are the replacement of IRSA with EKS Pod Identity for the Karpenter sub-module: Native support for IAM roles for service accounts (IRSA) has been removed; EKS Pod Identity is now… Read More: Terraform: AWS EKS Terraform module update from version 20.x to… »

Loading

Kubernetes: PVC in StatefulSet, and the “Forbidden updates to statefulset spec” error
0 (0)

22 July 2025

We have a VictoriaLogs Helm chart with a PVC size of 30 GB, which is no longer enough for us, and we need to increase it. But the problem is that .spec.volumeClaimTemplates[*].spec.resources.requests.storage in STS is immutable, that is, we can’t just change the size through values.yaml file, because it will lead to the error“Forbidden: updates… Read More: Kubernetes: PVC in StatefulSet, and the “Forbidden updates to statefulset… »

Loading

Kubernetes: Kubernetes API, API groups, CRDs, and the etcd
0 (0)

21 July 2025

I actually started to write about creating my own Kubernetes Operator, but decided to make a separate topic about what a Kubernetes CustomResourceDefinition is, and how creating a CRD works at the level of the Kubernetes API and the etcd. That is, to start with how Kubernetes actually works with resources, and what happens when… Read More: Kubernetes: Kubernetes API, API groups, CRDs, and the etcd0 (0) »

Loading

Kubernetes: what are the Kubernetes Operator and CustomResourceDefinition
0 (0)

21 July 2025

Perhaps everyone has used operators in Kubernetes, for example, PostgreSQL operator, VictoriaMetrics Operator. But what’s going on under the hood? How and to what are CustomResourceDefinition (CRD) applied, and what is an “operator”? And finally, what is the difference between a Kubernetes Operator and a Kubernetes Controller? In the previous part – Kubernetes: Kubernetes APIs,… Read More: Kubernetes: what are the Kubernetes Operator and CustomResourceDefinition0 (0) »

Loading

TCP/IP: OSI and TCP/IP models, TCP packets, Linux sockets and ports
0 (0)

19 July 2025

It’s difficult to describe in one post what thousands of books have been written about in a thousand pages, but today we’ll try to quickly review the basics of how hosts communicate on a network. First, let’s talk about the OSI and TCP/IP models, then about packet structure and connection establishment, and finally, we’ll look… Read More: TCP/IP: OSI and TCP/IP models, TCP packets, Linux sockets and… »

Loading

VictoriaMetrics: fixing the “no matches for kind VMAnomaly” error
0 (0)

10 July 2025

It’s not the first time I’ve encountered similar errors when upgrading VictoriaMetrics, so it’s time to note a solution. So, after upgrading the victoria-metrics-k8s-stack 0.55.0 => 0.56.0, errors appeared in the Operator logs: … {“logger”:”controller-runtime.source.EventHandler”,”msg”:”if kind is a CRD, it should be installed before calling Start”,”kind”:”VMAnomaly.operator.victoriametrics.com”,”error”:”no matches for kind \”VMAnomaly\” in version \”operator.victoriametrics.com/v1\””} … {“logger”:”setup”,”msg”:”cannot… Read More: VictoriaMetrics: fixing the “no matches for kind VMAnomaly” error0 (0) »

Loading

Arch Linux: linux-firmware-nvidia: /usr/lib/firmware/nvidia/ exists in filesystem
0 (0)

9 July 2025

Even though the changes were announced in emails from Arch Linux, for some reason, many people have had problems with the latest update: in the Arch Linux subreddits on Reddit, people are complaining like “Everything is broken, what should I do now?” Let’s see how to complete the upgrade and what exactly has changed. The… Read More: Arch Linux: linux-firmware-nvidia: /usr/lib/firmware/nvidia/ exists in filesystem0 (0) »

Loading

VictoriaMetrics: migrating VMSingle and VictoriaLogs data between Kubernetes cluster
0 (0)

5 July 2025

We have VictoriaMetrics and VictoriaLogs running on an AWS Elastic Kubernetes Service cluster. We do major upgrades to EKS by creating a new cluster, and therefore we have to transfer monitoring data from the old VMSingle instance to the new one. For VictoriaMetrics, there is the vmctl tool which can migrate data through the APIs… Read More: VictoriaMetrics: migrating VMSingle and VictoriaLogs data between Kubernetes cluster0 (0) »

Loading

AI: writing an MCP server for VictoriaLogs
0 (0)

22 May 2025

In the previous article, we figured out what an MCP is in general, and created a basic MCP server that was connected to Windsurf – see AI: What is the MCP? Now, let’s try to create something more useful, for example, an MCP server that will connect to VictoriaLogs and receive some data. In fact,… Read More: AI: writing an MCP server for VictoriaLogs0 (0) »

Loading