Category Archives: Scripting/coding

LiteLLM: Custom Callbacks and LLM Evaluations with Judge LLM
0 (0)

11 September 2026

A quick recap of what we are doing on the project right now: we have a separate hardware server (hostname == “Matrix”), where we run our own self-hosted models with llama.cpp. In our Kubernetes cluster we have a LiteLLM AI Gateway for our clients – Backend API and other project services. Clients send their OpenAI/Anthropic/OpenRouter… Read More: LiteLLM: Custom Callbacks and LLM Evaluations with Judge LLM0 (0) »

Loading

LiteLLM: Custom Callback for Traffic Mirroring and OTel Tracing to VictoriaTraces
0 (0)

9 September 2026

We’re currently setting up our own hardware server where we want to run self-hosted models. But we can’t just switch client traffic to them right away – first we need to see how these self-hosted LLMs will actually perform. So the general idea for now is to keep sending traffic to the primary provider, OpenAI… Read More: LiteLLM: Custom Callback for Traffic Mirroring and OTel Tracing to… »

Loading

LiteLLM: Traffic Mirroring, Batch Completions, and Traffic to Two Providers
0 (0)

21 August 2026

We’re getting ready to launch a self-hosted LLM, and at the testing stage the general idea is to send client requests simultaneously both to the “default production model” like GPT-5.6 and to the model running on our own server. And after getting the responses, we’ll compare them with Phoenix or Opik, and gradually tune our… Read More: LiteLLM: Traffic Mirroring, Batch Completions, and Traffic to Two Providers0… »

Loading

VictoriaMetrics: Basic Monitoring for AWS, Linux, NGINX, and PHP
5 (1)

28 March 2026

The RTFM migration from DigitalOcean to AWS went smoothly, and I’m gradually settling in. New infrastructure, everything new – so for the first while I want to keep a close eye on the server and blog state, which means setting up basic monitoring for WordPress: NGINX, PHP-FPM, the database, and the infrastructure running it all.… Read More: VictoriaMetrics: Basic Monitoring for AWS, Linux, NGINX, and PHP5 (1) »

Loading

AWS: Basic Infrastructure Setup for WordPress
0 (0)

15 March 2026

It’s time for a major server upgrade for RTFM, which I usually do by migrating to a new server – because I also do various other upgrades along the way, like upgrading the PHP version or even migrating to a different cloud. This time I’m planning to move from DigitalOcean, where RTFM has been hosted… Read More: AWS: Basic Infrastructure Setup for WordPress0 (0) »

Loading

FreeBSD: Home NAS, Part 15: Automating Backups – scripts, rsync, rclone
0 (0)

15 March 2026

This is essentially the last major task – setting up automated backup creation. In the post FreeBSD: Home NAS, Part 13: Planning Data Storage and Backups I described the general idea in more detail – what gets backed up, where, what gets stored and how – and today is the purely technical part about the actual… Read More: FreeBSD: Home NAS, Part 15: Automating Backups – scripts, rsync,… »

Loading

Glance: setting up a self-hosted home page for your browser
0 (0)

13 March 2026

There’s this cool thing called self-hosted home pages. I saw them somewhere on Reddit a while back, saved them to bookmarks, and now that I have all this self-hosted stuff with NAS (see FreeBSD: Home NAS, part 1), Grafana, and other useful things for work and daily life – I thought it would be nice… Read More: Glance: setting up a self-hosted home page for your browser0… »

Loading

FreeBSD: Home NAS, part 11 – extended monitoring with additional exporters
0 (0)

10 February 2026

In the previous post FreeBSD: Home NAS, part 10 – monitoring with VictoriaMetrics and Grafana, we configured VictoriaMetrics, node_exporter, Grafana and created a basic dashboard and basic alerts. Now, I want to add a bit more monitoring – to see process CPU/RAM data, SMART information, and ZFS details. Everything written here has been added to… Read More: FreeBSD: Home NAS, part 11 – extended monitoring with additional… »

Loading

Golang: writing an AWS Load Balancer logs collector for VictoriaLogs
5 (1)

6 December 2025

The next task I want to do with Golang is building a custom log collector that retrieves AWS Application Load Balancer logs from S3 and sends them to VictoriaLogs. Sure, we could simply use Vector.dev, like what I did for AWS VPC Flow Logs (see: Vector.dev introduction, logs from AWS S3, and VictoriaLogs integration). But… Read More: Golang: writing an AWS Load Balancer logs collector for VictoriaLogs5… »

Loading

Golang: interfaces – the “magic” of calling methods through interface
0 (0)

29 November 2025

Interfaces in Go allow you to describe access to data or behavior without providing concrete implementations inside the interface itself. In this way, we create a “common bus” that we can then use to “connect” external “systems.” In other words, an interface is an abstraction that defines a contract. The contract describes what can be… Read More: Golang: interfaces – the “magic” of calling methods through interface0… »

Loading