AWS: InvalidSignatureException: Signature not yet current and Kubernetes AWS ALB Ingress controller
0 (0)

4 March 2021

One day our developers said that they can not create new AWS LoadBalancers via Ingress on our Kubernetes Dev cluster (AWS EKS). Balancers are created using AWS ALB Controller, see AWS Elastic Kubernetes Service: running ALB Ingress controller. Errors in the controller’s logs were: E0304 07:12:38.595113       1 controller.go:217] kubebuilder/controller “msg”=”Reconciler error” “error”=”no object matching key… Read More »

Loading

Jenkins: running workers in Kubernetes and Docker images build
0 (0)

27 February 2021

We have a Jenkins instance that is running jobs in Docker containers on its host. Eventually, we’ve faced with an issue when the current AWS Ec2 instance t2.2xlarge (8 CPU, 32 RAM) during peak workload periods was too overloaded – not enough CPU time, not enough memory. So, the first solution could be to proceed… Read More »

Loading

Kubernetes: NGINX/PHP-FPM graceful shutdown and 502 errors
0 (0)

25 February 2021

We have a PHP application running with Kubernetes in pods with two dedicated containers – NGINX и PHP-FPM. The problem is that during downscaling clients get 502 errors. E.g. when a pod is stopping, its containers can not correctly close existing connections. So, in this post, we will take a closer look at the pods’… Read More »

Loading

Linux: setlocale: LC_ALL: cannot change locale (en_US.utf8) and Cyrillic symbols
0 (0)

4 February 2021

Locales is a set of environment variables that are used to determine how to display data and time (for example, first of the week), symbols encoding (for example, how to display cyrillic symbols), default files order when one executing the ls command, and so on. Those variables are: LANG: Determines the default locale in the… Read More »

Loading

Linux: connect Bluetooth headset with bluetoothctl and Blueman
0 (0)

2 February 2021

Recently, I bought a Sony WH-1000XM3 headset. In general, they are great but need to connect them to my laptop with Arch Linux. The documentation about Bluetooth on Arch Linux can be found here>>> and here>>>: Installation Install necessary packages: [simterm] $ sudo pacman -S bluez bluez-utils [/simterm] Check kernel’s module: [simterm] $ lsmod |… Read More »

Loading

Logz.io: collection logs from Kubernetes – fluentd vs filebeat
0 (0)

1 February 2021

We are using Logz.io to collect our Kubernetes cluster logs (also, there is a local Loki instance). Logs are collected and processed by a Fluentd pod on every WorkerNode which are deployed from a DaemonSet in its default configuration, see the documentation here – logzio-k8s. The problem we faced is that those pods are consuming… Read More »

Loading

Prometheus: Alertmanager Web UI alerts Silence
0 (0)

26 January 2021

Active alerts sending frequency via Alertmanager is configured via the repeat_interval in the /etc/alertmanager/config.yml file. We have this interval set to 15 minutes, and as result, we have notifications about alerts in our Slack each fifteen minutes. Still, some alerts are such a “known issues”, when we already started the investigation or fixing it, but… Read More »

Loading

ArgoCD: a Helm chart deployment, and working with Helm Secrets via AWS KMS
0 (0)

22 November 2020

In the previous post ArgoCD: an overview, SSL configuration, and an application deploy we did a quick overview on how to work with the ArgoCD in general, and now let’s try to deploy a Helm chart. The most interesting part of this is how to enable the Helm Secrets. Had some pain with this, but… Read More »

Loading

ArgoCD: an overview, SSL configuration, and an application deploy
0 (0)

22 November 2020

ArgoCD helps to deliver applications to Kubernetes by using the GitOps approach, i.e. when a Git-repository is used as a source of trust, thus all manifest, configs and other data are stored in a repository. It can b used with Kubernetes manifest, kustomize, ksonnet, jsonnet, and what we are using in our project – Helm-charts.… Read More »

Loading