Tag Archives: monitoring

Prometheus: Building a Custom Prometheus Exporter in Python
0 (0)

25 February 2023

Prometheus has many ready-to-use exporters, but sometimes you may need to collect your own metrics. For this, Prometheus provides client libraries that we can use to generate metrics with the necessary labels. Such an exporter can be included directly in the code of your application, or it can be run as a separate service that will poll one… Read More: Prometheus: Building a Custom Prometheus Exporter in Python0 (0) »

Loading

Kubernetes: Cluster Cost Monitoring – Kubernetes Resource Report and Kubecost
0 (0)

29 January 2023

The very useful thing is to monitor how efficiently the cluster is being used, especially if applications are deployed by developers who do not delve into requests much and set inflated values ​​”in reserve”. A reserve, of course, is needed – but simply requesting resources is a bad idea. For example, you have a WorkerNode… Read More: Kubernetes: Cluster Cost Monitoring – Kubernetes Resource Report and Kubecost0… »

Loading

Elastic Stack: an overview and ELK installation on Ubuntu 20.04
0 (0)

22 February 2022

The last time I’ve worked with the ELK stack about 7 years ago, see the ELK: установка Elasticsearch+Logstash+Kibana на CentOS. Currently, we are using Logz.io, but its costs going higher and higher, so we started looking at the self-hosted ELK solution to be running on our AWS Elastic Kubernetes Service clusters. So, the task, for… Read More: Elastic Stack: an overview and ELK installation on Ubuntu 20.040… »

Loading

AWS: Trusted Advisor, part 2 – CloudWatch Alarms and Slack notifications
0 (0)

29 November 2021

Continuing with the theme of the AWS Trusted Advisor service, let’s see how can we configure notifications about new findings. The first part: AWS: Trusted Advisor, part 1 – its features overview. To have notifications, we can use Trusted Advisor metrics from the CloudWatch, see their list on the Trusted Advisor metrics and dimensions page.… Read More: AWS: Trusted Advisor, part 2 – CloudWatch Alarms and Slack… »

Loading

AWS: WAF WebACL logging and Logz.io integration
0 (0)

22 July 2021

In the first post – AWS: Web Application Firewall overview, configuration, and its monitoring – we spoke about its main components, created a WebACL and Rules for it, and did basic monitoring. Also, we’ve configured WebACL’s logs collection with AWS Kinesis, but now it’s time to see them Logz.io, as CloudWatch Logs isn’t available for… Read More: AWS: WAF WebACL logging and Logz.io integration0 (0) »

Loading

AWS: CloudTrail overview and integration with CloudWatch and Opsgenie
0 (0)

15 July 2021

AWS CloudTrail is a service for auditing AWS accounts events and is enabled by default. It saves all actions that were done by a user, IAM role, or an AWS service via AWS Console, AWS CLI, or AWS SDK. CloudTrail will write information about every API call, log in to the system, services events, and… Read More: AWS: CloudTrail overview and integration with CloudWatch and Opsgenie0 (0) »

Loading

AWS: Simple Email Service Bounce rate and monitoring with and Prometheus
0 (0)

14 July 2021

Recently, AWS blocked our AWS Simple Email Service because of its low bounce rate. This can be checked in the AWS SES > Reputation Dashboard, our account currently has Under review status: After we’ve connected AWS Tech Support, they enabled it back, but we must solve the issue asap, and have to monitor AWS SES… Read More: AWS: Simple Email Service Bounce rate and monitoring with and… »

Loading

Opsgenie: integration with AWS RDS and alerting
0 (0)

18 March 2021

Let’s configure Opsgenie with AWS RDS. The idea is to get notifications from RDS about events and send them to Opsgenie which will send them to our Slack. To do so, we need to configure AWS Simple Notification Service and AWS RDS Event subscriptions. The official documentation is here>>>. Opsgenie confiuration Go to the Integrations… Read More: Opsgenie: integration with AWS RDS and alerting0 (0) »

Loading

Yandex.Tank: load testing tool – an overview, configuration, and examples
0 (0)

10 February 2021

Besides the Apache Bench and JMeter there is another utility – Yandex Tank. It’s used by our QA team and now it’s time for me to take a closer look on it to test one issue with our application running on a Kubernetes cluster. In this post a short overview of its capabilities and configuration.… Read More: Yandex.Tank: load testing tool – an overview, configuration, and examples0… »

Loading

Logz.io: collection logs from Kubernetes – fluentd vs filebeat
0 (0)

1 February 2021

We are using Logz.io to collect our Kubernetes cluster logs (also, there is a local Loki instance). Logs are collected and processed by a Fluentd pod on every WorkerNode which are deployed from a DaemonSet in its default configuration, see the documentation here – logzio-k8s. The problem we faced is that those pods are consuming… Read More: Logz.io: collection logs from Kubernetes – fluentd vs filebeat0 (0) »

Loading