We continue with a series of posts about Apache Druid. In the first part, we took a look at the Apache Druid itself – its architecture and monitoring, in the second part – we ran a PostgreSQL cluster and set up its monitoring. Next tasks: switch Druid to PostgreSQL as metadata storage instead of Apache Derby… Read More »
So, we’ve launched Druid, see Apache Druid: Overview, Running in Kubernetes, and Monitoring with Prometheus . So far, a local Apache Derby database is used as the default storage for metadata . Next, we will switch Druid to PostgreSQL, and later we will remove ZooKeeper from the cluster setup. To begin with, let’s start a PostgreSQL cluster in Kubernetes,… Read More »
Apache Druid is a columnar database, focused on working with large amounts of data, combining the features and benefits of Time-Series Database, Data Warehouse, and a search engine. The general task is to set up monitoring of the Druid cluster in Kubernetes, so at first, we will see what it is in general and how… Read More »
To access a database server, that has no public access (as it must be – access only inside an AWS VPC), Tableau suggests using its tool called Tableau Bridge. The idea is to have a Bridge service running in a network, which has access to a database server via its Private IP. Also, Bridge will… Read More »
The task is to spin up a Redis instance in a Kubernetes cluster. Will use the Master-Slave replication setup with Sentinels for monitoring and failover operations. Check the Redis: replication, part 2 – Master-Slave replication, and Redis Sentinel post for more details. Redis cluster vs Redis replication See Redis: replication, part 1 – an overview.… Read More »
In the previous post – Neo4j: graph database – run with Docker and Cypher QL examples – we’ve run the Neo4j database with в Docker. The next task is to run it in the Kubernetes cluster. Will use the Neo4j Community Edition, which will be running as a single-node instance as cluster ability for the… Read More »
In contrast to the RDMS (Relational Database Management System), where data objects are the main part, in a Graph Database, the relations between such data objects are playing the main role and are represented as dedicated objects which gives better performance especially when you have a lot of small data pieces tied to each other.… Read More »
We have a Redis-cluster with Master-slave replication and Sentinel, see the Redis: replication, part 2 – Master-Slave replication, and Redis Sentinel, Redis: fork – Cannot allocate memory, Linux, virtual memory and vm.overcommit_memory, and Redis: main configuration parameters and performance tuning overview posts. The system worked great until we started using it much more actively. Redis… Read More »
Our data-analytics team eventually started to play with an AWS Redshift cluster instead of the MariaDB RDS service. Actually, the current task is to spin up a simple Proof of Concept Redshift’s cluster in the AWS. Let’s do it quickly, without details – if this will go to the Production, I’ll add another post with… Read More »
Vertica is a data warehouse solution intended to store petabytes amount of data. The task, for now, is to spin up a kind of Proof of Concept for Vertica on an AWS EC2 to take a closer look at its setup and to give it to data-analytics to play with it a bit. Vertica has… Read More »