Where the compass is spinning around software
Storage for your cluster

Development Kubernetes Docker Storage

I’ve been working on getting Elasticsearch working on Kubernetes-On-ARM. The biggest problem has been storage. I’m using Elasticserach for storing logs and the cluster generates 1.4 million entries per day (i know, need to do something about it).

Hits during 24 hours
If you want to deploy your applications to Kubernetes, sooner or later you need to think about how to solve storage and persistence.

12 May 2016 #Development #Docker #Kubernetes #Raspberry PI #ARM #NFS #glusterFS #iscsi

E(F)K cluster on Kubernetes-On-ARM - Part 2

Development Kubernetes Docker ARM Raspberry PI

This is the second part in a series about handling logs on Kubernetes-On-ARM. In the first part we installed ELK and started sending syslog events from our nodes using logstash-forwarder. In this part we will start collecting logs from our pods and Kubernetes components. If you wan’t to cache up here’s a list of previous posts:

The plan was that this part would be about how to start collecting logs from Kubernetes. But I wasn’t satisfied with how logstash-forwarder worked. The thing is that, once the logstash-forwarder daemon is started, the node can’t run much else.

2 May 2016 #Development #Docker #Kubernetes #Raspberry PI #Elasticsearch #Fluentd #Logstash #Kibana #ARM #Logging

ELK cluster on Kubernetes-On-ARM - Part 1

Development Kubernetes Docker ARM Raspberry PI

One of the most important parts of running a cluster is to gain knowledge of whats going on. Using tools like kubectl logs or docker logs is fine if you run one or two nodes, but it soon gets impossible to get an overview of whats going on, and you need to be able to view, query and monitor your logs from one central place.

13 Mar 2016 #Development #Docker #Kubernetes #Raspberry PI #Elasticsearch #Logstash #Kibana #ARM