Elasticsearch-Curator

This directory contains a Kubernetes chart to deploy the Elasticsearch Curator.

What is Curator?

ElasticCurator is a tool from Elastic (the company behind Elasticsearch) to help manage your Elasticsearch cluster. One of Postmark’s main usages for Elasticsearch is for storing the emails that you have sent and received. We use one Elasticsearch index per day and keep a rolling 45 day window of history. This means that every day we need to create, backup, and delete some indices. Curator helps make this process automated and repeatable.

Curator is written in Python, so it is well supported almost all operating systems. Installation is a breeze with a pip install elasticsearch-curator. That provides you with the curator command that you can use. There’s also a Python API that you can access from your Python programs, but we only use the command line interface.

Elasticsearch Curator helps you curate, or manage, your Elasticsearch indices and snapshots by:

• Obtaining the full list of indices (or snapshots) from the cluster, as the actionable list
• Iterate through a list of user-defined filters to progressively remove indices (or snapshots) from this actionable list as needed.
• Perform various actions on the items which remain on the actionable list.

Features

Curator allows for many different operations to be performed to both indices and snapshots, including:

• Add or remove indices (or both!) from an alias
• Change shard routing allocation
• Close indices
• Create index
• Delete indices
• Delete snapshots
• Open closed indices
• forceMerge indices
• reindex indices, including from remote clusters
• Change the number of replicas per shard for indices
• rollover indices
• Take a snapshot (backup) of indices
• Restore snapshots