NAME

es-daily-index-maintenance.pl - Run to prune old indexes and optimize existing

VERSION

version 4.7

SYNOPSIS

es-daily-index-maintenance.pl --all --local

Options:

--help              print help
--manual            print full manual
--all               Run close, delete, optimize, and replicas tools
--bloom             Disable bloom filters for all indexes older than 1 day
--close             Run close for indexes older than
--close-days        Age of the oldest index to keep open (default:60)
--delete            Run delete indexes older than
--delete-days       Age of oldest index to keep (default: 90)
--optimize          Run optimize on indexes
--optimize-days     Age of first index to optimize (default: 1)
--replicas          Run the replic aging hook
--replicas-age      Age of the index to reach the minimum replicas (default:60)
--replicas-min      Minimum number of replicas this index may have (default:0)
--replicas-max      Maximum number of replicas this index may have (default:100)

From App::ElasticSearch::Utilities:

--local         Use localhost as the elasticsearch host
--host          ElasticSearch host to connect to
--port          HTTP port for your cluster
--noop          Any operations other than GET are disabled, can be negated with --no-noop
--timeout       Timeout to ElasticSearch, default 30
--keep-proxy    Do not remove any proxy settings from %ENV
--index         Index to run commands against
--base          For daily indexes, reference only those starting with "logstash"
                 (same as --pattern logstash-* or logstash-DATE)
--datesep       Date separator, default '.' also (--date-separator)
--pattern       Use a pattern to operate on the indexes
--days          If using a pattern or base, how many days back to go, default: all

From CLI::Helpers:

--data-file         Path to a file to write lines tagged with 'data => 1'
--color             Boolean, enable/disable color, default use git settings
--verbose           Incremental, increase verbosity (Alias is -v)
--debug             Show developer output
--debug-class       Show debug messages originating from a specific package, default: main
--quiet             Show no output (for cron)
--syslog            Generate messages to syslog as well
--syslog-facility   Default "local0"
--syslog-tag        The program name, default is the script name
--syslog-debug      Enable debug messages to syslog if in use, default false

DESCRIPTION

This script assists in maintaining the indexes for logging clusters through routine deletion and optimization of indexes.

Use with cron:

22 4 * * * es-daily-index-maintenance.pl --local --all --delete-days=180 --replicas-age=90 --replicas-min=1

OPTIONS

bloom

This will disable the bloom filters on all indexes older than 1 day unless the bloom filter setting "index.codec.bloom.load" has been explicitly set for this index.

close

Run the close hook

close-days

Integer, close indexes older than this number of days

delete

Run the delete hook

delete-days

Integer, delete indexes older than this number of days

optimize

Run the optimization hook

optimize-days

Integer, optimize indexes older than this number of days

replicas

Run the replicas hook.

replicas-age

The age at which we reach --replicas-min, default 60

replicas-min

The minimum number of replicas to allow replica aging to set. The default is 0

--replicas-min=1

replicas-max

The maximum number of replicas to allow replica aging to set. The default is 100

--replicas-max=2

AUTHOR

Brad Lhotsky <brad@divisionbyzero.net>

COPYRIGHT AND LICENSE

This software is Copyright (c) 2012 by Brad Lhotsky.

This is free software, licensed under:

The (three-clause) BSD License