Elasticsearch
Server Configuration
Edit /etc/elasticsearch/elasticsearch.yml to listen to the outside address
network.host: <outside IP address>
For automatic start/stop I created /etc/init.d/elasticsearch like
#!/bin/sh
# kFreeBSD do not accept scripts as interpreters, using #!/bin/sh and sourcing.
if [ true != "$INIT_D_SCRIPT_SOURCED" ] ; then
set "$0" "$@"; INIT_D_SCRIPT_SOURCED=true . /lib/init/init-d-script
fi
### BEGIN INIT INFO
# Provides: elasticsearch
# Required-Start: $remote_fs $syslog
# Required-Stop: $remote_fs $syslog
# Default-Start: 2 3 4 5
# Default-Stop: 0 1 6
# Short-Description: Start ElastichSearch deamon
# Description: Start ElastichSearch deamon
# This script starts a
# single forking daemon capable of writing a pid
# file.
### END INIT INFO
# Author: Hans de Ridder <hans@deridder.it>
#
if [ `id -nu` != 'elasticsearch' ]
then
su elasticsearch $0 $*
exit
fi
DESC="ElasticSearch engine"
DAEMON="/opt/elasticsearch/bin/elasticsearch"
DAEMON_ARGS="-d"
Now you can start by service elasticsearch start. Stopping is not implemented in this script.
In /etc/rc5.d do ln -s ../init.d/elasticsearch S02elasticsearch
Troubleshooting
- curl http://localhost:9200/_aliases?pretty=true
- List the indexes in elasticsearch
- curl -XDELETE http://localhost:9200/<indexname>*/
- Remove all indexes where name starts with <indexname>
Some endpoints on http://<server>:9200
- /
- Version information
- /_aliases
- All available indices
- /<indexname>
Problem
I needed a newer version of Elasticsearch [1] after an upgrade to mediawiki 1.43 and bluntly followed the instructions for that. It appeared I upgraded the software from version 6.8. to 8.17 and that is not supported. Consequently it refused to start. In the logs it report:
Caused by: org.elasticsearch.gateway.CorruptStateException: Format version is not supported. Upgrading to \[8.17.1\] is only supported from version \[7.17.0\].
Results from duckduckgo[2] told me downgrading is not possible. That may be true from a running version, mine has never run on v8, I managed to downgrade to v7 like this.
Configure apt to have the 7.x repository
cd /etc/apt/sources.list.d echo deb [signed-by=/usr/share/keyrings/elasticsearch-keyring.gpg] https://artifacts.elastic.co/packages/7.x/apt stable main > elastic-7.x.list apt install elasticsearch=7.10.2
This puts the software back, starting is not possible due to configuration issues. Restore /etc/elasticsearch from a backup.
Still no luck the logfile has:
[ERROR][o.e.b.Bootstrap ] [elast] node validation exception [1] bootstrap checks failed. You must address the points described in the following [1] lines before starting Elasticsearch. bootstrap check failure [1] of [1]: the default discovery settings are unsuitable for production use; at least one of [discovery.seed_hosts, discovery.seed_providers, cluster.initial_master_nodes] must be configured
In /etc/elasticsearch/elasticsearch.yml I added
cluster.initial_master_nodes: ["IP of my node"]
Note that I run a single elasticsearch server only I guess this would work for other configuration too but did not test that
Now it starts.
Make sure to have the v8 repository in /etc/apt/sources.list.d and an upgrade to that is possible:
apt update apt full-upgrade
Unfortunately now it again does not start as:
java.lang.IllegalStateException: Cannot start this node because it holds metadata for indices with version [6.8.23] with which this node of version [8.17.1] is incompatible. Revert this node to version [7.17.27] and delete any indices with versions earlier than [7.0.0] before upgrading to version [8.17.1]. If all such indices have already been deleted, revert this node to version [7.17.27] and wait for it to join the cluster to clean up any older indices from its metadata.
As mediawiki Cirrussearch[3] is working I decided to stay on v7 for now.
Preventing it
- Tell apt not upgrade elasticsearch
- apt-mark hold elasticsearch
- Install a specific version
- apt install elasticsearch=7.10.2
Fixing it
Trying to clear the entire database for a fresh start after the upgrade to version 8
- Remove everytrhing under /var/lib/elasticsearch
- In /etc/elasticsearch/elasticsearch.yml add
_aliases?pretty=true
Now elasticsearch start with a number of error messages, the search continues.