Upgrade InfluxDB Enterprise clusters

To successfully upgrade InfluxDB Enterprise clusters to 1.8.3, complete the following steps:

1. Back up your cluster.
2. Upgrade meta nodes.
3. Upgrade data nodes.

Note: To downgrade to an earlier version, complete the following procedures, replacing the version numbers with the version that you want to downgrade to.

Back up your cluster

Before performing an upgrade, create a full backup of your InfluxDB Enterprise cluster. Also, if you create incremental backups, trigger a final incremental backup.

Note: For information on performing a final incremental backup or a full backup, see Back up and restore InfluxDB Enterprise clusters.

Upgrade meta nodes

Complete the following steps to upgrade meta nodes:

1. Download the meta node package.
2. Install the meta node package.
3. Update the meta node configuration file.
4. Restart the influxdb-meta service.
5. Repeat steps 1-4 for each meta node in your cluster.
6. Confirm the meta nodes upgrade.

Download the meta node package

Ubuntu and Debian (64-bit)

wget https://dl.influxdata.com/enterprise/releases/influxdb-meta_1.8.3-c1.8.3_amd64.deb

RedHat and CentOS (64-bit)

wget https://dl.influxdata.com/enterprise/releases/influxdb-meta-1.8.3_c1.8.3.x86_64.rpm

Install the meta node package

Ubuntu and Debian (64-bit)

sudo dpkg -i influxdb-meta_1.8.3-c1.8.3_amd64.deb

RedHat and CentOS (64-bit)

sudo yum localinstall influxdb-meta-1.8.3_c1.8.3.x86_64.rpm

Update the meta node configuration file

Migrate any custom settings from your previous meta node configuration file.

To enable HTTPS, you must update the meta node configuration file (influxdb-meta.conf). For information, see Enable HTTPS within the configuration file for each Meta Node.

Restart the influxdb-meta service

sysvinit systems

service influxdb-meta restart

systemd systems

sudo systemctl restart influxdb-meta

Confirm the meta nodes upgrade

After upgrading all meta nodes, check your node version numbers using the influxd-ctl show command. The influxd-ctl utility is available on all meta nodes.

~# influxd-ctl show

Data Nodes
==========
ID	TCP Address		Version
4	rk-upgrading-01:8088	1.8.x_c1.8.y
5	rk-upgrading-02:8088	1.8.x_c1.8.y
6	rk-upgrading-03:8088	1.8.x_c1.8.y

Meta Nodes
==========
TCP Address		Version
rk-upgrading-01:8091	1.8.3_c1.8.3   # 1.8.3_c1.8.3 = 👍
rk-upgrading-02:8091	1.8.3_c1.8.3
rk-upgrading-03:8091	1.8.3_c1.8.3

Ensure that the meta cluster is healthy before upgrading the data nodes.

Upgrade data nodes

Complete the following steps to upgrade data nodes:

1. Download the data node package.
2. Stop traffic to data nodes.
3. Install the data node package.
4. Update the data node configuration file.
5. For Time Series Index (TSI) only. Rebuild TSI indexes.
6. Restart the influxdb service.
7. Restart traffic to data nodes.
8. Repeat steps 1-7 for each data node in your cluster.
9. Confirm the data nodes upgrade.

Download the data node package

Ubuntu and Debian (64-bit)

wget https://dl.influxdata.com/enterprise/releases/influxdb-data_1.8.3-c1.8.3_amd64.deb

RedHat and CentOS (64-bit)

wget https://dl.influxdata.com/enterprise/releases/influxdb-data-1.8.3_c1.8.3.x86_64.rpm

Stop traffic to the data node

• If you have access to the load balancer configuration, use your load balancer to stop routing read and write requests to the data node server (port 8086).

• If you cannot access the load balancer configuration, work with your networking team to prevent traffic to the data node server before continuing to upgrade.

Install the data node package

When you run the install command, you’re prompted to keep or overwrite your current configuration file with the file for version 1.8.3. Enter N or O to keep your current configuration file. You’ll make the configuration changes for version 1.8.3. in the next procedure, Update the data node configuration file.

Ubuntu and Debian (64-bit)

sudo dpkg -i influxdb-data_1.8.3-c1.8.3_amd64.deb

RedHat & CentOS (64-bit)

sudo yum localinstall influxdb-data-1.8.3_c1.8.3.x86_64.rpm

Update the data node configuration file

Migrate any custom settings from your previous data node configuration file.

• To enable HTTPS, see Enable HTTPS within the configuration file for each Data Node.

• To enable TSI, open /etc/influxdb/influxdb.conf, and then adjust and save the settings shown in the following table.

  Section	Setting
  [data]	To use Time Series Index (TSI) disk-based indexing, add index-version = "tsi1" To use TSM in-memory index, add index-version = "inmem" Add wal-fsync-delay = "0s" Add max-concurrent-compactions = 0 Setcache-max-memory-size to 1073741824
  [cluster]	Add pool-max-idle-streams = 100 Addpool-max-idle-time = "1m0s" Remove max-remote-write-connections
  [anti-entropy]	Add enabled = true Add check-interval = "30s" Add max-fetch = 10
  [admin]	Remove entire section.

  For more information about TSI, see TSI overview and TSI details.

Rebuild TSI indexes

Complete the following steps for Time Series Index (TSI) only.

1. Delete all _series directories in the /data directory (by default, stored at /data/<dbName>/_series).

2. Delete all TSM-based shard index directories (by default, located at /data/<dbName/<rpName>/<shardID>/index).

3. Use the influx_inspect buildtsi utility to rebuild the TSI index. For example, run the following command:

   influx_inspect buildtsi -datadir /yourDataDirectory -waldir /wal
   

   Replacing yourDataDirectory with the name of your directory. Running this command converts TSM-based shards to TSI shards or rebuilds existing TSI shards.

   Note: Run the buildtsi command using the same system user that runs the influxd service, or a user with the same permissions.

Restart the influxdb service

Restart the influxdb service to restart the data nodes.

sysvinit systems

service influxdb restart

systemd systems

sudo systemctl restart influxdb

Restart traffic to data nodes

Restart routing read and write requests to the data node server (port 8086) through your load balancer.

Note: Allow the hinted handoff queue (HHQ) to write all missed data to the updated node before upgrading the next data node. Once all data has been written, the disk space used in the hinted handoff queue should be 0. Check the disk space on your hh directory by running the [du] command, for example, du /var/lib/influxdb/hh.

Confirm the data nodes upgrade

After upgrading all data nodes, check your node version numbers using the influxd-ctl show command. The influxd-ctl utility is available on all meta nodes.

~# influxd-ctl show

Data Nodes
==========
ID	TCP Address		Version
4	rk-upgrading-01:8088	1.8.3_c1.8.3   # 1.8.3_c1.8.3 = 👍
5	rk-upgrading-02:8088	1.8.3_c1.8.3
6	rk-upgrading-03:8088	1.8.3_c1.8.3

Meta Nodes
==========
TCP Address		Version
rk-upgrading-01:8091	1.8.3_c1.8.3
rk-upgrading-02:8091	1.8.3_c1.8.3
rk-upgrading-03:8091	1.8.3_c1.8.3

If you have any issues upgrading your cluster, contact InfluxData support.