Configuring LizardFS

LizardFS is an easy option to configure shared storage which can be used by queues for persisting state. It can be configured on windows and linux machines.

Overview

Below is example with simple LizardFS configuration which includes:

  • one master server - it's responsible for storing information where chunks are located
  • one shadows master server - it's slave for master available to be promoted to master when original one is down
  • two chunks servers - they are storing file's chunks

Figure 1. LizardFS configuration.

Configuration

Cluster configuration is described on LizardFS website (here). If you want to configure above example just got to quick start. Then go through steps for installing master, shadow and chunk server. When you are ready you can mount your shared drive for example to /mnt/queue. You also need to install client on servers where JLupin Platform is running and you want to use queues.

For more advanced configuration please refer to LizardFS docs.

Setting storage for queue

Assuming that you had mounted your shared storage to /mnt/queue you should update your queue storage configuration file (storage.yml). Updated absoluteRootPath parameters to point to /mnt/queue:

STORAGE:
  absoluteRootPath: '/mnt/queue'
  [...]