This page describes the installation and configuration procedures for Kaa flume agents on a single Linux node. It does not cover installation and configuration of third party systems, though. Flume agents provide advanced logging capabilities in case of integration with Hadoop as described in Flume log appender.

System OS versions

Kaa supports the following operation system families and provides an installation package for each of them.

Ubuntu and other Debian systems

Red Hat/CentOS/Oracle 5 or Red Hat 6 systems

System requirements

To use Kaa flume agents, your system should meet the following minimum system requirements.

64-bit OS

4 Gb RAM

Third party components

Kaa flume agents require the following third party components to be installed and configured.

{application token} - the application token for logs collection. It can be obtained from Kaa admin web UI.

{log schema version} - the version of the log schema within the application. It can be obtained from Kaa admin web UI.

File schema_v{log schema version} should contain an avro log schema for the specified version in the text format.

Now that you have installed and configured the Kaa flume agents, you are ready to start them.

Start Kaa flume agents

To start the Kaa flume source, enter the following command in the shell.

sudo service kaa-flume-source-{source instance name} start

To start the Kaa flume sink, enter the following command in the shell.

sudo service kaa-flume-sink start

Validate/troubleshoot Kaa flume agents

To validate the installation of Kaa flume agents, see the logs located at /var/log/flume-ng/. If the agents were installed and configured correctly, the logs should not contain any exceptions or errors.