Install Additional Stage Libraries

Install additional stage libraries to use stages that are not included in the core RPM or
core tarball installation of Data Collector.
This is an optional step, but generally you'll want to install additional stage
libraries to process data after completing a core installation.

Important: You must perform additional steps to install the MapR stage
libraries, as described in MapR Prerequisites.

You can install additional RPM stage libraries using the Data Collector
command line program.

You can install additional tarball stage libraries using the Package Manager within Data Collector or
using the Data Collector
command line program.

Note: An installation with Cloudera Manager includes all available stage libraries. As a
result, you cannot use the Package Manager or the command line program to install or
uninstall additional stage libraries in a Cloudera Manager installation.

When necessary, you can also install legacy stage libraries for all installation
types.

Installing for RPM

Use the following commands to install additional stage
libraries for a core RPM installation:

To install one or more stage libraries:

Use the following command to install the stage libraries downloaded to the
current directory:

Use the full name of the libraries that you want to uninstall, separating them
with commas. Do not include spaces in the command.

For example, to uninstall the Amazon S3 origin and destination, use the
following
command:

yum remove streamsets-datacollector-aws-lib

Installing for Tarball Using the Package Manager

You can use the Package Manager
within Data Collector to
install additional stage libraries for a core tarball installation.

Complete one of the following steps to display the Package Manager:

Click the Package Manager icon .

Click Add/Remove Stages in the Stage Library panel when
viewing a pipeline in the pipeline canvas.

The Package Manager lists all available stage libraries, displaying a check mark next to
each installed library. You can filter the stage libraries by type or you can search for
a stage library in the list.

For example, the following image displays three installed stage libraries:

To install an additional stage library, click the More icon for
the library, and then click Install. Or to install multiple stage
libraries, select the libraries in the list and then click the
Install icon . Confirm that you want to install the libraries,
and then restart Data Collector
for the changes to take effect.

To uninstall a stage library, click the More icon for the library,
and then click Uninstall. Or to uninstall multiple stage
libraries, select the libraries in the list and then click the
Uninstall icon . Confirm
that you want to uninstall the libraries, and then restart Data Collector
for the changes to take effect.

Note: If Data Collector does not have internet connectivity, you can view the installed stage libraries
and can uninstall a stage library. However, you cannot view all stage libraries or
install an additional stage library.

Includes the RabbitMQ Consumer
origin and RabbitMQ Producer destination.

streamsets-datacollector-redis-lib

For Redis versions 2.8 and 3.0.

Includes:

Redis Consumer origin

Redis Lookup processor

Redis destination

streamsets-datacollector-salesforce-lib

For Salesforce.

Includes:

Salesforce origin

Salesforce Lookup processor

Salesforce destination

Einstein Analytics destination

streamsets-datacollector-stats-lib

Installs automatically with the core installation.

StreamSets Control Hub requires that the statistics stage library be installed on
each registered Data Collector.

streamsets-datacollector-vault-credentialstore-lib

For the Hashicorp Vault credential store system.

streamsets-datacollector-windows-lib

Installs automatically with the core installation.

For
Windows. Includes the Windows Event Log origin.

Legacy Stage Libraries

Legacy stage libraries
are older stage libraries that have been removed from Data Collector.
Though we strongly advise using the stage libraries provided with Data Collector,
and upgrading related systems, you can continue to use these legacy libraries when
necessary.