Configuring Flume Solr Sink to Sip from the Twitter Firehose

Edit /etc/flume-ng/conf/flume.conf or /opt/cloudera/parcels/CDH/etc/flume-ng/conf/flume.conf and replace the following
properties with credentials from a valid Twitter account. The Flume TwitterSource uses the Twitter 1.1 API, which requires authentication of both the consumer (application) and the user (you).

Select My applications from the drop-down menu in the top-right corner, and Create a new application.

Fill in the form to represent the Search installation. This can represent multiple clusters, and does not require the callback URL. Because this is not a publicly distributed
application, the values you enter for the required name, description, and website fields are not important.

Click Create my access token at the bottom of the page. You may have to refresh the page to see the access token.

To enable authentication, ensure the system clock is set correctly on all hosts where Flume connects to Twitter. You can install NTP and keep the host synchronized by running the
ntpd service, or manually synchronize using the command sudo ntpdate pool.ntp.org . To confirm that the time is set correctly, make
sure that the output of the command date --utc matches the time shown at http://www.timeanddate.com/worldclock/timezone/utc. You can also set the time manually using the date command.

If this documentation includes code, including but not limited to, code examples, Cloudera makes this available to you under the terms of the Apache License, Version 2.0, including any required
notices. A copy of the Apache License Version 2.0 can be found here.