DSE Search allows you to quickly find data and provide a modern search experience for your users, helping you create features like product catalogs, document repositories, ad-hoc reporting engines, and more.

Documentation for configuring and using configurable distributed data replication.

Running the Weather Sensor demo

The Weather Sensor demo compares how long it takes to run Spark SQL queries against
aggregated data for a number of weather sensors in various cities.

Using the Weather Sensor demo, you can compare how long it takes to run Spark SQL queries
against aggregated data for a number of weather sensors in various cities. For example, you
can view reports using different metrics, such as temperature or humidity, and get a daily
roll up.

You run customize Spark SQL queries using different metrics and different
dates. In addition to querying CQL tables, you time Spark SQL queries against data in DataStax
Enterprise File System (DSEFS).

Note: DataStax Demos do not work with LDAP or internal authorization
(username/password) enabled.

Prerequisites

Before running the demo, install the following source code and tools if you do not already
have them:

Python 2.7:

Debian and Ubuntu

sudo apt-get install python2.7-dev

RedHat or CentOS

sudo yum install python27

Mac OS X already has Python 2.7 installed.

pip installer tool:

Debian and Ubuntu

sudo apt-get install python-pip

RedHat or CentOS

sudo yum install python-pip

Mac OS X

sudo easy_install pip

The libsasl2-dev package:

Debian and Ubuntu

sudo apt-get install libsasl2-dev

RedHat or CentOS

sudo yum install cyrus-sasl-lib

The required Python packages:

All platforms

sudo pip install pyhs2 six flask cassandra-driver

If you installed DataStax Enterprise using a tarball, set the PATH
environment variable to the DataStax Enterprise installation /bin
directory.

export PATH=$PATH:installation_location/bin

Start DataStax Enterprise and import data

You start
DataStax Enterprise in Spark mode, and then run a script that creates the schema for weather
sensor data model. The script also imports aggregated data from CSV files into DSE tables. The
script uses the hadoop fs command to put the CSV files into the DSEFS.