HiveKa

How do we use HiveKa?

Write Avro byte-arrays to the Kafka topic.This can be done from your own app, or you can try our demo produce:﻿java -classpath hive-kafka-1.0-SNAPSHOT.jar org.apache.hadoop.hive.kafka.demoproducer.FakeTweetProducer tweet 10 hivekafka-1:9092Note that you'll also need Avro and Kafka libs on the classpath.The parameters are: topic-name, number of messages to producer and the Kafka broker URI.

Interactive Testing

We also packaged a utility that converts data from standard input to Avro messages, so they can be queried in Hive.

To use this:

java -classpath hive-kafka-1.0-SNAPSHOT.jar org.apache.hadoop.hive.kafka.demoproducer.AvroConsoleProducer console hivekafka-1:9092Note that you'll also need Avro and Kafka libs on the classpath.The parameters are: topic-name, number of messages to producer and the Kafka broker URI.