Kafka

Today, we have variety of data sources like social media, sensors, databases, data warehouse, file systems, logs, web/app servers. Data generated from this sources are much required for processing, dashboards, predictions or for later use. We have so many data ingestion tools to achieve this. In this post, let see Read more…

Hi Guys, Most of us are familiar with logstash. We use it to transfer data to multiple destinations. But how to transfer it to HDFS without using webHDFS ? Here is the solution!!!!!!! The following diagram explains the solution Kafka A highly reliable message broker which is often used for Read more…