HDFS

Back to BigData Once the data is in the BigData platform, we process it and transform it for getting useful information out of that data. Once the raw data is transform, we can use it for various purposes like reporting, recommendations, analysis, fraud detection, etc To transform the data, there […]

Back to BigData Once the data is collected using options mentioned in “BigData-Collecting Data” post, we may want to save it for further processing. It is not necessary that you alway want to persist this data. Sometimes you can directly process this data and transform it and then you may […]

Back to BigData Getting data into the BigData system depends on the source from where you want to collect the data. There are various options available as of today. First we will see the various sources from where data can be collected. Data collected by different sensors Log files generated […]

Back to BigData Here are the high level stages in architecting the big data projects. This is a template. You can refer it as a guideline but this is not a rule. Based on your project requirement you may or may not need some stages, which is possible. To come […]