java

Pellucid tutorial using java modules, REPL(READ EVALUATE Print Loop) jshell and how to launch jshell inline command from shell Jdk-9 is one of the major shift for java developers, it has so many powerful tools and jshell is one of them. Jshell shall be used to run small commands, utilities,…

Spark processing multiline csv EOLs in text column The multi line support for CSV will be added in spark version 2.2 JIRA and for now you can try below steps if you are facing issue while processing CSV: Get InputFormat and reader classes from git to your code base and…

Spark Socket streaming example windows: Windows OS doesn’t provide any netcat utility and if you are trying to test your spark streaming socket program in windows then either you download external netcat utility or create socket program equivalent to netcat. The spark streaming socket word count example is implemented using…

Tips to prepare Mapr Spark Certification- Yes finally I did it 🙂 After couple of months preparation I am finally Mapr certified spark developer. I wrote the exam on Nov 2016. Spark certification is sponsored by many organizations DataBricks, Mapr, Hortonworks, Cloudera… the DataBricks and Mapr are the popular one, I…

Java to json schema maven example: YAML and JSON are simple and nice format for structured data and easier for human to read and write than XML. But there have been no schema for YAML such as RelaxNG or DTD. Below is an example that convert java object to json…

Java to yaml schema maven example: YAML and JSON are simple and nice format for structured data and easier for human to read and write than XML. But there have been no schema for YAML such as RelaxNG or DTD. Below is an example that convert java object to yaml.…