Month: September 2013

According to MarketsandMarkets the global Big Data market will reach $46.34 billion by 2018. I wanted to check the local DC Metropolitan job market to verify the hype related to the shortage of professionals with Big Data skills. I went on a job board and searched for the number of job postings that listed Big Data tools as part of the requirements. I compared the numbers with the numbers that I had recorded on September of 2012.

The broader IT market didn’t change much in the past year, but there is significant growth in the Big Data related tools (Hadoop, R, MongoDB). I didn’t record the number of postings for Data Scientists last year, but the number stands at 29 this year– some are posted under Data Analyst because Big Data is new and some folks don’t know the difference between the two; the only way we would know is to read the job description. One interesting fact pertaining to the geographic spread of the Big Data jobs; the jobs are concentrated in few areas. Below is the ranking according to Dice. The sorting was based on Per Capita Ratio.

Silicon Valley

Boston

Seattle

Washington, D.C.

New York

Philadelphia

Los Angeles

Big Data will create jobs in three areas: Data Infrastructure, Data Management, and Data Presentation (visualization). Large data sets need storage, Database software to store the data, and Analytics tools to turn data into meaningful information for businesses. Additionally, there are other parts of IT that will be impacted by the surge of Big Data adoption such as Network, Security, and the Cloud.

I divide the required skill sets into two categories: Immediate opportunities and long term opportunities. If you are interested to build your Big Data hot skills for today’s market, you might want to take into consideration this list: Java, Hadoop, Linux, C#, R, Python, Php, Hbase, Cassandra, MongoDB, Amazon ERM, and Mapreduce.

Planning your career for long term engagement will involve several other tools that might be very much in demand in a couple of years. Windows Azure, IBM PureData, Oracle Big Data Appliance, HPCC, Cloud Foundry, Pivotal, Sap HANA, Google BigQuery, OpenStack, Mahout, SAS, Excel 2013, Tableau, Ruby, postgreSQL, MariaDB, Pentaho, MySql, Jaspersoft, Talend, and LAMP.

If you are the leading-edge type and you want to know how to get a hot job in Big Datawith startup companies, I recommend following the developments on these startups. SiSense, Parstream, Skytree, Platfora, VOLTDB, nuodb, Hortonworks, Cloudera, MapR, Splunk, Mu Sigma, Opera Solutions, 1010data, Alteryx, Datameer, and fusion-io

Software Defined Networking, Software Defined Storage, and Cloud Security are among the promising fields in support of Big Data in the coming years.

Like this:

Big Data will become the epicenter of market growth in IT in the coming years. Major League players such as Oracle, IBM, Microsoft, Google, Amazon, HP, VMware , Microstrategy, Informatica, SAP, NetApp, DELL, Intel, Cisco, and EMC have allocated significant resources to their Big Data strategy. Moreover, a slew of startups are working around the clock to bring their products to the bazar international and secure their place within the Big Data tribe. The market is rapidly gaining momentum and according to Gartner Group it will expand considerably in the coming years. What sets Big Data aside from other emerging technologies is the depth and breadth of its influence. Big Data is bringing to life an array of disparate technologies ranging from new Servers to new Analytical tools. The integration challenges for IT posed by the layers of complexities will invariably yield great opportunities for jobs. If you are concerned about job security and want to learn something new, the timing couldn’t be better; Where do I start learning Big Data? the following includes some of the Big Datahot skills in demand. Data Science, Hadoop, NoSql & NewSql Databases, Business Intelligence, Data Warehousing, Cloud Computing, Python, Mahout, and off course the omnipotent, omnipresent Java.