There is always demand for skilled technology experts. Every new technological platform brings with it a new demand for specialized skills. More often than not, there is a shortage of qualified talent and a boost in pay scale for those with the right programming and infrastructure expertise. The same is certainly true today for jobs in big data.
Big data is booming as more companies start to see value that the insight and innovations from big data can deliver. Ninety percent of Fortune 500 companies have some kind of big data initiative already underway. Accenture research shows that 75 percent of executives at large companies in the U.S. and the U.K. want to increase their company’s use of analytics.That means jobs in big data are booming as well, but skilled big data talent is hard to find.
There will be 1.5 million managers and analysts with big data experience needed in the next five years. At the same time there is going to be a predicted shortage of 140,000 to 190,000 big data experts. Those skills anticipated to be in greatest demand are in the areas of Structured Query Language (SQL), business intelligence, SAS analytics software, data warehousing, data analysis, Oracle, business analytics, data management, business processes, and extract, transform, and load (ETL) development.
As big data continues to evolve, talent-strapped organizations will continue to scramble to find the best talent to fill jobs in big data; experts with the skills necessary to architect, organize, and analyze various types of data sets. According to a survey by Kforce, the following roles are going to be in greatest demand in the months ahead:
- ETL Developers – Along with volume and velocity, big data is about data variety. There is going to be a growing need for experts who can acquire and integrate disparate data sources, extract data, and add that data to the data warehouse. ETL developers will be earning between $110,000 and $130,000 per year.
- Hadoop Developers – Open source still rules in big data and Hadoop is still the de facto framework for processing large data sets. Programmers with expertise in Hive, HBase, MapReduce, Pig, and other programming tools that can tame massively distributed processing will be in demand. Python and NoSQL programmers are also going to be in great demand. Hadoop programmers will be able to earn $150,000 to $175,000 per year.
- Visualization Tool Developers – Extracting the data is one step, but you still have to be able to interpret it. Visualization tools make it possible to quickly probe for new insights from big data, and programmers who can create customized dashboards can earn from $150,000 to $175,000 per year.
- OLAP Developers – Developers who can optimize data using Online Analytical Processing (OLAP) will be in increasing demand as the amount of unstructured data – email, social media, graphics, etc. – needed for big data grows at an alarming rate. OLAP developers take data from unstructured data sources and create dimensional models. They can earn from $97,000 to $115,000 per year.
- Data Scientists – The data scientist serves as the interpreter who translates data analytics into business value. These professionals walk the paths of both the technology and business and must be great communicators who can explain data findings to senior managers as well as IT managers. They will be able to command from $125,000 to $140,000 per year.
- Predictive Analytics Developers – This role is similar to the data scientist but specializes in performing hypothetical “what if” analyses. Predictive analytics builds potential business scenarios using historical and other available data. These professionals earn from $103,000 to $129,000 per year.
- Information Architects – Someone with knowledge of data management, data modeling, and business needs to be able to define and organize the data so as not to disrupt other business processes. The information architect is responsible for data governance, and can earn from $113,000 to $135,000 annually.
Of course, in addition to these specialized technical skills there also is an increasing demand for Information Technology Project Managers capable of overseeing entire big data projects. Statistics show that in the past 12 months there has been a jump in demand of 123.6 percent for Information Technology Project Managers with expertise in big data.
With demand for jobs in big data continuing to increase and talent in short supply, this is a golden opportunity for resellers to bring their expertise to big data projects to fill the gaps. Big data project management seems a logical place to begin. Then you can identify where the talent gaps lie and see how you can best fill the customer’s big data needs.