Posted in Big Data

Big Data Post #5 – Hadoop Framework ( ⚆ _ ⚆ )

Hadoop is a framework which has been developed for organizing and analysing big chunks of data for a business. Suppose you have a file larger than your system’s storage capacity and you can’t store it. Hadoop helps in storing bigger files than what could be stored on one particular server. You can, therefore, store very, very large files and also number of large files… *snicker

Hadoop was build to deal with big chunks of complex and structured data.

  • Hadoop is used in a number of domains. In financial domains, Hadoop helps in risk analysis. In online retail, Hadoop helps businesses in delivering better search answers to their customers so that they buy what is shown to them.
  • Hadoop also provides essential features like important predictions, fraud detection, log analysis, image processing wherever several gigabytes, terabytes or even petabytes of data has to be processed.
  • A crucial aspect behind the importance of Hadoop is that tasks are often completed in lesser time while cutting down the substantial costs.
  • Hadoop also works considerably well with public cloud-based frameworks.
Hadoop has now become a single solution for businesses which are in need of faster and stable processing of large, growing data chunks at a lesser cost.

Pre-Requisites for Learning Hadoop 

There is no specific pre-requisite to learn it but since Hadoop is all about Big Data Analysis and has been built in java, understanding of object oriented programming can definitely be an advantage.
One shall have the basic knowledge of concepts like 
  1. data-warehousing, 
  2. parallel and distributed computing, 
  3. data analysis, 
  4. web analytics etc.
Job Opportunities
Hadoop is by far the most used Big Data Technology in the entire world. According to the famous IT research organization named Gartner, Big Data is expected to create more than 4.4 million job opportunities by 2015. 
Here are some related job roles:
1) Data Statisticians
2) Operations Research Engineers
3) Business Managers
4) Market Research Analysts
5) Financial Analysts
6) Big Data scientists
7) Database administrators
According to a report by Gartner, 64% of surveyed companies indicate that they’re establishing or planning Big Data projects.
The fairly large need of Big Data is likely to be in health care, retail and manufacturing creating millions of job opportunities worldwide. However, only one-third of these job positions is estimated to be filled. This is due to the fact that there is a large talent gap for Big Data and skilled the number of professionals skilled in this field is relatively smaller than the requirement.

The future of technology is changing rapidly and Big Data holds a major share in this revolution.


So that being said … Let me start with how to go about with getting a glimpse of the discussed technology before getting into actual work…

Well, that was pretty mean…

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s