Bigdata Engineer

Big Data Engineer Responsibilities:

1. Minimum 6+ years of experience in IT Industry with 4 Years of relevant in Bigdata

Technologies.

1. Should have hands on experience in Spark, Scala, Hadoop, Azure AD, Bricks , Pycharm.


2. Meeting with managers to determine the company s Big Data needs.


3. Should have team handling experience. (5-10 People)


4. Developing Hadoop systems.


5. Loading disparate data sets and conducting pre-processing services using Hive or Pig.


6. Finalizing the scope of the system and delivering Big Data solutions.


7. Managing the communications between the internal system and the survey vendor.


8. Collaborating with the software research and development teams.


9. Building cloud platforms for the development of company applications.


10. Maintaining production systems.


11. Training staff on data resource management.