Big Data Engineer

We Need Strong Expertise on Hadoop or Scala

Required Qualifications:

• Overall 2+ years IT industry experience with all phases of SDLC
• 2+ years of experience with Waterfall and Agile project methodologies
• 2+ years of experience as a professional software engineer.
• 2+ years of experience in Spark application development and implementation.
• Holds very strong technical knowledge in Spark.
• Preferred knowledge and hands-on experience working with Hadoop Ecosystem and Big data technologies like Hive, Kafka, Hbase , NIFI and Data processing framework such as Spark.
• Hands-on experience with Data modeling, normalization, processing with Spark and SQL and Spark performance tuning knowledge.
• Excellent knowledge of OOPS concepts and familiarity in using Java.
• Experience using version control tools like GIT, CI/CD process and build tools like Gradle and Maven.
• Strong knowledge of Database concepts and UNIX bash scripting.
• Advantage of having knowledge with JOB schedulers like Autosys.
• Knowledge of docker images, containers, and container management framework like Kubernetes, including scheduling micro service deployment and creating services on kubernetes and   handling ingres and egress.

Desired Qualifications:

• 2+ total years with working with business partners to breakdown requirements, manage technology delivery, educate the business on technology options, lead enterprise level initiatives and ensure that expectations are set and delivered on time and budget.
• 2+ years of experience working in Control Room Surveillance, Trade Surveillance or Compliance Risk, or Financial Services domain experience
• 1+ years of experience designing and implementing process solutions for automation
• Must be able to provide examples that they have the ability to multi-task and handle multiple technology initiatives at the same time.
• A detailed, logical thinker, problem solver & team player
• Experience working with onsite/offshore teams
• Experience with messaging services like JMS/Kafka a plus.