BigData and Hadoop Ecosystems Developer

Job Descritpion of BigData and Hadoop Ecosystems Developer

4 to 6 Years Relevant Experience

We are seeking a highly skilled Big Data and Hadoop Ecosystems Developer with proven experience in building data-driven solutions using Hadoop, Spark, and Scala. The ideal candidate should have hands-on experience in data transformation, cloud platforms, and big data ecosystems, with a strong understanding of banking domain terminologies. If you're a proactive problem solver who thrives in complex environments, we’d love to hear from you.

Key Responsibilities:

• Develop and maintain scalable Big Data applications using Hadoop, Hive SQL, Spark, and related ecosystem tools.
• Create high-performance Scala/Spark jobs for data aggregation, transformation, and processing.
• Work with stream-processing systems such as Storm, Spark Streaming, or Flink.
• Optimize Hive queries and Spark jobs for performance enhancement.
• Participate in end-to-end development: environment setup, data connectivity, development, testing, deployment, and production support.
• Collaborate with cross-functional teams in a multi-reporting line organizational structure.
• Contribute to DevOps practices and follow Agile methodologies for iterative development and delivery.
• Occasionally act as the primary contact or project lead on small to medium-sized projects.

Required Skills & Experience:

• Hands-on experience with:
  • Hadoop, Hive SQLs
  • Apache Spark, Scala
  • Big Data Ecosystem Tools
• Strong command of data warehousing principles and practices.
• Understanding of object-oriented programming and HDFS architecture.
• Experience with streaming technologies such as Storm, Spark Streaming, or Flink.
• Familiarity with DevOps tools and Agile development frameworks.
• Exposure to banking or financial services domain with relevant terminology and practices.
• Strong problem-solving skills, ability to work independently in ambiguous or dynamic environments.

Desirable Skills:

• Knowledge of cloud platforms, especially AWS or Azure.
• Experience in setting up and managing cloud-based big data infrastructure.
• Ability to quickly grasp new technologies and adapt to shifting priorities.
• Excellent communication and interpersonal skills for working in cross-functional, global teams.

Required Skills for BigData and Hadoop Ecosystems Developer Job

Bigdata

Hadoop

Data Warehousing

Hive SQL's

Spark

Cloud