Big Data Engineer (Java & Spark)

As a Big Data Engineer, you will be responsible for translating application storyboards and use cases into functional applications, designing and building efficient and reliable Java code. You will ensure optimal performance, quality, and responsiveness of applications, while also identifying bottlenecks and devising solutions. Your role will involve developing high-performance, low-latency components to run Spark clusters and collaborating with global teams to propose best practices and standards.

Technical Skills:

• Programming Languages

  : Strong Java experience (8+ years) with Java 1.8 or higher; solid understanding of object-oriented programming and design patterns.

• Big Data Technologies

  : Experience with HDFS, Hive, HBase, Apache Spark, and Kafka.

• Data Processing

  : Proficient in processing data using Hive, Impala, and HBase; capable of performing analysis on large data sets.

• APIs and Architecture

  : Experience in building self-service platform-agnostic data access APIs; knowledge of service-oriented architecture and data standards like JSON, Avro, and Parquet.

• Analytical Skills

  : Experience in building advanced analytical models based on business context; strong analytical and problem-solving skills.

• Development Practices

  : Familiarity with Agile/Scrum methodologies, SCMs like Git, and tools like JIRA; strong understanding of unit testing and SDLC activities.

• Scripting and Databases

  : Experience with Linux shell scripting and RDBMS/NoSQL databases; good knowledge of database principles, practices, and SQL development (preferably with Oracle).

• Performance Tuning

  : Experience in application performance tuning and troubleshooting in the Big Data domain.

• Other Technologies

  : Familiarity with cloud and container technologies, build tools such as Maven, and continuous integration tools like Jenkins or Team City is a plus.

Experience:

• 5-10 years of experience in software development, with strong Java and Big Data technology expertise.
• Demonstrated ability to design solutions and mentor other developers within the team.
• Proven experience in working with large data volumes and logical data structures.

Day-to-Day Activities:

• Translate application storyboards and use cases into functional applications.
• Design, build, and maintain reliable and efficient Java code.
• Ensure optimal performance, quality, and responsiveness of applications.
• Identify and resolve bottlenecks and bugs.
• Develop high-performance components for Spark clusters.
• Collaborate with global teams to propose best practices and standards.
• Test software prototypes and facilitate handover to the operations team.
• Process data using Hive, Impala, and HBase, and conduct analysis on large datasets.
• Mentor and guide team members in technical skills and best practices.

Qualifications:

• Bachelor s or Master s degree in Computer Science, Information Technology, or a related field.
• Optional: Familiarity with Arcadia Tool for Analytics.

Soft Skills:

• Excellent analytical and problem-solving abilities.
• Strong communication and collaboration skills to work effectively with cross-functional teams.
• Ability to mentor and guide junior developers.
• Strong attention to detail and ability to work under pressure.
• Creative thinking and initiative in proposing improvements and innovations.