Java Spark Lead

Key Responsibilities:

• Lead the design and development of scalable data processing solutions using Java and Apache Spark
• Collaborate with data architects analysts and other stakeholders to understand data requirements
• Optimize Spark jobs for performance and scalability in distributed environments
• Ensure code quality through code reviews unit testing and best practices
• Mentor and guide junior developers and contribute to team growth
• Work closely with DevOps to deploy and monitor applications in production
• Troubleshoot and resolve technical issues across the data pipeline
• Stay updated with emerging technologies and propose improvements

Technical Requirements:

• Strong understanding of distributed computing and big data concepts
• Experience with Hadoop ecosystem Kafka Hive and other data tools is a plus
• Proficiency in writing optimized Spark jobs and handling large scale data
• Familiarity with cloud platforms AWS Azure GCP and containerization Docker Kubernetes
• Excellent problem solving communication and leadership skills

Additional Responsibilities:

• Experience with CI CD pipelines and version control systems Git
• Knowledge of Scala or Python is a plus
• Certifications in Big Data or Cloud technologies

Preferred Skills: