Senior Spark/Scala Developer

The Senior Spark Developer will be responsible for integrating and maintaining the Quantexa platform, a spark based software provided by a UK fintech, into our existing systems to enhance our anti-money laundering capabilities. This role requires a deep expertise in Spark development, as well as an ability to analyze and understand underlying data. Additionally, the candidate should have an interest in exploring open-source applications distributed by Apache, Kubernetes, OpenSearch and Oracle.

Responsibilities

• Integrate and upgrade the Quantexa tool with our existing systems for enhanced anti-money laundering measures.
• Develop and maintain Spark-based applications deployed on Kubernetes clusters.
• Conduct data analysis to understand and interpret underlying data structures.
• Collaborate with cross-functional teams to ensure seamless integration and functionality.
• Stay updated with the latest trends and best practices in Spark development and Kubernetes.

• Work on tasks assigned by Lead independently. Take ownership of tasks assigned.
• Adhering to the given timelines by Lead with first time right
• Develop programs in optimal manner without compromising core architecture/design
• Work on the technologies efficiently and produce best fit deliveries
• Be proactive and provide status to the team lead.
• Adheres to all compliance & project related processes
• Gain functional knowledge on applications worked upon
• Upgrade Technical skill by self-learning/taking

Key Responsibilities

• Integrate and upgrade the Quantexa tool with our existing systems for enhanced anti-money laundering measures.
• Develop and maintain Spark-based applications deployed on Kubernetes clusters.
• Conduct data analysis to understand and interpret underlying data structures.
• Collaborate with cross-functional teams to ensure seamless integration and functionality.
• Stay updated with the latest trends and best practices in Spark development and Kubernetes.

Required Qualifications

• 5+ years of experience in development
• Extensive experience in Hadoop, Spark, Scala development (5 years min).
• Strong analytical skills and experience in data analysis (SQL), data processing (such as ETL), parsing, data mapping and handling real-life data quality issues.
• Excellent problem-solving abilities and attention to detail.
• Strong communication and collaboration skills.
• Experience in Agile development
• High quality coding skill, incl. code control, unit testing, design, and documentation (code, test). Experience with tools such as sonar. Experience with GIT, Jenkins.