Job
Description
We are looking for 2 experienced Product Engineers with strong expertise in Scala and Java to join our team. As part of the engineering team, you will be responsible for building and maintaining our data batch processing framework. Your focus will be on connecting and implementing various data sources to ingest data into our systems, ensuring the seamless flow of data for our applications. If you have a passion for solving complex problems in a high-performance environment, this role is for you! Key Responsibilities : Develop, maintain, and optimize data ingestion pipelines using Scala and Java . Connect various data sources to our systems, ensuring smooth ingestion, validation, transformation, and loading of data. Leverage AWS cloud technologies (e.g., S3 , EMR ) to manage and scale data processing operations. Build and maintain CI/CD pipelines to automate deployment and ensure continuous integration and delivery of data solutions. Collaborate with cross-functional teams to integrate data from different sources and maintain high-quality data pipelines. Write and maintain unit, functional, and load/performance tests to ensure the reliability and performance of the systems. Utilize Maven , Cucumber , Kafka , and Jenkins to enhance development and testing workflows. Participate in Agile software development practices to ensure continuous delivery and collaboration within the team. Use tools like IntelliJ , Git , Bitbucket , Artifactory , Jira , and Confluence to collaborate, track progress, and manage the development process. Provide proactive solutions and maintain a high level of communication with both technical and non-technical stakeholders. Requirements : 8+ years of experience in software engineering , with a specific focus on Scala (primary) and Java . Strong experience in data ingestion , including data retrieval , validation , transformation , and loading . Familiarity with AWS cloud technologies , particularly S3 and EMR . Proficiency with Maven , Cucumber , Kafka , and Jenkins . Experience building and managing CI/CD pipelines for continuous integration and deployment. Solid background in unit , functional , and load/performance testing with hands-on experience in test automation . Familiarity with development and collaboration tools such as IntelliJ , Git , Bitbucket , Artifactory , Jira , and Confluence . Strong experience in Agile software development methodologies. High level of proactivity , strong problem-solving skills, and the ability to work independently. Excellent communication skills to interact with cross-functional teams and stakeholders. Nice to Have : Experience working with large-scale, distributed data processing systems. Familiarity with other AWS services such as Lambda , Redshift , or Glue . Experience working in high-performance or data-intensive environments. Skills : Scala Java Data Ingestion AWS (S3, EMR) Maven Cucumber Kafka Jenkins CI/CD Testing (Unit, Functional, Load/Performance) Agile Development Git , Bitbucket , Artifactory , Jira , Confluence
