Senior Product Engineer ( Data Engineer)

Job Summary:

We are seeking a skilled and motivated Data Engineer to design, develop, and maintain scalable data pipelines and backend services using cutting-edge technologies. You will work with AWS services, PySpark, Python, and Java to implement efficient data processing solutions and APIs. Collaborating with cross-functional teams, you will gather requirements, optimize data workflows, troubleshoot performance issues, and ensure data quality across platforms. As a mentor to junior engineers, you will provide technical guidance and contribute to the teams success.

Key Responsibilities:

• Design, develop, and maintain scalable data pipelines and systems using AWS services.
• Implement data processing solutions using PySpark and Python.
• Develop and maintain backend services and APIs using Java.
• Collaborate with cross-functional teams to gather requirements and deliver data solutions.
• Optimize and troubleshoot data workflows and performance issues.
• Ensure data quality and integrity across various data sources and platforms.
• Mentor junior engineers and provide technical guidance.

Required Skills:

• Extensive experience with AWS services such as EC2, S3, Lambda, Glue, and EMR.
• Proficiency in PySpark for large-scale data processing.
• Strong programming skills in Python.
• At least 2+ years of experience in Java.
• Experience with data warehousing solutions and ETL processes.
• Knowledge of both relational and NoSQL databases.
• Familiarity with CI/CD pipelines and version control systems like Git.
• Excellent problem-solving and analytical skills.
• Strong communication and teamwork abilities.

Preferred Qualifications:

• Experience with machine learning frameworks and tools.
• Knowledge of data security and compliance best practices.
• Certification in AWS or related technologies.

Qualifications

• AWS: EC2, S3, Lambda, Glue, EMR. Proficiency in PySpark & Python for large-scale data processing, 2+years of Java experience
• Familiarity with ETL processes and data warehousing concepts, Understanding of relational databases and NoSQL databases
• Familiarity with CI/CD pipelines and version control systems like Git.