Senior Data Engineer - ETL/Python

About The Role

We are looking for a highly experienced Senior Data Engineer with deep expertise in the AWS ecosystem to design, implement, and manage enterprise-grade data integration solutions.The ideal candidate will have a proven track record in ETL processes, cloud-based data architecture, and building scalable data pipelines.This role will play a critical part in enabling our data-driven strategy and ensuring the integrity, performance, and scalability of our data infrastructure.

Key Responsibilities

• Design and develop robust, scalable, and secure data integration and ETL solutions on AWS.
• Implement and optimize data pipelines using services such as AWS Glue, AWS Lambda, Amazon Redshift, Amazon S3, and AWS Data Pipeline.
• Work on data modeling, data warehousing, and big data solutions to support analytics and business intelligence initiatives.
• Ensure data quality, governance, and compliance with industry best practices and security standards.
• Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to translate requirements into data engineering solutions.
• Troubleshoot and optimize data processes to ensure high performance and reliability.
• Mentor junior engineers and contribute to building best practices for the data engineering team.
  

Qualifications Have & Experience

• Bachelors or Masters degree in Computer Science, Information Technology, or a related field.
• 10+ years of overall IT experience, with 7+ years in data integration and ETL processes.
• Strong expertise in AWS services: AWS Glue, AWS Lambda, Amazon Redshift, Amazon S3, AWS Data Pipeline.
  

Technical Skills

• Proficiency in SQL and hands-on experience with relational databases (MySQL, PostgreSQL, etc.
• Strong programming skills in Python.
• Experience with data modeling, warehousing, and big data frameworks.
• Knowledge of data governance, security, and compliance best practices.
  

Soft Skills

• Excellent problem-solving and analytical abilities.
• Strong communication, collaboration, and stakeholder management skills.
• Ability to work independently as well as within a cross-functional team.
  

Good To Have

• AWS Certified Solutions Architect or other relevant AWS certifications.
• Exposure to machine learning and AI technologies.
• Experience with Google Cloud Platform (GCP) or other cloud providers.
• Familiarity with LookML (Looker).
• Domain knowledge of US Healthcare and Life Sciences
  

(ref:hirist.tech)