Senior Data Engineer (AWS Focus)

We are looking for an experienced Data Engineer to design, build, and optimize data pipelines and architectures in the cloud. You'll work with cutting-edge technologies, turning raw data into actionable insights that drive business decisions.

KEY RESPONSIBILITIES:

• Design, build, and maintain scalable data pipelines and ETL processes on AWS.
• Work with AWS services such as Redshift, S3, Glue, Lambda, EMR, and Athena to manage and process large volumes of data.
• Collaborate with Data Analysts, Data Scientists, and stakeholders to understand data requirements and deliver solutions.
• Optimize data storage, performance, and cost-efficiency in the cloud environment.
• Implement data quality and governance practices to ensure accuracy, consistency, and reliability.
• Stay updated on AWS technologies and data engineering best practices.
• Troubleshoot and resolve data-related issues, ensuring system reliability and uptime.

REQUIRED COMPETENCIES:

• More than five years of Hands-on experience with AWS data services: Redshift, S3, Glue, Lambda, EMR, Athena.
• Strong SQL skills for querying and transforming data.
• Experience with ETL/ELT processes and data pipeline orchestration (e.g., Airflow).
• Proficiency in Python for data engineering tasks.
• Solid understanding of data modeling, warehousing, and big data concepts.
• Experience with version control (Git) and CI/CD pipelines.
• Strong analytical and problem-solving skills, with attention to detail.
• Ability to collaborate effectively with cross-functional teams and communicate technical concepts clearly.

DESIRED COMPETENCIES:

• Experience with Databricks or Spark on AWS.
• Familiarity with data governance, security, and compliance practices.
• Knowledge of containerization (Docker, Kubernetes) in data workflows.
• AWS certifications (e.g., AWS Certified Data Analytics Specialty)

QUALIFICATIONS:

•  Candidate must possess at least a Bachelors/College Degree in Computer Science, Computer Engineering, Information Technology or equivalent.
• More than five years of proven expertise in designing, building, and maintaining scalable data pipelines and ETL processes on AWS.