AWS Data Engineer

About the Role

AWS Data Engineer

large, complex, and multi-dimensional datasets

Veeva API integration

Key Responsibilities

• Design, develop, and optimize

  data ingestion, transformation, and storage pipelines

  on AWS.
• Manage and process

  large-scale structured, semi-structured, and unstructured datasets

  efficiently.
• Build and maintain

  ETL/ELT workflows

  using AWS native tools such as

  Glue, Lambda, EMR, and Step Functions

  .
• Design and implement

  scalable data architectures

  leveraging

  Python, PySpark, and Apache Spark

  .
• Develop and maintain

  data models

  aligned with business and analytical requirements.
• Collaborate closely with

  data scientists, analysts, and business stakeholders

  to ensure data availability, reliability, and quality.
• Handle

  on-premises and cloud data warehouse systems

  , ensuring optimal performance and smooth migration strategies.
• Maintain awareness of

  emerging trends and best practices

  in data engineering, analytics, and cloud computing.

Required Skills & Experience

• Proven hands-on experience with

  AWS Data Engineering stack

  , including:

• AWS Glue, S3, Redshift, EMR, Lambda, Step Functions, Kinesis, Athena, and IAM.

• Proficiency in

  Python, PySpark, and Apache Spark

  for data transformation and processing.
• Strong understanding of

  data modeling principles

  (conceptual, logical, and physical).
• Experience working with

  modern data platforms

  such as

  Snowflake, Dataiku, or Alteryx

  (good to have, not mandatory).
• Familiarity with

  on-premise and cloud data warehouses

  and

  migration strategies

  .
• Solid knowledge of

  ETL design patterns, data governance, and data quality/security best practices

  .
• Understanding of

  DevOps for Data Engineering

  , including

  CI/CD pipelines

  and

  Infrastructure as Code (IaC)

  using

  Terraform or CloudFormation

  (good to have).
• Excellent

  problem-solving, analytical, and communication skills

  .

Qualifications

• Bachelor's or Master's degree in

  Computer Science, Information Technology, Data Engineering

  , or a related field.
• Minimum

  4 years of experience

  in

  data engineering

  with a focus on

  AWS

  tools and ecosystem.
• Continual learning mindset with interest in

  emerging technologies and cloud data innovations

  .