AWS Data Engineer

Role: AWS Data Engineer

AWS Data Engineer

Contract to Hire

Key Responsibilities:

• Design, develop, and deploy

  data pipelines

  and solutions using AWS services such as

  S3, Glue, Lambda, API Gateway, and SQS

  .
• Write clean, efficient code using

  Python

  ,

  PySpark

  , and

  SQL

  to process and transform data.
• Implement

  batch job scheduling

  , manage data dependencies, and ensure reliable data processing workflows.
• Develop and maintain

  Spark

  and

  Airflow

  jobs for large-scale data processing and orchestration.
• Automate repetitive tasks and build

  reusable frameworks

  to enhance efficiency and reduce manual intervention.
• Provide

  Run/DevOps support

  , monitor pipelines, and manage the ongoing operation of data services on AWS.
• Ensure high standards for data quality, reliability, and performance.
• Collaborate with data scientists, analysts, and other engineers to support business initiatives.

Must-Have Skills:

• Strong hands-on experience with AWS services:

  S3, Lambda, Glue, API Gateway, SQS

• Proficiency in

  Python, PySpark, and SQL

• Experience with

  batch job scheduling

  and managing

  data dependencies

• Strong knowledge of

  Spark

  and

  Airflow

  for data processing and orchestration
• Solidunderstanding of

  DevOps practices

  and operational support for cloud data services

Good to Have:

• Experience with containerization (Docker, Kubernetes)
• Exposure to monitoring/logging tools (CloudWatch, Datadog, etc.)
• AWS certifications (e.g., Solutions Architect, Data Analytics Specialty)