Data Engineering

Job Title:

Experience:

Location:

Notice Period: Immediate

Role Summary

Software Engineer (Data Engineering)

client-facing role

flexible to work in alignment with US time zones when needed.

Key Responsibilities Data Engineering

• Design, build,and maintain scalable

  ETL/ELT pipelines

  for large-scale data processing.
• Develop and optimize

  data architectures

  supporting analytics and ML workflows.
• Ensure

  data integrity, security, and compliance

  with organizational and industry standards.
• Collaborate with

  DevOps

  teams to deploy and monitor data pipelines in production environments.

Required Qualifications

• Experience:

  4+ years in

  Data Engineering

  and

  AI/ML

  roles.

• Education:

  Bachelor’s or Master’sdegree in ComputerScience, Data Science,or a related field.

Technical Skills (Necessary)

• Languages/Libraries:

  Python, SQL, Bash, PySpark,Spark SQL, boto3, pandas

• Compute:

  Apache Spark on EMR (driver/executor model, sizing, dynamicallocation)

• Storage:

  Amazon S3 (Parquet), lifecycle to Glacier

• Catalog:

  AWS Glue (Catalog& Crawlers)

• Orchestration/Serverless:

  AWS Step Functions, AWS Lambda, Amazon EventBridge

• Ingestion:

  CloudWatch Logs/Metrics, KinesisData Firehose (or Kaffia/MSK)

• Warehouse:

  Amazon Redshift + Redshift Spectrum

• Security/Access:

  IAM (least privilege), SecretsManager / SSM

• Ops/Collab:

  Git + CI (Jenkins/GitHub/GitLab), CloudWatch logging/metrics