AWS Bigdata - Senior Engineer

Key Responsibilities

• Design, develop, and maintain

  scalable Big Data solutions on AWS

• Build and optimize

  data ingestion, transformation, and processing pipelines

• Work with large-scale structured and unstructured datasets
• Implement

  ETL/ELT workflows

  using cloud-native and Big Data tools
• Optimize performance, cost, and reliability of AWS data services
• Ensure

  data quality, security, and governance

  best practices
• Mentor junior engineers and contribute to technical best practices

Technical Skills (Must Have)

AWS Cloud

• Strong hands-on experience with

  AWS services

  such as:
  • S3, EC2, EMR, Glue, Athena, Redshift, Lambda, Airflow
  • IAM, CloudWatch, CloudFormation / Terraform
  • Exposure to

    Data Lake / Lakehouse architectures

• Experience in

  cost optimization and performance tuning

Big Data & Data Engineering

• Strong experience with

  Apache Spark (PySpark/Scala)

• Hands-on with

  Hadoop ecosystem

  (HDFS, Hive, Sqoop, HBase - as applicable)
• Experience with

  streaming frameworks

  (Kafka / Kinesis preferred)
• Solid understanding of

  data modeling and warehousing concepts

Programming & Tools

• Proficiency in

  Python / Scala / Java

• Strong

  SQL

  skills
• Experience with

  Linux/Unix environments

• Version control using

  Git

Good to Have

• Knowledge of

  DevOps & CI/CD pipelines

• AWS certifications (Associate or Professional)
• Experience working in

  Agile/Scrum

  teams

Soft Skills

• Strong analytical and problem-solving abilities
• Excellent communication and stakeholder management skills
• Ability to work independently and in cross-functional teams
• Ownership mindset with attention to detail

Mandatory Competencies