RITWIK IT SERVICES PRIVATE LIMITED logo

Senior AWS Data Engineer

RITWIK IT SERVICES PRIVATE LIMITED

8 - 13 years

8 - 18 Lacs

Bengaluru

Posted:5 days ago

Job Description

Experience:

Role Overview

We are looking for experienced AWS Data Engineers with strong expertise in data engineering, distributed processing and performance optimisation. The ideal candidate should have hands-on experience building scalable ETL/ELT pipelines, optimising large-scale data workloads and delivering reliable data solutions on AWS.

This role requires an independent technical contributor who can work directly with clients and stakeholders, provide technical consulting, mentor engineers and drive engineering excellence.

Key Responsibilities

  • Design, develop and maintain scalable ETL/ELT pipelines on AWS-based data platforms.
  • Build reusable engineering components using Python, SQL and PySpark.
  • Implement automated testing, monitoring, exception handling and recovery mechanisms.
  • Troubleshoot production issues, perform root-cause analysis and implement preventive measures.
  • Apply data modelling, metadata management, security and governance practices.
  • Maintain technical documentation, operational runbooks and knowledge-transfer materials.
  • Collaborate with platform engineering, operations, data owners and business stakeholders.
  • Identify and resolve performance bottlenecks across data ingestion, transformation, storage and query execution.
  • Optimise complex SQL queries and Spark/PySpark workloads.
  • Analyse execution plans, resource utilisation, data skew, shuffle operations and memory behaviour.
  • Improve partitioning, file sizing, compression, join strategies and incremental processing.
  • Tune AWS Glue, Amazon Redshift, Amazon Athena and other relevant processing environments.
  • Conduct workload benchmarking, concurrency testing and capacity analysis.
  • Establish performance baselines and validate improvements through repeatable testing.
  • Document measurable improvements in runtime, throughput, resource consumption and cloud costs without compromising data quality.

Mandatory Technical Skills

  • Strong hands-on experience in AWS Data Engineering.
  • Expertise in AWS services such as:
    • Amazon S3
    • AWS Glue
    • Amazon Redshift
    • Amazon Athena
    • AWS Lambda
  • Advanced SQL skills and strong proficiency in Python and PySpark.
  • Experience with Apache Spark and distributed data processing.
  • Experience with orchestration tools such as Apache Airflow.
  • Strong understanding of data lakes, lakehouse architectures, data warehouses and dimensional modelling.
  • Experience with Git, CI/CD pipelines, automated testing and production support.
  • Ability to translate business requirements into scalable and maintainable technical solutions.

Specialist Requirements – Performance Optimisation

  • Deep expertise in SQL query tuning and distributed processing optimisation.
  • Strong understanding of Spark execution, partitioning, caching, joins and resource configuration.
  • Experience troubleshooting large-scale AWS data workloads.
  • Knowledge of storage layouts, columnar file formats and efficient data-access patterns.
  • Ability to balance performance, reliability, scalability and cloud expenditure.

Good-to-Have Skills

  • Real-time and streaming data experience with Apache Kafka and/or Amazon Kinesis.
  • Exposure to Generative AI concepts and tools, including:
    • Amazon Bedrock
    • LLM concepts
    • Embeddings
    • Vector databases
  • Experience with Excel/CSV ingestion, template-driven ingestion and schema evolution handling.

Soft Skills

  • Excellent communication, comprehension and articulation skills.
  • Strong persuasion, negotiation and stakeholder-management abilities.
  • Ability to inspire and mentor technical teams.
  • Capable of working independently as a technical consultant for clients and engagements.
  • Strong individual contributor mindset with ownership and accountability.
  • Ability to mentor engineers on coding best practices and problem-solving techniques.

What We Offer

  • Opportunities to participate in organisation-wide innovation and continuous improvement initiatives.
  • Exposure to multiple products and projects across various ISVs.
  • Fortnightly organisational sessions to understand business and functional directions.
  • Opportunities to interact with leadership and colleagues across the organisation.
  • Employee engagement activities, celebrations and team-building initiatives.
  • Chimera Talks – a platform to share opinions and ideas beyond day-to-day work.
  • Annual year-end bonuses.
  • Hybrid working flexibility.

Important Note

Candidates must be comfortable with the 2:00 PM – 11:00 PM IST shift and working from the Chimera Office 2–3 days per week.

The final interview round will be conducted face-to-face at the Chimera Office.

Skills Required

SQL development Senior Amazon Redshift SQL AWS ETL Pyspark Glue

Learn the skills this job asks for

See your skill gap for Data Engineer →

Free courses, interview questions and practice for each skill.

Work Mode

Hybrid

Job Type

Full Time

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
RITWIK IT SERVICES PRIVATE LIMITED logo
RITWIK IT SERVICES PRIVATE LIMITED

RecommendedJobs for You

RITWIK IT SERVICES PRIVATE LIMITED logo

Senior AWS Data Engineer

RITWIK IT SERVICES PRIVATE LIMITED

Bengaluru

RITWIK IT SERVICES PRIVATE LIMITED logo

Senior AWS Data Engineer

RITWIK IT SERVICES PRIVATE LIMITED

Bengaluru