Data Engineer

5 years

4 - 8 Lacs

Posted:4 hours ago| Platform: GlassDoor logo

Apply

Work Mode

Remote

Job Type

Full Time

Job Description

Role: Data Engineer – ODS Platform
Location: [Onsite / Hybrid / Remote]
Type: [Full-Time / Contract]
Industry: Aviation, Retail, Finance, Healthcare
Job Overview
We are looking for an experienced Data Engineer with strong data modeling expertise, AWS Data Engineering certification, and hands-on experience across key AWS services used in building scalable Operational Data Store (ODS) platforms. The ideal candidate will bring a combination of backend engineering skills in Python or Java, a solid understanding of data pipelines and Lakehouse architectures, and a track record of delivering high-performance, SOX-compliant data systems in the cloud.
Key Responsibilities
Design and implement data ingestion pipelines, ETL/ELT workflows, and data transformation logic for ODS layers (Raw Curated Published).
Build scalable data models and schemas to support operational and analytical workloads with historical retention.
Leverage AWS-native services for data processing, storage, cataloging, and orchestration S3, Glue, Athena, Aurora, Redshift, DynamoDB, Step Functions, Lambda, Lake Formation
Ensure compliance with SOX, data governance, and access control standards.
Write reusable, well-tested code in Python and/or Java for custom data transformations and orchestration components.
Implement partitioning, compaction, and optimization techniques for performance and cost efficiency.
Monitor and troubleshoot data jobs using tools such as CloudWatch, Glue job metrics, and custom alerts.
Work closely with architects, analysts, and business stakeholders to understand data needs and deliver quality datasets.
Document technical designs, data flow diagrams, and data dictionaries.
Required Qualifications
5+ years of experience in data engineering with a strong focus on data modeling and cloud-based architecture.
AWS Certified Data Analytics – Specialty or Big Data – Specialty (or actively pursuing).
Solid hands-on experience with AWS Glue, S3, Athena, Aurora, Step Functions, Lambda, API Gateway, Lake Formation
Strong experience building and optimizing data models (3NF, star/snowflake, time-series) for ODS or EDW platforms.
Advanced proficiency in Python and/or Java, including experience building reusable frameworks or libraries.
Experience with data cataloging, schema evolution, and metadata management.
Familiarity with CI/CD, Git, and IaC tools like Terraform or CloudFormation.
Deep understanding of batch vs. streaming patterns, event-driven processing, and system decoupling.
Preferred Qualifications
Experience with Snowflake, Redshift Spectrum, or Databricks is a plus.
Knowledge of Kafka, Kinesis, or other streaming platforms.
Exposure to data quality, lineage, and governance frameworks.
Prior experience implementing SOX-compliant data architectures.
Familiarity with Airflow, dbt, or similar orchestration/transformation tools.

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You

Hyderabad, Telangana, India

Pune, Maharashtra, India

Noida, Uttar Pradesh, India