Senior Data Engineer

8 years

Pune

Posted:6 days ago

Job Description

Project description

As part of Client Technology team, the data Engineer will work to design, develop, and support scalable data solutions that underpin strong engineering practices, implicit data controls and the functional requirements for effective surveillance and regulatory reporting use cases. The scope will focus on onboarding new data sources, developing data ingestion and transformation pipelines, implementing data quality controls, supporting lineage and metadata requirements, and enabling efficient management of transactional and non-transactional/ reference data across the platform. The role will support both strategic initiatives and ongoing operational requirements

Responsibilities

Data Pipeline Development: Design, build, and maintain scalable batch and real-time streaming data pipelines (ETL/ELT) using tools like Dataflow, Pub/Sub, and Dataproc.

Data Warehousing & Modeling: Architect and optimize enterprise data warehouses, data lakes, and dimensional models inside BigQuery, Cloud Storage, and Cloud SQL.

Performance & Cost Optimization: Tune query performance, configure proper partitioning and clustering, and manage data lifecycle/retention policies.

Data Governance & Security: Enforce security controls, encryption, access management, and automated data quality checks.

Automation & DevOps: Implement Infrastructure as Code (Terraform) and CI/CD pipelines via GitHub or cloud-native deployment tools.

Skills

Must have

Minimum of 8 years of experience in data engineering, with a strong focus on SQL and data manipulation.

Cloud Platform: Deep experience with GCP services including BigQuery, Dataflow, Pub/Sub, Cloud Storage, Dataproc, and Cloud Composer.

Programming & Query Languages: Proficiency in Python, SQL, Java, Scala, or Golang.

Big Data & Analytics Concepts: Data modeling, star schemas, slowly changing dimensions (SCD), Apache Beam, and dbt.

Education & Experience: Typically a Bachelor’s or Master’s degree in Computer Science or Engineering,

Nice to have

Banking

Other

Languages

English: C2 Proficient

Seniority

Senior


Pune, India

Req. VR-126042

Data Modeling

BCM Industry

12/11/2026

Req. VR-126042

Skills Required

Regulatory Reporting USE Cases Onboarding Data Ingestion Data Quality Data Pipeline ETL Data Warehousing Cloud Storage Cloud SQL Cost Optimization Data Governance

Learn the skills this job asks for

See your skill gap for Data Engineer →

Free courses, interview questions and practice for each skill.

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
Luxoft logo
Luxoft

IT Services and IT Consulting

Zug New York

RecommendedJobs for You

Recruito logo

India

Jobaaj Com logo

Noida

YouGov logo
HP logo
Ecolab logo

Bengaluru

Hiringhood logo

Hyderabad

IntraEdge logo

Pune

NationsBenefits logo

Senior Data Engineer

NationsBenefits

Hyderabad

P

Hyderabad