Technical Lead: Open Source Data Engineering Platform

BAJAJ FINSERVE

9 - 12 years

25 - 30 Lacs

pune

Posted:1 week ago| Platform:

Apply

Skills Required

spark etl python data engineering

Work Mode

Work from Office

Job Type

Full Time

Job Description

Role & responsibilities

Data Engineering

deep expertise in large-scale Data Engineering platforms design, development and execution experience

robust, scalable, and future-ready data ingestion and processing framework

Preferred candidate profile

Experience Required:

Overall 8+ Years of experience in Data Engineering domain
Ability to lead the team to develop a cloud-agnostic, open-source data engineering platform
Hands on Architecture, Design and Programming skills to develop an Open Source based Data Engineering Application and Framework within a larger Enterprise Application product suite.
Strong Hands On experience in Python, Spark, API and preferably with other open source product like Apache Nifi etc.
Hands on experience in Java is preferrable
Strong experience in ETL/ELT pipelines, data streaming, CDC etc.
Design and implement real-time data streaming solutions as a part of product feature
Design and develop robust
data quality assurance
, failure logging features
Design and develop Monitoring, diagnostic and logging features to maintain production and non-production systems proactively
Develop automation scripts/tools (Python, Perl, Shell) to eliminate manual tasks and accelerate issue resolution
Engage with stakeholders to continuously enhance the product
Capture user feedback and translate it into actionable architecture or support initiatives.
Maintain structured documentation, including performance metrics and enhancement logs.

More Jobs at BAJAJ FINSERVE

Senior Manager - Financial Accounting

Pune

4 - 6 yrs

INR 7 - 17 Lacs

Manager - Management Accounting

Pune

Experience: Not specified

INR 5 - 5 Lacs

Java Developer - Immediate Joiner preferred

Pune

3 - 5 yrs

INR 0 - 0 Lacs

Manual Tester

Pune

4 - 7 yrs

INR 7 - 14 Lacs

Business Analyst

Pune

4 - 7 yrs

INR 9 - 16 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.