Home
Jobs
Companies
Resume

Senior Data Engineer

12.0 years

0 Lacs

Pune, Maharashtra, India

Posted:1 day ago| Platform: Linkedin logo

Apply Now

Skills Required

data support development monitoring compliance reporting cybersecurity metrics engineering pyspark sql test risk design automate etl integration traceability logging integrity collaboration scalability stack pipeline processing agile

Work Mode

On-site

Job Type

Full Time

Job Description

The Data Engineer will support the development and implementation of robust data pipelines to enable DQ rule execution, monitoring, and compliance reporting for cybersecurity metrics. The role demands hands-on experience with data engineering tools and platforms (Data bricks, PySpark, SQL), with a focus on supporting BCBS 239-aligned initiatives under DUSE/DMOV frameworks. Key Responsibilities: Build, test, and deploy scalable DQ rule execution pipelines for cyber risk metrics. Design and automate ETL/ELT jobs to integrate BDEs, DDTs, and metadata from various data sources. Develop integration workflows to stitch technical data fields with BDEs for metric lineage and traceability. Support implementation of DQ rules (~400+) in Data bricks; enable logging to Aurora platform. Ensure data availability, feed integrity, and SLA adherence in collaboration with ITSO and business teams. Optimize performance and scalability of rule execution and exception handling workflows. Collaborate with Data Architects, DQ Analysts, and Cyber SMEs to translate compliance requirements into engineering solutions. Skillsets Required: Overall 12+ years of IT experience with 5+ years of working experience in data engineering with tech. stack Data bricks and Pyspark. Strong proficiency in Data bricks , PySpark, and SQL for large-scale data handling. Experience with ETL/ELT pipeline development, exception logging systems (e.g., Aurora), and distributed data processing. Ability to work in Agile POD structure with cross-functional teams and stakeholders. Show more Show less

More Jobs at PURVIEW

Mainframes CICS Admin

Pune, Maharashtra, India

Experience: Not specified

|

Salary: Not disclosed

Consulting Specialist

Hyderabad, Telangana, India

8 - 8 yrs
|

Salary: Not disclosed

Talend Developer

Coimbatore, Tamil Nadu, India

4.0 - 4.0 yrs
|

Salary: Not disclosed

Senior Consultant Specialist

Pune, Maharashtra, India

Experience: Not specified

|

Salary: Not disclosed

Plex Engineer

Pune, Maharashtra, India

3.0 - 3.0 yrs
|

Salary: Not disclosed

Mock Interview

Boost Confidence & Sharpen Skills

Start Data Interview Now
PURVIEW

8 Jobs

RecommendedJobs for You

Senior Data Engineer

 Wavicle Data Solutions

Chennai, Coimbatore, Bengaluru

Wavicle Data Solutions logo

Senior Data Engineer

 Conviction Hr

Kolkata, Hyderabad, Pune

Conviction Hr logo

Senior Data Engineer

 Qualcomm

Hyderabad

Qualcomm logo

Senior Data Engineer

 SPAN.IO

Bengaluru

SPAN.IO logo

Senior Data Engineer

 Jeavio

Vadodara

Jeavio logo

Senior Data Engineer

 Envestnet

Trivandrum, Kerala, India

Envestnet logo

Senior Data Engineer

 Techblocks

Ahmedabad

Techblocks logo

Senior Data Engineer

 Amgen Inc

Hyderabad

Amgen Inc logo

Senior Data Engineer

 BrightEdge

India

BrightEdge logo

Senior Data Engineer

 Amgen Inc

Hyderabad

Amgen Inc logo