Talent500 logo

Lead Databricks Engineer [T500-30250]

Talent500
Hyderabad

Posted:1 week ago

Apply

Job Description

Talent500 is hiring for one of its clients.

Who are we:

Core Insurance Platforms (CIP) is Zurich’s global capability responsible for building, running, and evolving core insurance technology. We set a unified, scalable operating model—covering governance, standards, architecture, service delivery, and reuse—so our business units can deliver at speed and scale.

CIP is the strategic steward of Zurich’s Guidewire ecosystem, aligning platform roadmaps to business strategy while driving stability, modernization, reduced supplier dependency, and long term cost efficiency.

India delivery center is one of our global delivery and capability hub. We bring together experts in AI, engineering, analysis, quality, and architecture to deliver product & process solutions, application run services, change and transformation initiatives, and centralized platform services across both on prem and Guidewire Cloud environments. Our teams operate from multiple global delivery centers, supporting Zurich’s business units worldwide.


Lead Databricks Engineer

Own Zurich's global SAP strategy & relationship to enable cost-effective model to offer the Group functions and BUs. Operate and implement standard processes in SAP in alignment with our Business Partners.

Drive transformation and deliver services with full accountability from service and application design, delivery and operation, as well as financial responsibility, security and compliance aspects with a single point of entry to our business partners in Group functions or to the business units. Focus on digitalization and automation, as well developing capabilities and managing technology assets to drive value for Zurich.


Why you’ll love working here:

  • Enterprise critical impact

    – Work on platforms that underpin IFRS and Group Reporting across Zurich
  • Platform thinking, not one off fixes

    – Focus on standardization, reuse, and long term operational health
  • AI enabled ways of working

    – AI first engineering, testing, operations, and knowledge management
  • Clear ownership and accountability

    – Well defined service models, KPIs, and decision rights
  • Global collaboration

    – Work with diverse, highly skilled teams across locations and disciplines
  • Ownership culture

    – Trusted to make decisions, solve real problems, and see tangible outcomes

Actuary IT Solutions is the place to do it.


Role Purpose:

scalable, secure, and audit ready data pipelines and analytical workloads


Key Accountabilities:

Databricks Development & Engineering:

  • Design, develop, and maintain

    data pipelines and analytical workloads

    using Databricks.
  • Implement transformations using

    PySpark / Spark SQL

    and Delta Lake.
  • Support end-to-end data flows across

    ingestion, curation, and analytics layers

    .
  • Contribute to the evolution of common

    Databricks development frameworks and standards

    .


Data Quality, Performance & Reliability:

  • Implement robust

    data validation, logging, and error handling

    mechanisms.
  • Optimize workloads for

    performance, scalability, and cost efficiency

    .
  • Ensure pipelines are reliable, recoverable, and observable.


Security, Governance & Audit:

  • Implement and operate

    data governance controls

    using Unity Catalog (access control, lineage, auditability).
  • Ensure solutions comply with

    internal control, segregation of duties, and audit requirements

    .
  • Support traceability of data and results for regulatory and business reviews.


Collaboration & Delivery:

  • Work closely with

    actuarial SMEs, testers, and architects

    to translate requirements into technical solutions.
  • Support SIT, UAT, and release activities by resolving data, performance, or pipeline related issues.
  • Contribute to documentation, technical reviews, and knowledge sharing.


Skills & Experience:

Required Experience:

  • Approximately 5 years of experience

    in data engineering or analytics engineering roles.
  • Handson experience building solutions on

    Databricks

    in enterprise environments.


Technical Skills:

  • Solid coding experience in

    Python (PySpark)

    and

    SQL

    .
  • Experience with

    Delta Lake

    , data modelling, and data transformation patterns.
  • Experience building and operating

    data pipelines

    in cloud environments (Azure or AWS).
  • Familiarity with

    version control and CI/CD

    practices.


Databricks & Platform Knowledge:

  • Experience working with

    Unity Catalog

    or similar data governance frameworks is an advantage.
  • Understanding of performance tuning, cluster usage, and workload optimization.
  • Exposure to actuarial, financial, or risk related data domains is a plus, but not mandatory.


Professional Skills:

  • Strong analytical and problem-solving skills.
  • Structured and quality focused approach to engineering.
  • Effective communicator able to work with technical and nontechnical stakeholders.
  • Open, learning oriented mindset and willingness to continuously improve.


Education:

  • Bachelor’s degree in Computer Science, Engineering, Mathematics, Data Science, or a related field (or equivalent experience).


This role suits an engineer who enjoys Handson development, values data quality and governance, and wants to build reliable Databricks platforms that support critical actuarial and financial processes at scale.

Candidate Data Privacy Notice:

Applicability of This Notice: This

Participation in the Recruitment Process:

The Transferees maintain at least the same level of protection for your data as maintained by Zurich, and do not further transfer/disclose/share or publish your data.

For information on how your personal data is processed by ANSR, including your rights and how to contact the relevant data protection office.


You understand and acknowledge:

  • You have the option not to provide your data (in which case we may not be able to process your application);
  • You have the option to review, correct/amend your data;
  • You have the option to withdraw your consent from processing your data;
  • Your data is retained until the purpose for its collection is served; and
  • Zurich uses reasonable security measures to help protect against the unauthorized access, loss, misuse and alteration of the personal information under our control. However, no method of transmission over the internet, or method of electronic storage, is completely secure.

By submitting your interest in any of our vacancies, you consent to the collection, storage, transfer, disclosure, and processing of your personal information and/or sensitive personal data or information.

Skills Required

Insurance Service Delivery Business Strategy Engineering Analysis SAP Application Design Automation Knowledge Management Financial Reporting Data Ingestion Data Quality Engineering Design

Learn the skills this job asks for

See your skill gap for Data Engineer →

Free courses, interview questions and practice for each skill.

Job Type

Full Time

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
Talent500 logo
Talent500

RecommendedJobs for You