Technical Specialist - Data Engineer

Lanxess

5 - 10 years

7 - 11 Lacs

thane

Posted:2 days ago| Platform:

Apply

Skills Required

data engineer insurance data pipelines auditing sql analytics git data science spark devops xml json azure crm data formats chemistry rest python erp sap data security ai life insurance pandas apis data governance

Work Mode

Work from Office

Job Type

Full Time

Job Description

Job Highlights

Design, build, and operate secure, transparent data pipelinesmoving and transforming data fromSAP BW/ERP, OSIsoft PI, Dynamics CRM, web APIs, SFTP, and file shares to drive analytics and AI initiatives.
Develop scalable batch and streaming processes using PySpark, working in environments like Azure Synapse.
Build, test, and deploy CI/CD workflows for data pipelines (using Git, Azure DevOps, DataLake, ADF, Synapse Pipelines).
Maintain documentation, unit tests, and code reviews for robustness and maintainability.
Harmonize different data formats and sourcesincluding Parquet, CSV, JSON, XML, time series, andclassic relational structures.
Set up robust security structures (user/role-based permissions, auditing) in line with best practices andregulatory standards (EU AI Act, German requirements).
Collaborate closely with data scientists and business users to provision and preprocess data,translating business requirements into reliable datasets.

Experience and Skills

Education : Bachelor of Engineering (CS / IT / Data Science)

Required Technical skill set -

Python, Spark, Pandas, SQL, REST API.
Azure Data Factory, Synapse Pipelines, DataLake, Azure DevOps, Git.
Data Governance, Data Security, Pipeline Monitoring, Operational Dashboards.
SAP Cloud, SAP R3, SAP S4.

More Jobs at Lanxess

Deputy Manager - Microbiology Lab & TM

Thane

5.0 - 10.0 yrs

INR 7 - 12 Lacs

Senior AI Engineer

Thane

3.0 - 5.0 yrs

INR 5 - 7 Lacs

Sr Sales Manager India

Thane

6.0 - 11.0 yrs

INR 8 - 13 Lacs

Senior Officer - Treasury

Thane

5.0 - 10.0 yrs

INR 7 - 12 Lacs

Associate Analyst - SAP Data Engineer

Thane

1.0 - 3.0 yrs

INR 4 - 8 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Data Engineer Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.