Azure Data Engineer

Role & responsibilities

Preferred candidate profile

Job Summary:

Key Responsibilities:

•      Design, build, and maintain data ingestion, transformation, and integration pipelines using Azure Data Factory (ADF), Databricks, and Azure Synapse Analytics.

•      Develop scalable ETL/ELT processes to extract and transform structured and semi-structured data (JSON, CSV, Parquet) from diverse data sources.

•      Write complex SQL queries, stored procedures, and performance tuning scripts for data validation, cleansing, and reporting.

•      Utilize Python to automate data workflows, implement data quality checks, and optimize data processing tasks.

•      Collaborate with business analysts, data architects, and insurance domain experts to translate functional requirements into efficient data solutions.

•      Implement data governance, lineage, and security best practices across Azure environments.

•      Support data migration and modernization initiatives for legacy insurance data systems into Azure.

•      Leverage knowledge of P&C Insurance data domains such as policy, claims, underwriting, and reinsurance to design business-ready data models.

•      Participate in Agile/Scrum ceremonies, ensuring timely delivery of project milestones.

Required Skills & Qualifications:

•      8+ years of hands-on experience in Data Engineering and Analytics.

•      5+ years of experience working with Microsoft Azure Data Services (ADF, Synapse, Data Lake, Databricks).

•      Proficiency in SQL development and optimization across large datasets.

•      Strong experience with Python scripting for ETL, API integration, and data processing.

•      Experience working with JSON and semi-structured data within Azure and cloud environments.

•      Proven experience in P&C Insurance domain (policy, claims, premium, underwriting data).

•      Strong understanding of data architecture, pipelines, and data warehousing concepts.

•      Familiarity with Azure DevOps, Git, and CI/CD pipelines for data deployments.

•      Excellent problem-solving, analytical, and communication skills.

Preferred Qualifications:

•      Bachelors or Master’s degree in Computer Science, Information Systems, or related field.

•      Experience with Power BI or other BI tools for data visualization.

•      Exposure to Azure Purview, DataBricks Delta Lake, or Fabric is a plus.

• •      Prior experience working in an Agile environment with insurance or financial services clients.