Senior Expert (Azure Data)

Role & responsibilities

Key Responsibilities

• Design and implement robust ETL/ELT pipelines using Azure Data Factory, SSIS, and Databricks.
• Integrate data from diverse sources including on-premises databases, cloud platforms, APIs, and flat files.
• Develop and optimize data models for Azure SQL Database, Synapse Analytics, and Data Lake Storage Gen2.
• Architect scalable and secure data storage solutions using Azure Blob Storage and Data Lake.
• Tune data workflows and clusters for performance, reliability, and cost-efficiency.
• Monitor and troubleshoot data pipelines using Azure Monitor and Log Analytics.
• Work closely with business teams to understand data requirements.
• Translate business needs into technical solutions and ensure alignment with enterprise architecture.
• Implement data security, encryption, and role-based access control (RBAC).
• Ensure compliance with internal policies and external regulations (e.g., GDPR, HIPAA).
• Document data flows, pipeline logic, and integration points.
• Mentor junior engineers and enforce best practices in data engineering.

Preferred candidate profile

• 10+ years of experience in data engineering, with a strong focus on ETL development.
• Expert-level proficiency in:

• Azure Data Factory

  ,

  Databricks

  ,

  Azure SQL

  ,

  Azure Synapse Analytics, Power BI

• Python

  ,

  PySpark

  ,

  SQL

  ,

  SSIS

• Solid understanding of data warehousing concepts, star/snowflake schema, and dimensional modelling.
• Experience with CI/CD pipelines using

  Azure DevOps

  or

  GitHub Actions

  .
• Familiarity with big data technologies (Spark, Hadoop) and orchestration tools .