Senior Analyst

Role Overview:

Key Responsibilities:

• Design, build, and deploy

  scalable ETL/ELT pipelines

  using

  Databricks

  ,

  ADF

  , and

  Fabric Data Pipelines

  .
• Write production-grade

  PySpark and SQL

  code for transformation, cleansing, and data validation.
• Develop

  parameterized, reusable pipeline components

  and

  modular notebooks

  .
• Integrate and orchestrate data workflows using

  ADF pipelines and triggers

  .
• Contribute to

  data modeling

  (bronze, silver, gold) using

  Delta Lake and Fabric Lakehouse

  .
• Implement and monitor

  CI/CD pipelines

  with

  Azure DevOps

  and Git.
• Debug data quality and performance issues proactively.

Skills & Qualifications:

• 36 years of experience as a

  data developer or engineer

  in cloud environments.
• Strong hands-on experience with:

  • PySpark, SQL, and Python

    (coding and optimization)

  • Databricks

    ,

    ADF

    ,

    ADLS Gen2

    ,

    Fabric Dataflows

• Solid understanding of

  ETL/ELT design

  , data modeling, and pipeline orchestration.
• Familiar with

  DevOps (YAML pipelines, Git branching)

  and

  Agile sprints

  .
• Experience with

  GCP BigQuery, Dataflow, Composer

  , or hybrid multi-cloud setups.

Preferred Certifications:

• Databricks Certified Data Engineer Associate

• Microsoft Certified: Fabric Analytics Engineer Associate (DP-600)

• Microsoft Certified: Azure Data Engineer Associate (DP-203)