Azure Data Architect

Dear Candidates,

Data Architect

Job Summary:

Data Architect

Key Responsibilities:

• Design and implement

  ELT pipelines

  using modern frameworks and tools.
• Develop

  metadata-driven data pipelines

  to promote reusability and standardization.
• Work with

  Azure Data Lake Storage Gen2 (ADLS Gen2), Azure Databricks, Azure Data Factory

  for scalable, cost-effective storage solutions.
• Implement

  Medallion Architecture (Bronze, Silver, Gold layers)

  to support enterprise-grade data processing and analytics.
• Drive the adoption and implementation of the

  Lakehouse architecture

  to modernize legacy data platforms.
• Develop scalable data transformation logic using

  PySpark

  , with a solid understanding of

  actions and transformations

  .
• Design and optimize data workflows based on

  Directed Acyclic Graph (DAG)

  concepts and

  Spark architecture

  .
• Ensure

  non-functional requirements (NFRs)

  such as performance, scalability, availability, and security are addressed in the data platform design.
• Leverage the

  Azure Well-Architected Framework (WAF)

  to ensure best practices in cloud-native architecture and operations.
• Implement robust

  exception handling, logging, and data reconciliation

  mechanisms for end-to-end data reliability and observability.

Required Skills & Qualifications:

• Strong hands-on experience in

  ELT pipeline design and implementation

• Experience with

  metadata-driven pipeline development

• Experience of

  Azure Data Lake Storage Gen2, Azure Databricks, Azure Data Factory

• Proven experience in implementing

  Medallion and Lakehouse architectures

• Strong command over

  PySpark

  and understanding of its internals, including actions, transformations, and DAG execution
• Deep understanding of

  Spark architecture

• Familiarity with

  non-functional architecture requirements

  and associated benchmarks
• Practical experience adopting

  Azure Well-Architected Framework (WAF)

• Hands-on experience with

  logging, exception handling

  , and

  data reconciliation

  in production-grade systems

Thanks & Regards

AJAY KUMAR

Email: Ajay.Kumar@winfort.net