Senior Data Engineer

5 years

0 Lacs

Posted:17 hours ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

About the Project:

.


What You'll Do (Responsibilities):

As a Senior Data Governance & Platform Engineer, you will be a hands-on contributor across all facets of the project, specifically leading the implementation of master data and quality frameworks:

  • Platform Foundations (Reference Architecture & DataOps):

    Collaborate on the design and implementation of a consolidated EDP reference architecture. You will be responsible for building out and hardening the platform’s core components using Azure Synapse, Azure Databricks, and Azure Data Lake Storage (ADLS). You will help define and implement a DataOps model, including CI/CD pipelines, environments, and observability.


  • Master Data Management (MDM) & Quality Leadership (NEW FOCUS):

MDM Solutioning:

Data Quality Automation:

Data Quality Scorecards:


  • Data Governance & Catalog:

    Support the operationalization of the full data governance framework. This includes implementing data classification policies, setting up data quality scorecards, and configuring the data catalog with ownership and lineage in a tool like Azure Purview.
  • Data Security & Access:

    Implement fine-grained access controls using patterns like Row-Level Security and Column-Level Security. You'll help design and apply a security model using Azure Entra ID groups and implement policy-as-code to protect PII.
  • Data Product Pipeline Factory:

    Build and maintain scalable and repeatable data pipelines to ingest, transform, and publish data from various sources. You will work on creating a standardized framework for data products, ensuring observability and adherence to established

    MDM and DQ standards.

  • Data Literacy & Change Management:

    Contribute to the enablement of data stewards, engineers, and analysts by providing practical, role-based training anchored to the data products and governance frameworks you build.


What We're Looking For (Required Skills & Experience):

We are seeking hands-on data engineers with a passion for building robust, well-governed, and secure data platforms. A strong candidate for this team will have:

  • Deep Azure Data Services Expertise:

    Proven, hands-on experience with the Azure data ecosystem: Azure Synapse Analytics, Azure Databricks, Azure Data Lake Storage (ADLS), and Azure Purview. Experience with Unity Catalog is highly desirable.


  • MDM & Data Quality Specialization:

Master Data Management:

Data Quality Analyst Skills:


  • Data Engineering Fundamentals:

    Strong background in data modeling (Dimensional, 3NF), ETL/ELT processes, and building scalable data pipelines for batch and streaming data. Knowledge of data warehousing and lakehouse architectures.
  • Programming & Scripting:

    Proficiency in

    Python and PySpark is essential

    for data transformation and pipeline development in Azure Databricks. Strong SQL skills are also required.
  • DevOps & CI/CD:

    Experience with DataOps principles, including setting up and maintaining CI/CD pipelines using tools like Azure DevOps or GitHub Actions. Familiarity with managing environments and infrastructure as code is a strong plus.
  • Data Governance & Security:

    Practical experience or a solid understanding of data governance concepts, including data quality, lineage, metadata management, and access control models (RBAC/ABAC).


Qualifications:

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • 5+ years

    of progressive experience in a data engineering or data governance focused role.
  • Excellent problem-solving, analytical, and communication skills.
  • Demonstrated ability to work effectively in a collaborative and fast-paced environment.

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You

mumbai, maharashtra, india

chennai, tamil nadu, india