Senior Data Engineer- Azure Databricks

0 years

0 Lacs

Posted:3 weeks ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Position:

 

Purpose of the Position:

To design, build, and optimize scalable data pipelines and solutions using Azure Databricks and related technologies, to make faster, data-driven decisions as part of its data transformation journey. 

Proficiency in data integration techniques, ETL processes and data pipeline architectures. Well versed in Data Quality rules, principles and implementation. 

 

Location:

 

Type of Employment

 

Key Result Areas and Activities:

  • Data Pipeline Development: Design and implement robust batch and streaming data pipelines using Azure Databricks and Spark. 

  • Data Architecture Implementation: Apply Medallion Architecture to structure data layers (raw, enriched, curated). 

  • Data Quality & Governance: Ensure data accuracy, consistency, and governance using tools like Azure Purview and Unity Catalog. 

  • Performance Optimization: Optimize Spark jobs, Delta Lake tables, and SQL queries for efficiency and cost-effectiveness. 

  • Collaboration & Delivery: Work closely with analysts, architects, and business teams to deliver end-to-end data solutions.

  • Mock Interview

    Practice Video Interview with JobPe AI

    Start Job-Specific Interview
    cta

    Start Your Job Search Today

    Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

    Job Application AI Bot

    Job Application AI Bot

    Apply to 20+ Portals in one click

    Download Now

    Download the Mobile App

    Instantly access job listings, apply easily, and track applications.

    coding practice

    Enhance Your Skills

    Practice coding challenges to boost your skills

    Start Practicing Now
    InfoCepts logo
    InfoCepts

    Business Consulting and Services

    Washington DC VA

    RecommendedJobs for You