Senior Data Engineer (Azure / PySpark)

5 years

0 Lacs

Posted:2 days ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

About the Role

We are seeking a highly skilled and client-oriented

Senior Data Engineer

with proven expertise in

PySpark, Python, and Azure data services

. In this role, you will design and implement robust, scalable data solutions while collaborating closely with both technical teams and business stakeholders. You will play a key part in delivering high-quality, high-performance data pipelines and solutions that directly support client needs.

Key Responsibilities

  • scalable ETL pipelines

  • Work closely with clients to gather requirements, present solutions, and ensure deliverables align with business goals.

  • performance, scalability, and cost-efficiency

  • Ensure data quality through validation checks, monitoring, and automated alerts.

  • Collaborate with cross-functional teams, including data scientists, BI developers, and business analysts.

  • Create and maintain comprehensive documentation for data pipelines, architecture, and processes.

  • Support pre-sales or solutioning discussions by providing technical insights.

Requirements

Required Qualifications

  • Bachelor’s degree in Computer Science, Data Science, or a related technical field.

  • 5+ years

  • PySpark

  • Python

  • Azure

  • ETL design patterns, data modeling, and data warehousing

  • clients or business stakeholders

Preferred Skills

  • CI/CD experience with Azure DevOps or similar tools.

  • Familiarity with Delta Lake, data governance, and security best practices.

  • Exposure to performance tuning for Spark jobs and Azure pipelines.

Soft Skills

  • Excellent communication skills for both technical and non-technical audiences.

  • Strong problem-solving and analytical abilities.

  • Ability to work independently and collaboratively in a fast-paced environment.

Benefits
Competitive salary based on experience.Statutory benefits and performance incentives.

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You

Bangalore North Rural, Karnataka, India

Bangalore North Rural, Karnataka, India