Software Engineer

Job Title: Senior Python Pyspark Data Engineer

Experience: 8+ Years

Employment Type: Full-Time, Permanent

Location- Pune/ Bangalore/ Indore

About the Role :-

We are looking for a Senior Python PySpark Data Engineer to design, develop, and maintain

scalable data pipelines and applications in a fast-paced, cloud-first environment. You will

build end-to-end data solutions using Python, PySpark, and Azure cloud services,

contributing to architecture, performance optimization, and code quality.

This role offers an opportunity to work on modern data platforms including Databricks and

Azure Data Factory (ADF), collaborating with cross-functional teams to deliver

high-performance, production-grade data solutions.

Key Responsibilities :-

● Design, develop, and maintain robust, scalable data pipelines using Python and

PySpark.

● Build end-to-end data solutions from scratch with modular, maintainable, and

reusable code.

● Write and optimize complex SQL queries for large-scale data processing and

validation.

● Develop dynamic, reusable frameworks and implement design patterns for scalability

and performance.

● Refactor legacy codebases to improve performance, reliability, and maintainability.

● Collaborate with data engineers, analysts, and business stakeholders to translate

requirements into technical solutions.

● Orchestrate workflows and automate pipelines using Databricks and Azure Data

Factory (ADF).

● Drive best practices in code reviews, deployment automation, and performance

tuning.

● Stay current with emerging tools and contribute to continuous improvement

initiatives.

Must-Have Skills & Qualifications :-

● Hands-on experience in software/data engineering.

● Strong expertise in Core Python and PySpark development.

● Proficient in SQL, with experience handling large datasets.

● Hands-on experience with Azure Cloud Data Services.

● Experience with Databricks and Azure Data Factory (ADF).

● Solid understanding of data structures, design patterns, and scalable architectures.

● Expertise in performance optimization, debugging, and automation.

● Exposure to other cloud platforms (AWS/GCP) is a plus.

● Bachelor’s degree in Computer Science, Engineering, or related field.

● Strong problem-solving mindset with ability to deliver end-to-end solutions.

Why You’ll Love This Role :-

● Freedom to build scalable data systems from the ground up.

● Work with modern cloud technologies: Azure, Databricks, ADF.

● Collaborate with a team that values innovation, clean engineering, and

problem-solving.

● Influence architecture and design decisions for enterprise-level solutions.

● Fast-paced, learning-driven environment where your ideas are implemented.

If Intrested. Please submit your CV to aman_sariyam@sourcebae.com

Stay updated with our latest job opportunities and company news by following us on LinkedIn: :https://www.linkedin.com/company/sourcebae