Python PySpark Data Engineer

Infobeans

6 - 11 years

6 - 10 Lacs

indore nagar pune

Posted:2 days ago| Platform:

Apply

Skills Required

python pyspark microsoft azure data engineering sql hive oracle sql queries performance tuning data validation cloud platforms azure data factory data bricks gcp spark design patterns oracle adf data structures data transformation hadoop sqoop aws

Work Mode

Work from Office

Job Type

Full Time

Job Description

What will your role look like

Design, develop, and maintain robust data pipelines and applications using Python and PySpark.
Build end-to-end data solutions from scratch, ensuring clean, modular, and reusable code.
Write and optimize complex SQL queries for data transformation, validation, and analytics.
Develop scalable, reusable frameworks following best practices in coding and architecture.
Refactor existing codebases to improve performance and maintainability.
Collaborate with data engineers, analysts, and stakeholders to deliver efficient and impactful solutions.
Utilize Databricks and Azure Data Factory (ADF) to orchestrate and automate data workflows.
Contribute to code reviews, performance tuning, and ensure adherence to development standards.

Why you will love this role

Youll have the opportunity to build solutions from the ground up and shape scalable data products.
Youll work hands-on with modern technologies like Databricks, ADF, and Azure.
Youll collaborate with a talented, cross-functional team that values clean code and innovative thinking.
Youll grow your expertise in data engineering best practices and cloud platforms.
Youll be part of an environment that encourages continuous learning and ownership.

We would like you to bring along

5+ years of hands-on experience in software or data engineering with a strong focus on Python and PySpark.
Proven experience developing Python applications from scratch with modular and reusable code.
Proficiency in SQL and experience working with large, complex datasets.
Good understanding of data structures, design patterns, and scalable architecture.
Hands-on experience with Databricks and Azure Data Factory (ADF).
Knowledge of cloud platforms such as Azure, AWS, or GCP is a plus.
Strong problem-solving skills with a solution-oriented and analytical mindset.
A Bachelors degree in Computer Science, Engineering, or a related field.

More Jobs at Infobeans

Software Engineer (Backend Developer)

Chennai, Indore, Hyderabad

5 - 10 yrs

INR 20 - 30 Lacs

SAP EWM Support Consultant

Chennai

3 - 8 yrs

INR 10 - 20 Lacs

Webmethods Developer

Chennai

7 - 12 yrs

INR 20 - 30 Lacs

Tableau Developer

Pune

4 - 6 yrs

INR 10 - 18 Lacs

Senior Salesforce Developer

Indore, Pune, Chennai

3 - 8 yrs

INR 10 - 20 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.