Python Pyspark Azure professional

Virtusa

7 - 9 years

4 - 8 Lacs

hyderabad

Posted:2 days ago| Platform:

Apply

Skills Required

python data pipelines pyspark databricks cloud platforms data quality apache spark gcp apache spark troubleshooting aws etl azure

Work Mode

Work from Office

Job Type

Full Time

Job Description

We are seeking a highly skilled and experienced Consultant to join our team
In this role, you will be responsible for designing and developing robust data pipelines using Python, Apache Spark on Databricks
You will also be responsible for optimizing and troubleshooting existing pipelines for performance and reliability
As a Consultant, you will collaborate with data scientists and analysts to understand their requirements and ensure data quality, integrity, and security across various sources
Additionally, you will implement ETL processes and integrate with cloud platforms such as Azure, AWS, and GCP
Other responsibilities include maintaining and monitoring Databricks clusters and notebooks, documenting technical specifications and pipeline workflows, and staying updated on Databricks features and best practices
The ideal candidate will have at least 7 years of experience in a similar role and will work from our Virtusa office
If you are a self-motivated and detail-oriented individual with a passion for data and technology, we would love to hear from you.

More Jobs at Virtusa

Servicenow QA

Bengaluru, Karnataka

3 - 3 yrs

Salary: Not disclosed

React T3

Bengaluru, Karnataka

Experience: Not specified

Salary: Not disclosed

Java-Pankaj

Bengaluru, Karnataka

Experience: Not specified

Salary: Not disclosed

C ++

Bengaluru, Karnataka

Experience: Not specified

Salary: Not disclosed

Java Architect (ATC)

Bengaluru, Karnataka

Experience: Not specified

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.