Pyspark Architect

ICONIUM CONSULTING GROUP(INDIA) (P) LTD

5 - 8 years

12 - 16 Lacs

pune chennai bengaluru

Posted:3 days ago| Platform:

Apply

Skills Required

hive microsoft azure solution design hadoop big data python scala oozie data warehousing apache pig data architecture machine learning sql nosql java mapreduce data modeling kafka sqoop hbase

Work Mode

Work from Office

Job Type

Full Time

Job Description

We are looking for a skilled PySpark Architect with 8 to 13 years of experience to join our team in India. The ideal candidate will have a strong background in designing and implementing scalable data processing architectures using PySpark.

Roles and Responsibility

Design and develop scalable data processing architectures using PySpark.
Collaborate with cross-functional teams to identify business requirements and design solutions.
Develop and maintain large-scale data pipelines using PySpark.
Ensure high-quality data processing and analysis by implementing robust testing and validation frameworks.
Optimize data processing workflows for performance, scalability, and reliability.
Mentor junior team members to improve their skills and knowledge.

Job Requirements

Strong experience in designing and implementing scalable data processing architectures using PySpark.
Excellent understanding of big data technologies such as Hadoop and Spark.
Experience with cloud-based platforms such as AWS or Azure is desirable.
Strong problem-solving skills and attention to detail.
Ability to work collaboratively in a team environment.
Excellent communication and interpersonal skills.

More Jobs at ICONIUM CONSULTING GROUP(INDIA) (P) LTD

Senior Informatica Developer

pune, chennai, bengaluru

5.0 - 9.0 yrs

INR 6 - 10 Lacs

Sitecore CMS Professional

pune, chennai, bengaluru

6.0 - 8.0 yrs

INR 7 - 11 Lacs

React JS - Architect

hyderabad, pune, bengaluru

8.0 - 13.0 yrs

INR 12 - 16 Lacs

Python - Team Lead

pune, chennai, bengaluru

6.0 - 8.0 yrs

INR 5 - 9 Lacs

RPA Automation Developer

pune, chennai, bengaluru

5.0 - 9.0 yrs

INR 6 - 10 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Big Data Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.