Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Home
>
Jobs in greater kolkata area
>
Talent Worx
>
Pyspark Architect

Pyspark Architect

Talent Worx

7 - 13 years

0 Lacs

greater kolkata area

Posted:1 month ago| Platform:

Apply

Skills Required

pyspark data aws teradata scala visualization processing leadership engineering design scalability hadoop tableau power reporting architecture redshift technology communication management certification devops code recruitment consulting analytics ai cutting drive

Work Mode

On-site

Job Type

Full Time

Job Description

Job Description: PySpark Architect
Location: Bangalore,Pune,KolkataExperience Required: 7 to 13 YearsRole Overview:We are seeking a highly skilled and motivated PySpark Manager to lead our dataengineering initiatives. The ideal candidate will have deep expertise in PySpark,Hadoop, AWS, Teradata, Scala, and data visualization tools. You will be responsible fordesigning, building, and managing large-scale data processing solutions while leading ateam of data engineers to deliver high-quality outcomes.Key Responsibilities:

Leadership & Team Management:
Lead and mentor a team of data engineers, ensuring high performance and

professional growth.

Oversee project timelines, quality, and deliverables for multiple data initiatives
Data Engineering & Development:
Design and implement robust data pipelines and workflows using PySpark and

Hadoop.

Optimize performance and scalability of big data solutions for complex data sets
Develop and integrate solutions with AWS services for cloud-based data processing
Technical Expertise:
Leverage expertise in PySpark, Hadoop, and Scala to solve complex technical

challenges.

Work with Teradata for large-scale data warehousing solutions
Utilize data visualization tools (e.g., Tableau, Power BI) to provide insights and

reporting solutions.

Stakeholder Collaboration:
Collaborate with cross-functional teams, including business stakeholders and product

managers, to understand requirements and deliver solutions.

Provide thought leadership on best practices in big data technologies and architecture

Required Skills & Qualifications:

Technical Expertise:
Proficiency in PySpark, Hadoop, AWS (S3, Glue, EMR, Redshift), and Teradata
Hands-on experience with Scala for data engineering tasks
Familiarity with data visualization tools like Tableau, Power BI, or similar platforms
Experience:
7-13 years of experience in data engineering, with a focus on big data technologies
Proven track record of managing end-to-end data engineering projects and leading

teams.

Educational Background:
Bachelor's or Master's degree in Computer Science, Information Technology, or a

related field.

Soft Skills:
Strong analytical and problem-solving skills
Excellent communication and stakeholder management abilities
Ability to work in a fast-paced, dynamic environment

Preferred Skills:

Certification in AWS or related big data tools
Experience in real-time data streaming platforms like Kafka
Knowledge of DevOps practices, including CI/CD pipelines and infrastructure as code

Requirements

Talent Worx is a growing services & recruitment consulting firm, we are hiring for our client which is a Global and leading provider of financial intelligence, data analytics, and AI-driven solutions, empowering businesses worldwide with insights for confident decision-making. Join to work on cutting-edge technologies, drive digital transformation, and shape the future of global markets.

More Jobs at Talent Worx

Python Data Engineer

Hyderabad, Telangana, India

5 - 8 yrs

Salary: Not disclosed

PLSQL Developer

Hyderabad, Telangana, India

5 - 8 yrs

Salary: Not disclosed

Site Leader - Talent Acquisition Delivery

Jaipur, Rajasthan, India

5 - 8 yrs

Salary: Not disclosed

Python Developer

Hyderabad, Telangana, India

5 - 8 yrs

Salary: Not disclosed

SAP ABAP Developer - Sr. Consultant

Greater Kolkata Area

2 - 5 yrs

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now

Talent Worx

Login to

Please Verify Your Phone or Email

Confirm Action

Pyspark Architect