Cognizant logo

Software Engineer - Pyspark

5 - 9 years

0 Lacs

chennai tamil nadu

Posted:1 week ago| Platform: Shine logo

Apply

Skills Required

data security compliance troubleshooting technical documentation apache spark pyspark aws ec2 aws emr pyspark frameworks python programming code reviews spark optimization techniques

Work Mode

On-site

Job Type

Full Time

Job Description

As a Pyspark Developer at our company, you will be responsible for optimizing Pyspark applications to improve performance and resource utilization, ensuring efficient data processing and analysis. Your key responsibilities will include: - Developing and maintaining scalable solutions using AWS EC2 and AWS EMR to support business needs and data-driven decision-making. - Implementing PySpark frameworks to process large datasets, enhancing data accessibility and insights for stakeholders. - Collaborating with cross-functional teams to design and deploy robust data pipelines, ensuring seamless integration with existing systems. - Utilizing Python programming to automate tasks and streamline workflows, contributing to increased productivity and reduced operational costs. - Ensuring data security and compliance with industry standards, safeguarding sensitive information and maintaining trust with clients. - Troubleshooting and resolving technical issues related to Pyspark and AWS environments, minimizing downtime and optimizing system performance. - Participating in code reviews and providing constructive feedback to peers, fostering a culture of continuous improvement and innovation. - Documenting technical processes and solutions, creating comprehensive guides for future reference and knowledge sharing. - Staying updated with the latest advancements in PSpark and AWS technologies, applying new techniques to enhance project outcomes. - Engaging in collaborative problem-solving sessions, contributing to the development of creative solutions for complex challenges. - Supporting the team in achieving project milestones and deliverables, ensuring alignment with organizational goals and objectives. Qualifications: - Demonstrate proficiency in Spark Optimization techniques showcasing the ability to enhance data processing efficiency. - Exhibit strong experience with AWS EC2 and AWS EMR highlighting expertise in cloud-based solutions and infrastructure management. - Possess advanced skills in Apache Spark demonstrating capability in handling large-scale data processing tasks. - Showcase expertise in Python programming emphasizing the ability to automate processes and develop efficient solutions. - Display a minimum of 5 years of relevant experience ensuring a solid foundation in technical and domain skills. - Present a maximum of 8 years of experience indicating a balance of expertise and adaptability in evolving technologies.,

More Jobs at Cognizant

Workday: Walk-in drive 10th May Pune with CTS(Full time)

Pune, Mumbai (All Areas)

3 - 8 yrs
|

INR 7 - 17 Lacs

Java Full Stack Developer

Chennai

5 - 10 yrs
|

INR 10 - 20 Lacs

Walkin For Freshers @hyderabad

Hyderabad

Experience: Not specified

|

INR 0 - 2 Lacs

React JS Developer

Hyderabad

2 - 7 yrs
|

INR 9 - 14 Lacs

Java Developer

Bengaluru

5 - 10 yrs
|

INR 15 - 30 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Google Play App Store
coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
Cognizant logo
Cognizant

IT Services and IT Consulting

Teaneck New Jersey

RecommendedJobs for You

Cognizant logo

Software Engineer - Pyspark

Cognizant

chennai, tamil nadu

Cognizant logo

Software Engineer - Pyspark

Cognizant

chennai, tamil nadu