Pyspark, AWS

8 - 12 years

0 Lacs

Posted:3 days ago| Platform: SimplyHired logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Job Summary

We are seeking a highly skilled Sr. Developer with 8 to 12 years of experience in Big Data and AWS technologies. The ideal candidate will work in a hybrid model utilizing their expertise in AWS EC2 AWS EMR Amazon S3 Apache Spark and Python to drive innovative solutions. This role offers the opportunity to make a significant impact on our projects and contribute to the companys success.


Responsibilities

  • Develop and implement scalable big data solutions using AWS EC2 AWS EMR and Amazon S3 to enhance data processing capabilities.
  • Collaborate with cross-functional teams to design and optimize data pipelines ensuring efficient data flow and storage.
  • Utilize Apache Spark to perform complex data transformations and analytics delivering actionable insights for business decisions.
  • Write and maintain high-quality Python code to automate data processing tasks and improve system performance.
  • Monitor and troubleshoot data processing workflows ensuring reliability and accuracy of data outputs.
  • Participate in code reviews and provide constructive feedback to peers fostering a culture of continuous improvement.
  • Stay updated with the latest industry trends and technologies applying new knowledge to enhance existing systems.
  • Ensure data security and compliance with industry standards protecting sensitive information and maintaining trust.
  • Contribute to the development of best practices and standards for big data processing and cloud computing.
  • Provide technical guidance and support to junior developers sharing expertise and promoting skill development.
  • Collaborate with stakeholders to understand business requirements and translate them into technical solutions.
  • Optimize resource utilization on AWS platforms reducing costs and improving system efficiency.
  • Document technical specifications and project progress ensuring clear communication and alignment with project goals.


Qualifications

  • Possess a strong understanding of big data technologies and cloud computing particularly AWS services.
  • Demonstrate proficiency in Apache Spark and Python with a proven track record of successful project implementations.
  • Exhibit excellent problem-solving skills and the ability to work independently in a hybrid work model.
  • Show experience in designing and optimizing data pipelines for large-scale data processing.
  • Have a keen eye for detail and a commitment to delivering high-quality results.
  • Display effective communication skills both written and verbal to collaborate with diverse teams.


Certifications Required

AWS Certified Big Data Specialty Apache Spark Developer Certification

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Cognizant logo
Cognizant

IT Services and IT Consulting

Teaneck New Jersey

RecommendedJobs for You

hyderabad, telangana

chennai, tamil nadu

hyderabad, telangana

chennai, tamil nadu