PYSPARK+GCP

0 years

5 - 6 Lacs

Posted:3 days ago| Platform: GlassDoor logo

Apply

Work Mode

On-site

Job Type

Part Time

Job Description

Job Summary

The Sr. Developer role is pivotal in driving the success of our data-driven projects. With a focus on Big Data and AWS technologies the candidate will design and implement scalable solutions. This hybrid role requires expertise in Apache Spark and Python ensuring efficient data processing and storage. The position offers a dynamic work environment with a day shift schedule contributing significantly to our companys innovation and impact.


Responsibilities

  • Develop and implement scalable data processing solutions using Big Data technologies to enhance data-driven decision-making.
  • Collaborate with cross-functional teams to design and optimize data architectures on AWS EC2 and AWS EMR platforms.
  • Utilize Amazon S3 for efficient data storage and retrieval ensuring data integrity and accessibility.
  • Leverage Apache Spark to process large datasets improving data analysis and reporting capabilities.
  • Write and maintain Python scripts for data manipulation and automation streamlining workflows and increasing productivity.
  • Monitor and troubleshoot data pipelines to ensure seamless data flow and minimize downtime.
  • Conduct code reviews and provide constructive feedback to peers fostering a culture of continuous improvement.
  • Stay updated with the latest industry trends and technologies to propose innovative solutions and maintain a competitive edge.
  • Ensure compliance with data security and privacy regulations safeguarding sensitive information.
  • Document technical specifications and processes to facilitate knowledge sharing and onboarding of new team members.
  • Participate in agile development processes contributing to sprint planning and retrospective meetings.
  • Provide technical guidance and mentorship to junior developers enhancing team capabilities and performance.
  • Collaborate with stakeholders to gather requirements and translate them into technical specifications aligning with business objectives.


Qualifications

  • Possess a strong background in Big Data technologies with hands-on experience in AWS EC2 and AWS EMR.
  • Demonstrate proficiency in Amazon S3 for data storage solutions.
  • Have extensive experience with Apache Spark for data processing tasks.
  • Exhibit advanced skills in Python programming for data manipulation and automation.
  • Show a proven track record of developing scalable data processing solutions.
  • Display excellent problem-solving abilities and attention to detail.
  • Have a solid understanding of data security and privacy regulations.


Certifications Required

AWS Certified Big Data - Specialty Apache Spark Developer Certification

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Cognizant logo
Cognizant

IT Services and IT Consulting

Teaneck New Jersey

RecommendedJobs for You