Pyspark + Databricks

6 - 10 years

0 Lacs

Posted:3 days ago| Platform: SimplyHired logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Job Summary

We are seeking a highly skilled Sr. Developer with 6 to 10 years of experience to join our team. The ideal candidate will have expertise in Databricks SQL Databricks Workflows and PySpark. Experience in the Cards & Payments domain is a plus. This is a hybrid work model with day shifts and no travel required.


Responsibilities

  • Develop and maintain scalable data pipelines using Databricks SQL and Databricks Workflows.
  • Implement and optimize PySpark code for data processing and analytics.
  • Collaborate with cross-functional teams to understand data requirements and deliver solutions.
  • Ensure data quality and integrity through rigorous testing and validation.
  • Provide technical guidance and support to junior developers.
  • Monitor and troubleshoot data pipeline performance and resolve issues promptly.
  • Participate in code reviews to maintain high coding standards.
  • Stay updated with the latest industry trends and technologies in data engineering.
  • Contribute to the continuous improvement of development processes and best practices.
  • Document technical specifications and maintain comprehensive project documentation.
  • Work closely with stakeholders to gather requirements and provide timely updates on project progress.
  • Utilize domain knowledge in Cards & Payments to enhance data solutions.
  • Ensure compliance with data security and privacy regulations.


Qualifications

  • Possess strong expertise in Databricks SQL and Databricks Workflows.
  • Demonstrate proficiency in PySpark for data processing and analytics.
  • Have experience in developing and maintaining scalable data pipelines.
  • Show ability to collaborate effectively with cross-functional teams.
  • Exhibit strong problem-solving skills and attention to detail.
  • Have knowledge of data quality and validation techniques.
  • Possess excellent communication and documentation skills.
  • Experience in the Cards & Payments domain is a plus.
  • Familiarity with data security and privacy regulations is desirable.
  • Ability to work in a hybrid work model with day shifts.
  • Minimum of 6 years and maximum of 10 years of relevant experience.
  • Bachelors degree in Computer Science Engineering or a related field is preferred.
  • Strong commitment to continuous learning and professional development.

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
Cognizant logo
Cognizant

IT Services and IT Consulting

Teaneck New Jersey

RecommendedJobs for You