Databricks + Pyspark - AIA

6 - 9 years

0 Lacs

Posted:2 weeks ago| Platform: GlassDoor logo

Apply

Work Mode

On-site

Job Type

Part Time

Job Description

Job Summary

We are seeking a highly skilled Sr. Developer with 6 to 9 years of experience to join our dynamic team. The ideal candidate will have expertise in Delta Live Pipelines Python Databricks SQL Databricks Workflows and PySpark. This hybrid role involves working on cutting-edge projects that drive innovation and efficiency. The position is based on a day shift schedule with no travel requirements.


Responsibilities

  • Develop and implement robust data solutions using Delta Live Pipelines to enhance data processing capabilities.
  • Collaborate with cross-functional teams to design and optimize Databricks SQL queries for improved performance.
  • Utilize Python to automate data workflows and streamline processes ensuring high-quality data management.
  • Oversee the deployment and maintenance of Databricks Workflows to support seamless data integration.
  • Leverage PySpark to process large datasets efficiently contributing to data-driven decision-making.
  • Ensure data accuracy and integrity by implementing best practices in data engineering and management.
  • Provide technical guidance and support to junior developers fostering a collaborative team environment.
  • Conduct regular code reviews to maintain high standards of code quality and performance.
  • Identify and resolve technical issues promptly to minimize disruptions in data operations.
  • Stay updated with the latest industry trends and technologies to continuously improve data solutions.
  • Document processes and solutions to facilitate knowledge sharing and team collaboration.
  • Engage in continuous learning to enhance skills and contribute to innovative solutions.
  • Drive the implementation of data solutions that align with the companys strategic goals and societal impact.


Qualifications

  • Possess a strong background in Delta Live Pipelines and Databricks SQL with proven experience in data engineering.
  • Demonstrate proficiency in Python and PySpark with a focus on developing scalable data solutions.
  • Experience in designing and optimizing Databricks Workflows for efficient data integration.
  • Strong problem-solving skills and the ability to troubleshoot complex data issues effectively.
  • Excellent communication skills to collaborate with team members and stakeholders.
  • A proactive approach to learning and adapting to new technologies and methodologies.
  • A bachelors degree in Computer Science Information Technology or a related field is preferred.


Certifications Required

Databricks Certified Data Engineer Associate Python Certification

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Cognizant logo
Cognizant

IT Services and IT Consulting

Teaneck New Jersey

RecommendedJobs for You