Azure data bricks +Pyspark

4 years

0 Lacs

Posted:21 hours ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Skill:

Azure Databricks+ Pyspark

Experience:

4 to 12 years

Location: AIA Noida

Job Summary

We are seeking a highly skilled Sr. Developer with 9 to 10 years of experience to join our dynamic team. The ideal candidate will have expertise in Databricks SQL Databricks Delta Lake Databricks Workflows and PySpark. This role is hybrid allowing for a flexible work environment. The Sr. Developer will play a crucial role in developing and optimizing data solutions that drive business insights and innovation.

Responsibilities

  • Develop and implement robust data solutions using Databricks SQL to enhance data processing capabilities.
  • Optimize Databricks Delta Lake for efficient data storage and retrieval ensuring high performance and scalability.
  • Design and manage Databricks Workflows to automate data pipelines and improve operational efficiency.
  • Utilize PySpark to process large datasets enabling advanced analytics and data-driven decision-making.
  • Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
  • Ensure data quality and integrity by implementing best practices in data governance and validation.
  • Provide technical guidance and support to junior developers fostering a culture of continuous learning and improvement.
  • Monitor and troubleshoot data solutions to ensure seamless operations and minimal downtime.
  • Stay updated with the latest industry trends and technologies to drive innovation and maintain competitive advantage.
  • Contribute to the development of data architecture and strategy to align with organizational goals.
  • Document technical specifications and processes to facilitate knowledge sharing and collaboration.
  • Engage in code reviews to maintain high standards of code quality and performance.
  • Support the deployment and integration of data solutions into existing systems ensuring compatibility and functionality.

Qualifications

  • Possess a strong understanding of Databricks SQL and its application in data processing.
  • Demonstrate expertise in managing and optimizing Databricks Delta Lake for large-scale data solutions.
  • Have experience in designing and implementing Databricks Workflows for automated data pipelines.
  • Show proficiency in PySpark for processing and analyzing large datasets.
  • Exhibit excellent problem-solving skills and the ability to work collaboratively in a team environment.
  • Display strong communication skills to effectively convey technical concepts to non-technical stakeholders.
  • Maintain a proactive approach to learning and adapting to new technologies and methodologies.

Certifications Required

Databricks Certified Data Engineer Associate or equivalent certification in data engineering.

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
Cognizant logo
Cognizant

IT Services and IT Consulting

Teaneck New Jersey

RecommendedJobs for You