Posted:4 days ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Job Summary

As an Lead Data Engineer with a focus on Palantir PySpark and Python you will play a pivotal role in designing and implementing scalable data solutions. With a hybrid work model you will collaborate with cross-functional teams to drive innovation and efficiency. Your expertise will contribute to the companys mission of delivering cutting-edge technology solutions that have a significant impact on society.

Responsibilities

  • Design and implement scalable data architectures using Palantir Spark and SparkSQL to meet business requirements.
  • Collaborate with cross-functional teams to understand data needs and provide innovative solutions.
  • Develop and optimize Python scripts to enhance data processing and analysis capabilities.
  • Ensure data quality and integrity through rigorous testing and validation processes.
  • Lead the development of data models and pipelines to support analytics and reporting.
  • Provide technical guidance and mentorship to junior team members to foster growth and development.
  • Oversee the integration of data from various sources to create a unified data platform.
  • Monitor system performance and implement improvements to enhance efficiency and reliability.
  • Stay updated with the latest industry trends and technologies to drive continuous improvement.
  • Communicate effectively with stakeholders to align data solutions with business objectives.
  • Document technical specifications and processes to ensure knowledge sharing and continuity.
  • Contribute to the companys purpose by delivering data solutions that drive informed decision-making.
  • Impact society by enabling data-driven insights that lead to innovative solutions. Qualifications
  • Possess extensive experience in designing data architectures with Spark and SparkSQL.
  • Demonstrate proficiency in Python programming for data processing and analysis.
  • Exhibit strong problem-solving skills and the ability to work collaboratively in a hybrid environment.
  • Have a solid understanding of data modeling and pipeline development.
  • Show experience in ensuring data quality and integrity through testing and validation.
  • Display excellent communication skills to interact with stakeholders and team members.
  • Stay abreast of industry trends and advancements in data technologies.

Certifications Required

Certified Spark Developer Python Programming Certification

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Cognizant logo
Cognizant

IT Services and IT Consulting

Teaneck New Jersey

RecommendedJobs for You

bengaluru east, karnataka, india

hyderabad, telangana

chennai, tamil nadu, india

bengaluru east, karnataka, india

bengaluru, karnataka, india

bengaluru, karnataka

bengaluru east, karnataka, india