Palantir

Cognizant

6 - 12 years

0 Lacs

kochi kerala

Posted:2 weeks ago| Platform: SimplyHired logo

Apply

Skills Required

training & development python

Work Mode

On-site

Job Type

Full Time

Job Description

Job Summary

We are seeking an experienced Pyspark Lead Data Engineer with 6 to 12 years of experience to join our team. The ideal candidate will have expertise in Pyspark Optimization Python Palantir Foundry.

Location: - Kolkata

Responsibilities

Design and implement scalable data architectures using Pyspark-Python (Palantir Foundry) to enhance data processing capabilities.
Optimize Spark applications for performance and efficiency ensuring minimal resource usage and maximum throughput.
Develop and maintain ETL processes to streamline data integration and transformation.
Utilize Palantir Foundry/Pyspark/Python to create robust data pipelines and automate data workflows for improved operational efficiency.
Manage and organize data storage solutions in Amazon S3 ensuring data accessibility and security.
Collaborate with cross-functional teams to understand data requirements and deliver tailored solutions.
Provide technical guidance and support to team members fostering a collaborative and innovative environment.
Conduct regular performance tuning and troubleshooting to ensure optimal system performance.
Stay updated with the latest industry trends and technologies to continuously improve data solutions.
Ensure data quality and integrity through rigorous testing and validation processes.
Document technical specifications and processes to maintain clear and comprehensive records.
Contribute to the strategic planning of data initiatives to align with business objectives.
Engage in continuous learning and development to enhance technical skills and knowledge.

More Jobs at Cognizant

Workday: Walk-in drive 10th May Pune with CTS(Full time)

Pune, Mumbai (All Areas)

3 - 8 yrs

INR 7 - 17 Lacs

Java Full Stack Developer

Chennai

5 - 10 yrs

INR 10 - 20 Lacs

Walkin For Freshers @hyderabad

Hyderabad

Experience: Not specified

INR 0 - 2 Lacs

React JS Developer

Hyderabad

2 - 7 yrs

INR 9 - 14 Lacs

Java Developer

Bengaluru

5 - 10 yrs

INR 15 - 30 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.