Data Engineer

CGI

6 - 11 years

11 - 20 Lacs

hyderabad

Posted:1 hour ago| Platform:

Apply

Skills Required

pyspark python mongodb

Work Mode

Hybrid

Job Type

Full Time

Job Description

Role & responsibilities

Design, develop, and maintain end-to-end data pipelines for batch and real-time processing.
Work with Apache Spark to process and transform large datasets efficiently.
Manage and optimize HDFS storage, ensuring data availability, reliability, and performance.
Develop scripts and data orchestration workflows using Python.
Build and maintain NoSQL data solutions using MongoDB, including data modeling and performance tuning.
Collaborate with Data Scientists, Analysts, and Platform Engineering teams to deliver high-quality data solutions.
Implement data quality, validation, and monitoring frameworks to ensure accuracy and consistency.
Participate in design reviews, code reviews, and performance optimization initiatives.
Contribute to the continuous improvement of data engineering standards and best practices.

More Jobs at CGI

Sap Abap Consultant

Bengaluru, Hyderabad

4 - 8 yrs

INR 12 - 19 Lacs

Junior position Software Engineer/Lead Java Fullstack

Hyderabad, Telangana, India

Experience: Not specified

Salary: Not disclosed

Lead Analyst - SAP ABAP

Hyderabad, Telangana, India

Experience: Not specified

Salary: Not disclosed

Power Bi Developer

Mumbai

5 - 8 yrs

INR 0 - 0 Lacs

Python Software Developer

Mumbai

5 - 8 yrs

INR 0 - 0 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.