Big Data Engineer

Allegis Group

5 - 9 years

15 - 19 Lacs

hyderabad

Posted:11 hours ago| Platform:

Apply

Skills Required

pyspark python sql

Work Mode

Work from Office

Job Type

Full Time

Job Description

Role & responsibilities

Consult on or participate in moderately complex initiatives and deliverables within Software Engineering and contribute to large-scale planning related to Software Engineering deliverables.
Review and analyze moderately complex Software Engineering challenges that require an in-depth evaluation of variable factors.
Contribute to the resolution of moderately complex issues and consult with others to meet Software Engineering deliverables while leveraging solid understanding of the function, policies, procedures, and compliance requirements.
Collaborate with client personnel in Software Engineering.
Design, develop, and maintain big data pipelines using
Python
and
PySpark
.
Work with large-scale datasets and distributed computing frameworks.
Collaborate with data scientists and AI teams to support machine learning workflows.
Optimize data processing for performance, scalability, and reliability.
Ensure data quality, governance, and compliance across all stages of the pipeline.
Participate in architectural discussions and contribute to solution design.
Stay updated with emerging trends in big data and AI technologies.

More Jobs at Allegis Group

Principal Automation Engineer # TEKsystems

Hyderabad

11 - 15 yrs

INR 0 - 1 Lacs

HR Coordinator - Learning and Development

Hyderabad

Experience: Not specified

INR 1 - 3 Lacs

ROR Developer

Hyderabad

5 - 10 yrs

INR 1 - 4 Lacs

Human Resource Operations Specialist

Hyderabad

Experience: Not specified

INR 1 - 2 Lacs

TEKsystems #Hiring #SCRUM Masters

Hyderabad

10 - 12 yrs

INR 0 - 1 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.