6.0 - 10.0 years

0 Lacs

all india, gurugram

On-site

As a Data Engineer at Infogain, your role involves analyzing existing Hadoop, Pig, and Spark scripts from Dataproc and refactoring them into Databricks-native PySpark. You will be responsible for implementing data ingestion and transformation pipelines using Delta Lake best practices, applying conversion rules and templates for automated code migration and testing, and conducting data validation between legacy and migrated environments. Additionally, you will collaborate on developing AI-driven tools for code conversion, dependency extraction, and error remediation. It is essential to ensure best practices for code versioning, error handling, and performance optimization, as well as actively...

Posted 12 hours ago

AI Match Score

Apply

Senior Consultant - Business Consulting Risk - FSRM - GCP Data Engineer EY

4.0 - 8.0 years

0 Lacs

maharashtra

On-site

Role Overview: As a GCP Data Engineer at EY, you will be part of the FSRM team, a fast-moving and high-growth area with immense potential. Your role will involve designing, developing, and maintaining robust data pipelines using GCP services such as BigQuery, Dataflow, Pub/Sub, CloudSQL, and Cloud Composer (Airflow). You will collaborate with data scientists, analysts, and other engineers to ensure data availability and quality. Your expertise in Python scripting and orchestrating tools like Airflow will be essential for optimizing data workflows for performance, scalability, and cost-efficiency. Key Responsibilities: - Design, develop, and maintain robust data pipelines using GCP services s...

Posted 2 months ago

AI Match Score

Apply

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.