Lead Data Engineer - Java/Scala

8 - 12 years

13 - 20 Lacs

Posted:2 months ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

- Bachelor's degree in Computer Science, Information Technology, or a related field (Master's preferred). - Proven experience as a Data Engineer, with a focus on cloud migrations, preferably on GCP with 8 to 10 + yrs. exp - Strong programming skills in languages Java, or Scala. - Strong expertise in building and maintaining data pipelines and data warehouses. - Develop a comprehensive migration strategy for our data infrastructure and workloads to GCP. - Proficiency in GCP services, including Big Query, Dataproc, Pub/Sub and Cloud Storage. - Migrate data processing jobs using GCP services. - Experience with data modelling, ETL processes, and data transformation. - Lead the migration of existing EMR pipelines to GCP, including ETL processes, data ingestion, and transformation workflows. - Experience with Data Catalogue migration & updating the partitions on day-to-day basis - Ensure data pipelines are optimized for performance and cost-effectiveness. - Troubleshoot and resolve data pipeline issues. - Monitor and optimize data processing and storage costs. - Excellent problem-solving and analytical skills. - Effective leadership and team management abilities. - Strong communication and collaboration skills.

Mock Interview

Practice Video Interview with JobPe AI

Start Java Interview Now

My Connections Carbynetech India Pvt Ltd

Download Chrome Extension (See your connection in the Carbynetech India Pvt Ltd )

chrome image
Download Now
Carbynetech India Pvt Ltd
Carbynetech India Pvt Ltd

Information Technology and Cloud Services

Hyderabad

50-100 Employees

856 Jobs

    Key People

  • Alice Johnson

    CEO
  • Rahul Mehta

    CTO

RecommendedJobs for You

Bengaluru / Bangalore, Karnataka, India

Bengaluru / Bangalore, Karnataka, India

Bengaluru / Bangalore, Karnataka, India

Bengaluru / Bangalore, Karnataka, India