GCP Data Engineer

Prodapt

3 - 4 years

10 - 11 Lacs

chennai

Posted:-1 days ago| Platform:

Apply

Skills Required

computer science version control git data management data modeling agile apache information technology monitoring python

Work Mode

Work from Office

Job Type

Full Time

Job Description

Data Pipeline Development:
Design and implement robust data pipelines using Google Cloud services (BigQuery, Dataflow, Pub/Sub) integrated with Kafka for real-time data processing.
Streaming Applications:
Develop and maintain real-time streaming applications using Kafka and Java, ensuring high availability and performance.
Cloud Infrastructure:
Utilize GCP technologies to build scalable and efficient data architectures, leveraging tools such as Cloud Storage, Cloud Functions, and Kubernetes.
Monitoring and Optimization:
Monitor data flow, performance metrics, and troubleshoot issues in production environments. Optimize data pipeline performance and reliability.
Collaboration:
Work closely with data scientists, analysts, and other engineers to understand data requirements and translate them into technical specifications.
Documentation:
Maintain comprehensive documentation of data pipelines, architecture, and processes to ensure knowledge sharing and compliance.

Requirements Required Skills:

Cloud Skills:
Proficiency in Google Cloud Platform (GCP), including services like BigQuery, Dataflow, and Pub/Sub.
Streaming Technologies:
Strong experience with Kafka for real-time data streaming and messaging.
Programming Language:
Proficient in Java, with a solid understanding of object-oriented programming principles and best practices.
Data Management:
Familiarity with data modeling, ETL processes, and database management.
Development Tools:
Experience with version control systems (e.g., Git), CI/CD tools, and Agile methodologies.
Problem-Solving:
Strong analytical and troubleshooting skills, with the ability to work independently and as part of a team.

Preferred Qualifications:

Bachelors degree in Computer Science, Information Technology, or a related field.
Experience with other programming languages (Python, Scala) is a plus.
Knowledge of additional GCP services or data visualization tools (e.g., Looker, Tableau) is advantageous.

More Jobs at Prodapt

Job Template - AD ASM Manager

Chennai, Tamil Nadu, India

7 - 12 yrs

Salary: Not disclosed

MySQL DBA

Greater Chennai Area

Experience: Not specified

Salary: Not disclosed

Delivery Lead

Chennai, Tamil Nadu, India

20.0 - 20.0 yrs

Salary: Not disclosed

Data Engineer

Greater Chennai Area

3.0 - 7.0 yrs

Salary: Not disclosed

Backend Engineer (Full Stack)

Greater Chennai Area

5.0 - 8.0 yrs

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.