Posted:2 weeks ago|
Platform:
Work from Office
Full Time
Responsibilities What you'll do Engineer, test, document and manage GCP Dataproc, DataFlow and VertexAI services used in high-performance data processing pipelines and Machine Learning. Help developers optimize data processing jobs using Spark, Python, and Java. Collaborate with development teams to integrate data processing pipelines with other cloud services and applications. Utilize Terraform and Tekton for infrastructure as code (IaC) and CI/CD pipelines, ensuring efficient deployment and management. Good to have Experience with Spark for large-scale data processing. Solid understanding and experience with GitHub for version control and collaboration. Experience with Terraform for infrastructure management and Tekton for continuous integration and deployment. Experience with Apache NiFi for data flow automation. Knowledge of Apache Kafka for real-time data streaming. Familiarity with Google Cloud Pub/Sub for event-driven systems and messaging. Familiarity with Google BigQuery Mandatory Key Skills Python,Java,Google Cloud Pub/Sub,Apache Kafka,Big Query,CI/CD*,Machine Learning*,Spark*
Shashwath Solution
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
My Connections Shashwath Solution
Chennai, Tamil Nadu, India
Salary: Not disclosed
5.0 - 8.0 Lacs P.A.
12.0 - 16.0 Lacs P.A.
Hyderabad
4.0 - 9.0 Lacs P.A.
Bengaluru
7.0 - 12.0 Lacs P.A.
Bengaluru
Experience: Not specified
2.0 - 5.0 Lacs P.A.
5.0 - 10.0 Lacs P.A.
4.0 - 9.0 Lacs P.A.
Hyderabad
4.0 - 9.0 Lacs P.A.
Bengaluru
7.0 - 12.0 Lacs P.A.