DevOps Engineer

ACL Digital

5 - 7 years

50 - 55 Lacs

bengaluru

Posted:2 weeks ago| Platform:

Apply

Skills Required

github gcp product innovation devops consulting cloud infrastructure big data sql python

Work Mode

Work from Office

Job Type

Full Time

Job Description

DevOps Engineer Big Data Ingestion (Terraform | Databricks | GCP)5+yrs
Required DevOps Engineer to support a Big Data Ingestion project. The role involves automating and managing infrastructure for pipelines ingesting data from Datadog logs and Cloud SQL Server into Google BigQuery, built on Databricks and PySpark.
Responsibilities:
Build and manage GCP infrastructure (BigQuery, Cloud SQL, Cloud Storage, IAM) using Terraform.
Automate Databricks cluster provisioning and pipeline deployments.
Implement CI/CD pipelines for infrastructure and code.
Set up monitoring, logging, and alerting for ingestion pipelines.
Collaborate with Data Engineers and QA teams to ensure reliability and scalability.

Requirements:

Strong hands-on experience with Terraform and GCP services.
Knowledge of Databricks, PySpark, and BigQuery.
Experience with CI/CD tools (GitHub Actions, Jenkins, or Cloud Build).
Familiarity with Datadog or other monitoring tools.
Scripting skills in Python/Bash.
Nice to Have: Docker/Kubernetes, Airbyte/Fivetran, OAuth 2.0, cost optimization in big data environments.

More Jobs at ACL Digital

Scala Developer

Pune, Bangalore Rural

4 - 9 yrs

INR 15 - 18 Lacs

Technical Architect

Ahmedabad

10 - 20 yrs

INR 20 - 35 Lacs

Embedded Linux Developer

Pune, Maharashtra, India

7 - 7 yrs

Salary: Not disclosed

Functional Safety Engineer/Lead/Manager

Bengaluru

7 - 12 yrs

INR 25 - 40 Lacs

Process Automation Engineer - Workato / Zapie / Boomi

Chennai

2 - 6 yrs

INR 7 - 15 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start DevOps Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.