DevOps Engineer (CDP Specialist)

Job Title:

Department:

Location:

Experience:

Key Responsibilities

1. CDP Cluster Management

• Deploy, monitor, and maintain

  Cloudera Data Platform (CDP)

  across staging and production environments
• Manage stability, performance tuning, patching, and upgrades for CDP services such as

  HDFS, Hive, HBase, Impala, and Ranger

• Automate CDP provisioning, configuration, and lifecycle management using scripts and infrastructure-as-code tools
  

2. CI/CD Pipeline Ownership

• Design, build, and manage

  CI/CD pipelines

  using

  GitLab CI, Jenkins

  , or similar tools
• Standardize deployment workflows with version control, rollback strategies, and environment parity
  
• Enable fast, reliable deployments for backend services and ML pipelines
  

3. Containerization & Orchestration

• Manage

  Kubernetes-based infrastructure

  , including Helm charts, scaling, networking, and pod health
• Implement automated deployment strategies such as

  rolling, blue/green, and canary deployments

4. Cloud & Security Operations

• Provision and manage infrastructure on

  AWS

  (EC2, S3, VPC, IAM);

  GCP exposure is a plus

• Enforce security best practices including

  TLS/SSL, RBAC, audit logging, IAM policies, and key management

5. Monitoring, Observability & Incident Management

• Implement and maintain monitoring and alerting using

  Prometheus, Grafana, ELK

  , and custom dashboards
• Participate in incident response, root cause analysis (RCA), and post-mortems
  
• Continuously improve system observability and reliability
  

6. Collaboration & Documentation

• Collaborate with engineering, data science, and support teams to streamline development-to-deployment workflows
  
• Create and maintain clear documentation for

  deployment playbooks, system architecture, and operational SOPs

Qualifications & Skills

Education

• Bachelors degree in

  Computer Science, Engineering, or a related field

Experience

• 5–8 years

  of experience in

  DevOps, Infrastructure, or Site Reliability Engineering

• 2+ years

  of hands-on experience managing

  CDP (Cloudera Data Platform)

  in production environments

Technical Skills

• Cloudera CDP:

  HDFS, Hive, HBase, Impala, Ranger

• CI/CD:

  GitLab CI, Jenkins, or equivalent

• Containers:

  Docker, Kubernetes, Helm

• Infrastructure as Code:

  Terraform and/or Ansible

• Cloud Platforms:

  AWS (EC2, S3, VPC, IAM); GCP is a plus

• Scripting:

  Bash, Python

• Monitoring & Logging:

  Prometheus, Grafana, ELK Stack

• Security:

  TLS/SSL, RBAC, key rotation, audit logging

Key Competencies

• Infrastructure Reliability:

  Ensures high availability and scalable systems

• Automation-First Approach:

  Proactively eliminates manual operational tasks

• Platform Ownership:

  Owns deployment efficiency, performance, and observability

• Cross-Functional Collaboration:

  Works effectively with dev, data, and infra teams

• Security-First Mindset:

  Designs and audits secure operational environments