Devops Engineer

Key Responsibilities

1. CI/CD Pipeline Management

• Design, implement, and maintain end-to-end CI/CD pipelines for continuous integration, testing, and deployment of data and application workloads.
• Integrate and automate workflows using AWS CodePipeline, CodeBuild, CodeDeploy, and Jenkins, ensuring zero-downtime deployments.

2. Infrastructure Automation & Provisioning

• Build and manage Infrastructure as Code (IaC) using Terraform, CloudFormation, or Ansible to automate the provisioning of AWS services and data environments.
• Implement auto-scaling, backup, and disaster recovery strategies for high availability and resilience.

3. Cloud & Data Production Management

• Deploy and manage Data Production environments on AWS, ensuring system reliability, data consistency, and minimal downtime during releases.
• Collaborate with data engineering teams to operationalize and optimize ETL/ELT pipelines, Spark clusters, AWS Glue jobs, and Iceberg tables.
• Manage production-grade Data Lakes and Lakehouses using S3, EMR, Glue, Redshift, Athena, and Lake Formation.
• Monitor and troubleshoot production issues using CloudWatch, CloudTrail, Prometheus, or Grafana.

4. Containerization & Orchestration

• Containerize and deploy applications using Docker and Kubernetes (EKS) for scalable and consistent environment management.
• Manage Helm charts and Kubernetes manifests for multi-environment deployments (Dev, QA, UAT, Prod).

5. Collaboration & Continuous Improvement

• Work cross-functionally with developers, QA, and data engineers to improve deployment efficiency and enhance platform reliability.
• Evaluate new tools and techniques to strengthen automation, observability, and security within the data and DevOps ecosystem.