Site Reliability Engineer

Site Reliability Engineer

Primary Skills (Must-Have)

• AWS (core services: EC2, EKS, Lambda, Redshift, S3, IAM, VPC)
  
• CI/CD (Jenkins, GitHub Actions, AWS CodePipeline)
  
• Infrastructure as Code (Terraform, CloudFormation)
  
• Kubernetes (EKS) and container orchestration
  

Secondary Skills (Good-to-Have)

• AWS Systems Manager, Dataiku platform operations
  
• Experience with platform patching, upgrades, and maintenance
  

Tools & Platforms

• Data Warehousing & Processing

  : Snowflake, Redshift, Apache Airflow, dbt

• CI/CD & Deployment

  : Jenkins, GitHub Actions, AWS CodePipeline, Terraform

• Cloud & Event Processing

  : AWS Lambda, API Gateway, SNS/SQS, Kafka, Step Functions

• Monitoring & Logging

  : DataDog, AWS CloudWatch, Prometheus, Splunk

• Incident Management

  : PagerDuty, Opsgenie, AWS Health Dashboard

• Collaboration & Code Review

  : GitHub, Jira, Confluence

Key Responsibilities

Data Pipeline Reliability & Observability

• Maintain highly available, fault-tolerant infrastructure for ETL jobs and real-time data processing
  
• Implement monitoring of Airflow DAGs, Snowflake queries, and AWS data workflows
  
• Automate health checks, error handling, and self-healing for data pipelines
  

Infrastructure & Cloud Automation

• Deploy and manage AWS-based infrastructure with Terraform & CloudFormation
  
• Optimize Kubernetes (EKS) clusters for scale and cost efficiency
  
• Support scaling and reliability for Redshift, Snowflake, and storage solutions
  

Performance, Monitoring & Incident Response

• Build real-time monitoring, logging, and alerting with DataDog, CloudWatch, and Prometheus
  
• Define & track SLOs/SLIs to improve data platform uptime
  
• Perform RCA, post-mortems, and security audits after incidents
  

Security & Compliance

• Ensure compliance with GDPR, CCPA, SOC 2 across data pipelines
  
• Apply AWS security best practices (IAM, KMS, Shield, WAF)
  
• Secure API Gateways, data access policies, and encryption standards
  

Collaboration & Leadership

• Partner with data engineers, analytics, and DevOps teams to improve reliability
  
• Participate in DR (Disaster Recovery) planning and security compliance reviews
  
• Promote best practices in automation, observability, and cost optimization