Job
Description
As a Lead DevOps / Platform Engineer - Kafka & OpenSearch at BMC Software, you will play a crucial role in the strategic design, automation, and operations of large-scale data platform services. Your main focus will be on event streaming (Kafka) and search/analytics (OpenSearch). Your key responsibilities will include: - Architecting and managing scalable Kafka and OpenSearch clusters for low-latency streaming, log analytics, and enterprise search - Defining and implementing patterns for scaling, replication, retention, disaster recovery, and cost optimization across distributed environments - Leading infrastructure automation using Terraform, Ansible, Jenkins, and GitOps to provision, patch, and upgrade hybrid cloud platforms - Designing CI/CD workflows that support streaming pipelines and search services, including schema management and data ingestion automation - Deploying and orchestrating Kafka and OpenSearch on Kubernetes using Helm and operators, ensuring resilience, elasticity, and multi-tenancy - Building observability frameworks with logging, metrics, and alerting to monitor Kafka brokers, consumers, and OpenSearch nodes, supporting 99.99% uptime SLAs - Enforcing security and compliance through RBAC, encryption, vulnerability patching, auditing, and certificate automation - Mentoring engineers on distributed data best practices while driving initiatives to reduce operational overhead and align platform strategies with business goals You will collaborate with global engineering, database, and platform teams to deliver automation, observability, and orchestration frameworks that support enterprise-wide data services. Additionally, as a lead contributor, you will tackle complex challenges, guide technical direction for Kafka and OpenSearch services, and align DevOps strategies with business objectives and organizational goals. As a Lead DevOps / Platform Engineer - Kafka & OpenSearch at BMC Software, you will play a crucial role in the strategic design, automation, and operations of large-scale data platform services. Your main focus will be on event streaming (Kafka) and search/analytics (OpenSearch). Your key responsibilities will include: - Architecting and managing scalable Kafka and OpenSearch clusters for low-latency streaming, log analytics, and enterprise search - Defining and implementing patterns for scaling, replication, retention, disaster recovery, and cost optimization across distributed environments - Leading infrastructure automation using Terraform, Ansible, Jenkins, and GitOps to provision, patch, and upgrade hybrid cloud platforms - Designing CI/CD workflows that support streaming pipelines and search services, including schema management and data ingestion automation - Deploying and orchestrating Kafka and OpenSearch on Kubernetes using Helm and operators, ensuring resilience, elasticity, and multi-tenancy - Building observability frameworks with logging, metrics, and alerting to monitor Kafka brokers, consumers, and OpenSearch nodes, supporting 99.99% uptime SLAs - Enforcing security and compliance through RBAC, encryption, vulnerability patching, auditing, and certificate automation - Mentoring engineers on distributed data best practices while driving initiatives to reduce operational overhead and align platform strategies with business goals You will collaborate with global engineering, database, and platform teams to deliver automation, observability, and orchestration frameworks that support enterprise-wide data services. Additionally, as a lead contributor, you will tackle complex challenges, guide technical direction for Kafka and OpenSearch services, and align DevOps strategies with business objectives and organizational goals.
