Platform Engineer (Kafka)

Responsibilities :

Deploy, configure, and manage Kafka clusters across development, staging, and production environments.

Ensure platform reliability, scalability, and performance through proactive monitoring, tuning, and capacity planning.

Manage and maintain Kafka components such as Kafka Connect, Schema Registry, and REST Proxy.

Implement platform-level security including access controls, TLS encryption, and audit logging.

Monitor platform health using observability tools and respond to alerts and incidents.

Collaborate with application and data engineering teams to support integration and usage of Kafka.

Maintain documentation for deployment procedures, operational runbooks, and platform standards.

Perform regular upgrades, patching, and vulnerability remediation across platform components.

Ensure compliance with infrastructure and security best practices and standards.

Additional Responsibilities:

Familiarity with infrastructure automation tools (e.g., Terraform, Ansible).

Experience with monitoring and alerting tools (e.g., Prometheus, Grafana).

Exposure to stream processing platforms such as Flink.

Technical and Professional Requirements:

34 years of experience in platform or infrastructure engineering roles.

Hands-on experience with Kafka in production environments.

Strong understanding of Kafka architecture, including brokers, topics, partitions, replication, and retention policies.

Experience managing Kafka Connect connectors and Schema Registry configurations.

Experience with Linux system administration and shell scripting.

Understanding of networking, load balancing, and DNS in cloud or hybrid environments.

Strong troubleshooting and root cause analysis skills.