Kafka Administrator

Kafka Administrator

Role & responsibilities

• Install, configure, and manage Kafka clusters in production and non-production environments.
• Monitor and maintain Kafka brokers, topics, partitions, and consumer groups for optimal performance.
• Implement security configurations including SSL, Kerberos, and ACLs.
• Automate deployment and configuration tasks using Chef and scripting languages (Shell/Python).
• Integrate Kafka with CI/CD tools such as Jenkins for automated build and deployment pipelines.
• Set up and manage monitoring and alerting using Splunk, Dynatrace, or similar monitoring tools.
• Troubleshoot and resolve Kafka-related issues, including performance bottlenecks and data inconsistencies.
• Work closely with developers, DevOps, and infrastructure teams to ensure seamless integration and operation of Kafka.
• Conduct regular maintenance activities, including version upgrades, patching, and capacity planning.
  

Primary Skills

• Apache Kafka Administration installation, configuration, maintenance, troubleshooting.
• Jenkins CI/CD pipeline setup and integration.
• Chef configuration management and automation.
• Scripting – Shell / Python scripting for automation and operational tasks.
• Monitoring Tools – Splunk, Dynatrace, or any equivalent APM/monitoring platform.
  

Secondary Skills

• Git – version control and source code management.
• XLR (XL Release) – release orchestration and deployment management.