Kafka Engineer

Position Title: Kafka Engineer

Department: Digital Engineering

About Americana Restaurants International PLC

region and Kazakhstan's Out-of-Home Dining industry, ranking among the world's leading

2,600+ restaurants spans 12 countries

Center of Excellence in Mohali, India

Your Role Will Include:

Kafka Cluster Deployment and Management:

Design, deploy, and maintain scalable Kafka clusters using Confluent Platform.

Configure and optimize Kafka brokers, topics, partitions, and replication.

Monitor Kafka cluster performance and troubleshoot issues.

Data Integration and Stream Processing:

Implement data streaming architectures using Kafka for real-time data integration and processing.

Design and develop Kafka Connect connectors for integrating Kafka with various data sources and sinks.

Develop and deploy Kafka Streams applications for data transformation and analytics.

Security and Governance:

Implement and maintain security measures for Kafka clusters (e.g., SSL/TLS encryption, authentication, authorization).

Define and enforce Kafka governance policies and access controls.

Monitoring and Optimization:

Set up monitoring and alerting for Kafka clusters using tools such as Confluent Control Center or similar monitoring solutions.

Optimize Kafka configurations and performance tuning to ensure scalability, reliability, and efficiency.

Documentation and Collaboration:

Document Kafka architecture, configurations, and operational procedures.

Collaborate with cross-functional teams including developers, data scientists, and operations teams to integrate Kafka into overall system architectures

What You Bring:

1. Bachelor's degree in computer science, Engineering, or a related field, or equivalent work experience.
2. Proven experience as a Kafka Engineer, Streaming Platform Engineer, or similar role with hands on experience in implementing Kafka solutions.
3. Deep understanding of Apache Kafka architecture, components, and ecosystem, particularly using Confluent Platform.
4. Experience with Kafka cluster setup, configuration, and management in production environments.
5. Proficiency in Kafka Connect, Kafka Streams, and related tools for data integration and stream processing.
6. Strong knowledge of Kafka security principles and best practices.
7. Experience with Kafka monitoring, performance tuning, and troubleshooting.
8. Excellent scripting and automation skills (e.g., Python, Shell scripting).
9. Strong analytical and problem-solving skills.
10. Excellent communication and collaboration skills.
11. 5+ years of industry experience in building and managing Kafka streaming services

Preferred Qualifications:

1. Confluent Certified Developer or Administrator certification.
2. Experience with cloud platforms and services

   (e.g., AWS, Azure, Google Cloud).

3. Knowledge of containerization and orchestration tools such as Docker and Kubernetes for Kafka deployment.
4. Familiarity with event-driven architecture and microservices