Kafka Developer

Desired Competencies (Technical/Behavioral Competency)

Job Summary

Mid-Level Kafka Developer

Key Responsibilities

• Design, develop, and maintain real-time streaming solutions using

  Apache Kafka

  .
• Implement

  Kafka producers, consumers, topics, and stream processing

  logic.
• Develop and maintain

  Kafka Connectors

  and

  Kafka Streams

  applications.
• Optimize Kafka clusters for performance, scalability, and reliability.
• Collaborate with DevOps teams for Kafka deployment, monitoring, and alerting.
• Integrate Kafka with data sources like databases, microservices, and cloud services.
• Participate in code reviews, design discussions, and sprint planning.
• Troubleshoot and resolve issues related to message delivery, data loss, and system failures.

Primary Skills

• 36 years of software development experience.
• 2+ years of hands-on experience with

  Apache Kafka

  .
• Strong knowledge of

  Kafka architecture

  (brokers, zookeepers, partitions, offsets, replication).
• Experience with

  Kafka Streams

  ,

  Kafka Connect

  , or

  ksqlDB

  .
• Proficiency in

  Java

  ,

  Scala

  , or

  Python

  .
• Understanding of distributed systems and real-time data processing.
• Experience with RESTful APIs and microservices architecture

Secondary Skills

• Experience with

  Kafka on Confluent Platform

  or

  AWS MSK

  .
• Familiarity with

  Schema Registry

  ,

  Avro/Protobuf

  , and

  serialization formats

  .
• Knowledge of

  containerization

  (Docker, Kubernetes).
• Experience integrating Kafka with

  Big Data technologies

  (e.g., Hadoop, Spark, Flink).
• Familiarity with monitoring tools like

  Prometheus, Grafana, Kafka Manager, or Confluent Control Center

  .