Kafka Developer with Streaming Experience

Kafka Developer

Responsibilities:

• Develop & Optimize Data Streaming Solutions:

  Design, develop, and maintain high-performance data pipelines and real-time streaming applications primarily using

  Java

  with Apache Kafka, Kafka Streams, and Apache Flink. Enhance and support existing Kafka codebase. Experience with Python is a plus.

• Kafka Administration & Integration:

  Install, configure, monitor, and optimize Kafka clusters. This includes extensive experience with

  Kafka Connect

  and specifically the

  MongoDB Connector

  for seamless data integration.

• MongoDB Expertise:

  Design and optimize MongoDB schemas, develop complex queries, and manage MongoDB replication sets and sharded clusters for scalable data storage.

• Software Engineering Excellence:

  Apply strong principles of

  Object-Oriented Programming (OOP)

  ,

  Test-Driven Development (TDD)

  , and proven

  Software Design Patterns

  to deliver clean, maintainable, and scalable code.

• Operational Proficiency:

  Utilize DevOps practices (CI/CD, Docker, Kubernetes) for automated deployments, and actively monitor and troubleshoot distributed systems to ensure high availability and performance.

• Technical Environment:

  Kafka version 3.7, deployed on cloud. Real-time streaming and event-driven architecture.

Qualifications:

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• Proven experience with Apache Kafka and real-time data streaming.
• Proficiency in programming languages such as Java, Scala, or Python.
• Familiarity with distributed systems and microservices architecture.
• Strong problem-solving skills and the ability to work collaboratively in a team environment.
• Understanding of SOA, Object-oriented analysis and design, or client/server systems.
• Expert knowledge in REST, JSON, XML, SOAP, WSDL, RAML, YAML.
• Hands-on experience in large scale SOA design, development and deployment.
• Experience with API management technology
• Experience working with continuous integration and continuous deliver tools (CI/CD) and processes.