Confluent Kafka Integration Engineer/Consultant

• We are seeking a skilled Kafka Integration Engineer with hands on experience in Confluent Kafka to join our data engineering team
• The ideal candidate will be responsible for designing developing and maintaining scalable real time data pipelines and integrations using Kafka and Confluent components

Key Responsibilities:

• Design and implement real time streaming solutions using Kafka Confluent Platform and Confluent Cloud
• Develop stream processing applications using Apache Flink ksqlDB and Kafka Streams
• Build data governance frameworks using Confluent s Stream Governance suite
• Implement data lineage tracking and stream catalog management
• Deploy and manage KRaft based clusters ZooKeeper free Kafka architecture
• Configure client side field level encryption for sensitive data protection
• Integrate Kafka with enterprise systems databases APIs microservices
• Manage Kafka clusters topics schemas and connectors
• Optimize performance scalability and reliability of Kafka solutions
• Configure and manage KRaft controllers and metadata management
• Implement disaster recovery and cross region replication strategies
• Set up monitoring using next generation Confluent Control Center with Prometheus OpenTelemetry
• Deploy and manage Confluent for Kubernetes CFK and Ansible automation
• Monitor and troubleshoot Kafka pipelines and infrastructure
• Ensure data governance security and compliance in streaming workflows
• Collaborate with data engineers architects and DevOps teams

Technical Requirements:

• 5 years experience with Confluent Kafka and Apache Kafka
• Programming Strong proficiency in Java Python or Scala
• Kafka Ecosystem Kafka Connect Kafka Streams KSQL Schema Registry REST Proxy Confluent Control Center
• Confluent Platform Stream Governance Data Lineage Stream Catalog Audit Logs Role Based Access Control RBAC
• Confluent Cloud Fully managed Kafka service ksqlDB Cloud Apache Flink on Confluent Cloud
• Stream Processing Apache Flink ksqlDB real time analytics and complex event processing
• Architecture Event driven architecture and data streaming patterns
• DevOps Docker Kubernetes CI CD pipelines
• Cloud AWS GCP or Azure with Kafka deployment experience
• Soft Skills Excellent problem solving and communication abilities

Preferred Skills: