Job
Description
Job Title : Kafka Developer Location : Chennai /Hyderabad/Bangalore Job Type : Full-Time Experience:5-9 Yrs Introduction : We are seeking an experienced Kafka Developer with JAVA to join our dynamic team. In this role, you will be responsible for designing, implementing, and maintaining real-time data streaming systems using Apache Kafka. You will work closely with cross-functional teams to build scalable, high-performance data pipelines and enable the efficient flow of data across various applications. Responsibilities : Design, implement, and maintain scalable, high-performance data streaming systems using Apache Kafka. Build and deploy Kafka topics, producers, and consumers for real-time data processing. Collaborate with backend engineers, data engineers, and other team members to integrate Kafka into various systems and platforms. Optimize Kafka clusters for performance, scalability, and high availability. Develop Kafka Streams applications for real-time data processing and transformation. Troubleshoot and resolve Kafka-related issues, including cluster performance, message processing, and data consistency problems. Implement security best practices within the Kafka ecosystem, including access control, encryption, and authentication. Monitor Kafka clusters and pipelines to ensure uptime and performance metrics are met. Ensure proper data governance and compliance measures are implemented across the Kafka pipeline. Develop and maintain documentation, including setup guides, technical specifications, and architecture diagrams. Stay up to date with the latest Kafka features, improvements, and industry best practices. Requirements : Proven experience as a Kafka Developer, Data Engineer, or similar role with hands-on expertise in Apache Kafka. Strong knowledge of Kafkas core concepts: topics, partitions, producers, consumers, brokers, and Kafka Streams. Experience with Kafka ecosystem tools like Kafka Connect, Kafka Streams, and KSQL. Expertise in Java, developing Kafka-based solutions. Experience in deploying and managing Kafka clusters in cloud environments (AWS, Azure, GCP). Strong understanding of distributed systems, message brokers, and data streaming architectures. Familiarity with stream processing and real-time data analytics. Experience in building, optimizing, and monitoring Kafka-based systems. Knowledge of containerization technologies (e.g., Docker, Kubernetes) for managing Kafka deployments. Excellent problem-solving skills and the ability to troubleshoot complex Kafka-related issues. Strong communication and collaboration skills for working in a team environment. Preferred Qualifications : Experience with other messaging systems like Apache Pulsar or RabbitMQ. Familiarity with data storage technologies like HDFS, NoSQL, or relational databases. Experience in DevOps practices and CI/CD pipelines. Knowledge of cloud-native architectures and microservices. Education : Bachelors degree in Computer Science, Information Technology, or a related field (or equivalent work experience). Why Join Us : [Photon Interactive systems offers a dynamic and inclusive work environment with opportunities for personal and professional growth. Competitive salary and benefits package. Work with the latest technologies in the field of data streaming and big data analytics.
