16 Kafka Brokers Jobs

Opening for the Insurance Company. **Looking someone with 30 days notice period** Location : Mumbai (Lower Parel) Key Responsibilities: Kafka Infrastructure Management: Design, implement, and manage Kafka clusters to ensure high availability, scalability, and security. Monitor and maintain Kafka infrastructure, including topics, partitions, brokers, Zookeeper, and related components. Perform capacity planning and scaling of Kafka clusters based on application needs and growth. Data Pipeline Development: Develop and optimize Kafka data pipelines to support real-time data streaming and processing. Collaborate with internal application development and data engineers to integrate Kafka with various HDFC Life data sources. Implement and maintain schema registry and serialization/deserialization protocols (e.g., Avro, Protobuf). Security and Compliance: Implement security best practices for Kafka clusters, including encryption, access control, and authentication mechanisms (e.g., Kerberos, SSL). Documentation and Support: Create and maintain documentation for Kafka setup, configurations, and operational procedures. Collaboration: Provide technical support and guidance to application development teams regarding Kafka usage and best practices. Collaborate with stakeholders to ensure alignment with business objectives Interested candidates shared resume on snehal@topgearconsultants.com

Role & responsibilities Responsibilities: • Work in an on-prem environment to manage and maintain data architecture. • Configure and manage Kraft / Zookeeper. • Perform Kafka Topic Configuration, create and test topics, and validate data flow from source to Kafka using sample tables. • Ingest data from different databases. • Deploy sink connectors and map Kafka topics to ODS tables with upsert logic. • Setting up Kafka High Availability. • Manage Kafka through Provectus. • Demonstrate knowledge about Kubernetes and virtual machines. Preferred Skills: • Strong analytical and problem-solving skills. • Excellent communication and teamwork abilities. • Ability to work independently and manage multiple tasks.

Manage end-to-end activities including installation, configuring & maintenance of Kafka clusters, managing topics configured in Kafka, ensuring maximum uptime of Kafka. Monitor performance of producer & consumer threads interacting with Kafka. Required Candidate profile Kafka Certification Must have hands-on experience in managing large Kafka clusters and installations Ability to monitor performance of producer consumer threads interacting with Kafka.

Proficient in Java 8 , Kafka Must have Experience with Junit Test Case Good on Spring boot, Microservices, SQL , ActiveMQ & Restful API

Responsibilities: * Monitor Kafka clusters for performance & availability * Manage Kafka broker instances & replication strategies * Collaborate with dev teams on data pipeline design & implementation Food allowance Health insurance Provident fund Annual bonus

Design & develop data pipelines for real-time and batch data ingestion and processing using Confluent Kafka, ksqlDB, Kafka Connect Apache Flink, Build and configure Kafka Connectors to ingest data from various sources(databases, APIs, message queues,

Role & responsibilities Administer and maintain Apache Kafka clusters , including installation, upgrades, configuration, and performance tuning. Design and implement Kafka topics, partitions, replication , and consumer groups. Ensure high availability and scalability of Kafka infrastructure in production environments. Monitor Kafka health and performance using tools like Prometheus, Grafana, Confluent Control Center , etc. Implement and manage security configurations such as SSL/TLS, authentication (Kerberos/SASL), and access control. Collaborate with development teams to design and configure Kafka-based integrations and data pipelines . Perform root cause analysis of production issues and ensure timely resolution. Create and maintain documentation for Kafka infrastructure and configurations. Required Skills: Strong expertise in Kafka administration , including hands-on experience with open-source and/or Confluent Kafka . Experience with Kafka ecosystem tools (Kafka Connect, Kafka Streams, Schema Registry). Proficiency in Linux-based environments and scripting (Bash, Python). Experience with monitoring/logging tools and Kafka performance optimization. Ability to work independently and proactively manage Kafka environments. Familiarity with DevOps tools and CI/CD pipelines (e.g., Jenkins, Git, Ansible). Preferred Skills: Experience with cloud platforms (AWS, GCP, or Azure) Kafka services. Knowledge of messaging alternatives like RabbitMQ, Pulsar, or ActiveMQ . Working knowledge of Docker and Kubernetes for Kafka deployment.

Kafka/MSK Linux In-depth understanding of Kafka broker configurations, zookeepers, and connectors Understand Kafka topic design and creation. Good knowledge in replication and high availability for Kafka system ElasticSearch/OpenSearch

Warm Greetings from SP Staffing Services Pvt Ltd!!!! Experience:4-7yrs Work Location :Chennai /Hyd/Bangalore Job Description: Interested candidates, Kindly share your updated resume to gokul.priya@spstaffing.in or contact number (Whatsapp:9360311230) to proceed further. Job Description: Confluent Kafka platform setup , maintenance , upgrade. Hands on experience with Kafka Brokers. Hands on experience with Schema Registry. Hands on experience with KSQL DB and understanding of underlying implementation and functions. Hands on experience with Kafka connectors and understanding of underlying implementation. Proficient understanding of Kafka client Producer and consumer functioning Experience with Kafka deployment in Azure Kubernetes Service Experience working in Azure cloud

Job Description: Standing up and administer on premise Kafka cluster. Ability to architect and create reference architecture for kafka Implementation standards Provide expertise in Kafka brokers, zookeepers, Kafka connect, schema registry, KSQL, Rest proxy and Kafka Control center. Ensure optimum performance, high availability and stability of solutions. Create topics, setup redundancy cluster, deploy monitoring tools, alerts and has good knowledge of best practices. Create stubs for producers, consumers and consumer groups for helping onboard applications from different languages/platforms. Provide administration and operations of the Kafka platform like provisioning, access lists Kerberos and SSL configurations. Use automation tools like provisioning using Docker, Jenkins and GitLab. Ability to perform data related benchmarking, performance analysis and tuning. Strong skills in In-memory applications, Database Design, Data Integration. Involve in design and capacity review meetings to provide suggestion in Kafka usage. Solid knowledge of monitoring tools and fine tuning alerts on Splunk, Prometheus, Grafana ,Splunk. Setting up security on Kafka. Providing naming conventions, Backup & Recovery and problem determination strategies for the projects. Monitor, prevent and troubleshoot security related issues. Provide strategic vision in engineering solutions that touch the messaging queue aspect of the infrastructure QUALIFICATIONS Demonstrated proficiency and experience in design, implementation, monitoring, and troubleshooting Kafka messaging infrastructure. Hands on experience on recovery in Kafka. 2 or more years of experience in developing/customizing messaging related monitoring tools/utilities. Good Scripting knowledge/experience with one or more (ex. Chef, Ansible, Terraform). Good programming knowledge/experience with one or more languages (ex. Java, node.js, python) Considerable experience in implementing Kerberos Security. Support 24*7 Model and be available to support rotational on-call work Competent working in one or more environments highly integrated with an operating system. Experience implementing and administering/managing technical solutions in major, large-scale system implementations. High critical thinking skills to evaluate alternatives and present solutions that are consistent with business objectives and strategy. Ability to manage tasks independently and take ownership of responsibilities Ability to learn from mistakes and apply constructive feedback to improve performance Ability to adapt to a rapidly changing environment. Proven leadership abilities including effective knowledge sharing, conflict resolution, facilitation of open discussions, fairness and displaying appropriate levels of assertiveness. Ability to communicate highly complex technical information clearly and articulately for all levels and audiences. Willingness to learn new technologies/tool and train your peers. Proven track record to automate.

Experience in Java, Apache Kafka, Streams, Clusters Application Development, Topic Management, Data Pipeline Development, Producer & Consumer Implementation, Integration & Connectivity, Cluster Administration, Security & Compliance, Apache Zookeeper Required Candidate profile 7 -10 year exp in Kafka Expertis, Programming Skill, Big Data & Streaming Technologie, Database Knowledge, Cloud & DevOp, Event-Driven Architecture, Security & Scalability, Problem Solving & Teamwork

Role & responsibilities Urgent Hiring for one of the reputed MNC for Kafka Developer Exp - 7 - 11 Years Only immediate Joiners Location - Pune , Chennai , Noida Educational Background A degree in Computer Science, IT, or a related field. Kafka Expertise Strong knowledge of Kafka architecture, brokers, producers, consumers, and stream processing. Programming Skills Proficiency in Java, Scala, or Python for developing Kafka-based applications. Big Data & Streaming Technologies Experience with Spark, Flink, or Apache Storm is a plus. Database Knowledge Familiarity with SQL and NoSQL databases like Cassandra, MongoDB, or PostgreSQL. Cloud & DevOps Experience with cloud platforms (AWS, Azure, GCP) and Kubernetes/Docker. Event-Driven Architecture Understanding of event-driven and microservices architectures. Monitoring & Debugging Experience with Kafka monitoring tools like Confluent Control Center, Kafka Manager, or ELK stack. Security & Scalability Knowledge of Kafka security, access control, and scaling strategies. Problem-Solving & Communication Strong analytical skills and ability to work in cross-functional teams Preferred candidate profile Kafka Application Development Data Pipeline Development Producer & Consumer Implementation Integration & Connectivity Performance Optimization Security & Compliance Cluster Administration Monitoring & Logging Documentation Perks and benefits

Strong experience on development on Java /J2EE technologies, Spring boot, REST API, Transactions management, ACID properties. Strong understanding of OOP concepts, design patterns Working Experience on Microservices using Spring boot Experience on Kafka Streams, Kafka Producer/Consumer API, Avro Good knowledge on Kafka Broker, Zookeeper, Schema registry, topics etc., Experience on Azure cloud, Kubernetes, Docker, Helm etc., Strong experience in databases such as (DB2, Postgres, SQL) or similar. Good experience in Test driven development Experience in working with Jira, GitHub, Azure DevOps Agile Good communications skills

J ob Description: Senior Kafka Developer, Having over around 7+ years of experience in different integration technologies, data streaming technologies and Kafka. Solid understanding of Kafka architecture and experience in using Kafka. Ensure optimum performance, high availability and stability of solutions Strong hands-on designing integration solutions using Kafka and aware of integration best practices for data streaming solutions. Strong awareness of Kafka ecosystem, Zookeeper, Kafka cluster, Kafka broker, producer, consumer, Connectors, different APIs, Kafka Topic etc. Strong hands-on SQL connector, HTTP connector etc. Strong knowledge on different APIs exposed by Kafka to handle the integration, data steaming and for data management. Strong awareness on designing deployment architecture for Kafka solutions. Solid hands-on Kafka deployment and configuration. Experience on production deployment, invoke Kafka components as background processes, configuration, trouble shooting and environment maintenance. Location:Pune

About The Role Must have: Java , SpringBoot , Microservices. Good to Have Kafka or GraphQL What will you do? Interact and collaborate with customers andpartners to define the integration landscape. Define the logical sequence of integrationactivities for a SaaS onboarding project. Coordinate with the product development teamto implement recommended integration strategies. Improve overall project delivery experienceand go-live time by improving process and documentation. Support cloud infrastructure and systemcomponents required for integration. Lead the identification, isolation,resolution, and communication of issues within a client environment. What do Ineed to succeed? Must have Worked on at least one end to end SaaSimplementation project. 2+ years of application and data integrationexperience. Experience with clustering and highavailability configurations. Agile experience. Designed an end-to-end scalable integrationsolution. Broad exposure to different technology stacksinvolved in a SaaS delivery model. Broad and in-depth knowledge of o data integration concepts and tools o network protocol stacks and related integrationparadigms o security postures in integration technologystacks o API design and API based integration o Azure, AWS and GCP public cloud platforms andprovided services and their integration approaches o Integration frameworks used by SaaS applications. Skilled technical documenter. Solution designer at heart. Experience in using modeling tools to createeffective architecture views. Strong organizational, analytical, criticalthinking, and debugging skills. Excellent communication skills. Ability to break down complex technical andfunctional requirements and effectively articulate / communicate them todifferent stakeholders involved in a project. Self-starter willing to get involved in allaspects of solution delivery including implementation and processimprovement. Broad picture minded - one who sees theend-to-end solution of a project. Nice to have Domain knowledge of banking and financialinstitutions and/or large enterprise IT environment. Strong delivery experience with geographicallydistributed delivery and client teams. Strong knowledge and hands-on experience withsetting up and configuration of Kafka brokers. Strongknowledge and experience with the Kafka Connect Framework including workingwith multiple connector typesHTTP, RESTful APIs, JMS check(event) ; career-website-detail-template-2 => apply(record.id,meta)" mousedown="lyte-button => check(event)" final-style="background-color:#6875E2;border-color:#6875E2;color:white;" final-class="lyte-button lyteBackgroundColorBtn lyteSuccess" lyte-rendered=""> I'm interested

5- 7 years of Confluent Kafka platform experience Administration of Confluent Kafka Platform on Prem and in the Cloud Knowledge of Confluent Kafka operations Administration of Topics, Partitions, Consumer groups and kSQL queries to maintain optimal performance. Knowledge of Kafka ecosystem including Kafka Brokers, Zookeeper/KRaft, kSQL, Connectors, Schema Registry, Control Center, and platform interoperability. Knowledge of Kafka Cluster Linking and replication Experience with administering Multi Regional Confluent Clusters System Performance: Knowledge of performance tuning of messaging systems and clients to meet application requirements. Operating Systems: RedHat Linux Employee Type: Permanent