238 Kafka Streams Jobs - Page 5

JD : KAfka: Design and develop Kafka/Kafka connectors data pipelines and integration solutions. Implement and manage Kafka producers, consumers, topics, and partitions. Integrate Kafka with external systems (e.g., databases, APIs, cloud services). Optimize Kafka performance for throughput, latency, and reliability. Collaborate with DevOps, data engineering, and application teams. Monitor and troubleshoot Kafka clusters and streaming applications. Ensure data security, compliance, and governance in Kafka implementations. Maintain documentation for Kafka configurations, schemas, and processes. Mandatory Skills: Kafka Integration. Experience: 5-8 Years.

As a Java Backend with Kafka, you will be responsible for demonstrating a strong proficiency in Core Java, Spring Boot, and Microservices architecture. Your role will involve hands-on experience with Apache Kafka, including Kafka Streams, Connect, Schema Registry, and Confluent. You will also work with REST APIs, JSON, and event-driven systems. In this position, you should have knowledge of SQL databases such as MySQL and PostgreSQL, as well as NoSQL databases like MongoDB, Cassandra, and Redis. Familiarity with Docker, Kubernetes, and CI/CD pipelines is essential for success in this role. Experience in multi-threading, concurrency, and distributed systems will be beneficial. An understandin...

Responsibilities Deploy and upgrade production-grade Kafka clusters, ensuring high availability and fault tolerance. Automate the installation and configuration of Kafka clusters using tools such as Ansible and Chef. Troubleshoot critical production issues, optimizing Kafka performance and minimizing downtime. Configure MirrorMaker for data replication between two data centers, ensuring effective disaster recovery. Deploy and manage Provectus Kafka UI on a Kubernetes cluster for real-time monitoring and management. Integrate Schema Registry and deploy multiple Kafka Connectors to facilitate seamless data flow. Onboard new users by managing ACL permissions, creating topics, and implementing e...

Job Description As aSenior Software Engineer in our team, you work with large scale manufacturing data coming from our globally distributed plants. You will focus on building efficient, scalable & data-driven applications that - among other use cases - connect IoT devices, pre-process, standardize or enrich data, feed ML models or generate alerts for shopfloor operators. The data sets produced by these applications - whether data streams or data at rest - need to be highly available, reliable, consistent and quality-assured so that they can serve as input towide range of other use cases and downstream applications. We run these applications on a hybrid data platform - Azure Databricks and a ...

Job Description At American Express, our culture is built on a 175-year history of innovation, shared and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career. Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express. How will you make an impact in this role American Express is looking for a hands-on Software Engineer I in the Risk Decision Technology (RDT) organization...

As a skilled engineer, you will play a crucial role in designing robust and scalable data platforms and microservices. Your primary responsibility will be ensuring that architectural and coding best practices are adhered to in order to deliver secure, reliable, and maintainable systems. You will actively engage in debugging complex system issues and work collaboratively with cross-functional teams to define project scope, goals, and deliverables. In this role, you will be tasked with managing priorities, effectively allocating resources, and ensuring the timely delivery of projects. Additionally, you will have the opportunity to lead, mentor, and cultivate a team of 10-15 engineers, fosterin...

As a Strategy professional at Standard Chartered Bank, you will be responsible for tapping into the latest industry trends, innovative products, and solutions to deliver effective and faster product capabilities. Your role will involve supporting CASH Management Operations by leveraging technology to streamline processes, enhance productivity, reduce risk, and improve controls. Your responsibilities will include ensuring timely delivery to business meeting time, cost, and high-quality constraints. You will also support respective businesses in growing Return on investment, commercialization of capabilities, bid teams, monitoring of usage, improving client experience, enhancing operations, an...

Job Title: Software Developer DevOps | Kubernetes, Kafka, Docker Location: Chennai Experience: 2 5 Years Employment Type: Full Time | Permanent Industry: IT Services & Consulting / Banking & Financial Services Functional Area: IT Software – DevOps, Software Development Notice Period : Immediate - short joiners ( Serving np) Job Description Join Banking domain in India Solutions as a Software Developer – One Sourcing Team , where you will be part of a fast-paced and collaborative environment. We are looking for a DevOps-savvy professional with strong expertise in Kubernetes , Kafka , and Docker to manage, scale, and enhance our containerized microservices infrastructure. Key Responsibilities:...

Position Description: Job Title: Senior Software Engineer - Data Engineer with Python, Kafka Streaming & Spark Shift Timings: General Shift Your future duties and responsibilities: Job Summary: CGI is looking for a skilled and proactive Data Engineer with hands-on experience in Kafka streaming, Apache Spark. The ideal candidate will play a key role in designing, developing, and deploying scalable backend systems and real-time data pipelines. This position is ideal for someone passionate about building high-performance systems and working with cutting-edge technologies in cloud-native environments. Key Responsibilities: Develop real-time data streaming applications using Apache Kafka and Kafk...

We are looking for Java Fullstack Lead with the below skills. Key Responsibilities: Design and develop robust APIs and microservices using Java 17 (mandatory) , Spring Boot , and Kafka Streaming . Implement publish/subscribe mechanisms for real-time data processing using Kafka topics . Build responsive and dynamic user interfaces using Angular or Harmony frameworks. Manage and optimize data storage and retrieval using MongoDB . Own the CI/CD pipeline using BitBucket , Jenkins , and OpenShift for containerized deployments. Monitor application performance and health using Dynatrace and LogScale . Collaborate with cross-functional teams to ensure seamless integration and delivery. Maintain high...

You are an experienced Confluent Kafka Administrator responsible for managing and maintaining the Kafka infrastructure. With a minimum of 5 years of experience in Confluent Kafka and expertise in data streaming and real-time data processing, you will handle various responsibilities to ensure the smooth operation of Kafka clusters. Your key responsibilities include installing, configuring, and managing Kafka clusters, monitoring performance for optimization, implementing security measures, integrating Kafka with data sources, planning and executing upgrades and patches, developing disaster recovery plans, documenting configurations and procedures, providing support for Kafka-related issues, a...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

As a Data Platform Engineering Manager at Traceable AI, you will be responsible for designing robust and scalable data platforms and microservices. It will be your duty to ensure that architectural and coding best practices are followed to deliver secure, reliable, and maintainable systems. You will actively participate in debugging complex system issues and work with cross-functional teams to define project scope, goals, and deliverables. Managing priorities, allocating resources effectively, and ensuring timely project delivery will be crucial aspects of your role. In this position, you will lead, mentor, and grow a team of 10-15 engineers, fostering a collaborative and high-performance cu...

NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with the organization. If you are looking to be part of an inclusive, adaptable, and forward-thinking team, then this opportunity in Noida, Uttar Pradesh, India may be the right fit for you. As a Software Engineer on the Digital Platform Team, you will play a crucial role in delivering digitally enabled banking solutions. This position is ideal for engineers with 5+ years of experience who are interested in working on event-driven architectures, real-time data processing, and hybrid cloud environments. Your responsibilities will include developing resilient, scalable, and high-performance application...

You should have experience working with Confluent Kafka. You must possess a strong knowledge of Kafka architecture, Kraft mode (Kafka Raft), Kafka Connect, Kafka Streams, and KSQL. It is essential to have proficiency in scripting languages such as Python, Bash, and automation tools like Ansible and Terraform. Experience with monitoring tools like Prometheus, Grafana, Dynatrace, and Splunk ITSI is required. Understanding of security best practices for Kafka including SSL/TLS, Kerberos, and RBAC is crucial. Strong analytical and problem-solving skills are necessary for this role. Excellent communication and collaboration skills are also expected.,

*Kafka DBA Engineer SME* Exp : 6+years Location : Mumbai *Kafka and Zookeper* *Dev ops tool* : ansible, Nagios, shell scripting python, Jenkins, Ansible, Git, Maven etc. to implement automation *Multiple distribution* : Cloudera, Confluent, open source Kafka etc. *Network infrastructure* : TCP/IP, DNS, Firewall, router, load balancer etc. implementation of security in ecosystem Hadoop Security ranger, Kerberos, SSL etc

Role & responsibilities Kafka DBA Engineer SME Exp : 6+years Location : Mumbai Kafka and Zookeper Dev ops tool : ansible, Nagios, shell scripting python, Jenkins, Ansible, Git, Maven etc. to implement automation Multiple distribution : Cloudera, Confluent, open source Kafka etc. Network infrastructure : TCP/IP, DNS, Firewall, router, load balancer etc. implementation of security in ecosystem Hadoop Security ranger, Kerberos, SSL etc IF INTERESTED KINDLY SHARE ME YOUR CV ON aditya.s@genxhire.in

Role & responsibilities Kafka DBA Engineer SME Exp : 6+years Location : Mumbai Kafka and Zookeper Dev ops tool : ansible, Nagios, shell scripting python, Jenkins, Ansible, Git, Maven etc. to implement automation Multiple distribution : Cloudera, Confluent, open source Kafka etc. Network infrastructure : TCP/IP, DNS, Firewall, router, load balancer etc. implementation of security in ecosystem Hadoop Security ranger, Kerberos, SSL etc IF INTERESTED KINDLY SHARE ME YOUR CV ON 7021112973 OR rashi.s@gmail.in

Job Title: Data Engineer (CDC / Realtime Data Integration) Location: Navi Mumbai, India Experience Level: 46 Years About the Role: We are seeking a skilled and experienced Data Engineer with expertise in Change Data Capture (CDC) and real-time data integration . The ideal candidate will have hands-on experience in designing, implementing, and managing real-time data pipelines using Debezium, Kafka , and related technologies. This role requires building low-latency pipelines that enable instant data availability for analytics, operational reporting, and downstream systems, ensuring data integrity and scalability in a fast-paced environment. Key Responsibilities: Design, develop, and maintain ...

As a Senior Software Engineer - DevOps at INVIDI Technologies Corporation in Bangalore, India, you will be part of a globally acclaimed software development company that revolutionizes television broadcasting. Our Emmy Award-winning technology is utilized by leading cable, satellite, and telco operators worldwide, delivering targeted ads seamlessly across various devices and platforms. INVIDI's innovative solutions have played a pivotal role in shaping the addressable television industry, with clients including major operators, networks, advertising agencies, and prominent brands. In this dynamic and fast-paced environment, you will be at the forefront of commercial television innovation, co...

Role & responsibilities Design, develop, and maintain ETL pipelines to extract, transform, and load data from various sources into Oracle, Snowflake, or cloud data warehouses. Write and optimize PL/SQL scripts, stored procedures, and functions for data processing and performance tuning. Build and configure Talend jobs (or other ETL tools) for batch and real-time data integration. Develop and support data models, schemas, and warehouse structures aligned with business reporting needs. Collaborate with BI teams to enable dashboards and reports in Cognos and Power BI. Implement data quality checks, validations, and reconciliation mechanisms. Work with cloud data platforms (AWS, Azure, or GCP) f...

As an Engineering Manager at Concentric AI, you will be responsible for leading and managing a team of talented engineers in the development and delivery of high-quality software solutions. You will play a crucial role in driving technical excellence, fostering a collaborative team environment, and ensuring the successful execution of projects. People Management The core responsibilities for the job include the following: Lead, mentor, and coach a team of software engineers, fostering a culture of innovation, collaboration, and continuous improvement. Set clear goals and objectives for the team and individuals, and provide regular feedback and performance evaluations. Develop and implement s...

About the Role We are looking for a Staff EngineerReal-time Data Processing to design and develop highly scalable, low-latency data streaming platforms and processing engines. This role is ideal for engineers who enjoy building core systems and infrastructure that enable mission-critical analytics at scale. Youll work on solving some of the toughest data engineering challenges in healthcare. A Day in the Life Architect, build, and maintain a large-scale real-time data processing platform. Collaborate with data scientists, product managers, and engineering teams to define system architecture and design. Optimize systems for scalability, reliability, and low-latency performance. Implement robu...

About the Role We are seeking a highly skilled Senior Data Engineer to design, build, and optimize scalable data platforms that empower data-driven decision-making. This role requires deep technical expertise in modern data engineering frameworks, architectural patterns, and cloud-native solutions on AWS. You will be a key contributor to our data strategy, ensuring data quality, governance, and reliability while mentoring other engineers in the team. Key Responsibilities Design, develop, and own robust, scalable, and maintainable data pipelines (batch & real-time). Architect and implement Data Lake, Data Warehouse, and Lakehouse solutions using modern frameworks and architectural patterns. E...

NVIDIA is searching for a highly motivated software engineer for the NVIDIA NetQ team that is building a next gen Network management and Telemetry system in cloud using modern design principles at internet scale.NVIDIA NetQ is a highly scalable, modern network operations toolset that provides visibility, troubleshooting, and validation of your Cumulus fabrics in real time. NetQ utilizes telemetry and delivers actionable insights about the health of your data center network, integrating the fabric into your DevOps ecosystem. What you'll be doing: Building and maintaining infrastructure components like NoSQL DB (Cassandra, Mongo), TSDB, Kafka etc Maintain CI/CD pipelines to automate the build,...