Movate Technologies logo

Senior Confluent Cloud Kafka & Flink Engineer

Movate Technologies

10 - 15 years

Chennai Bengaluru

Posted:19 hours ago

Job Description

Experience: 10- 15 Years

Location: Bangalore/Chennai

Work Mode: WFO

Shift: General Shift

Movate is looking for a Senior Confluent Cloud Kafka & Flink Engineer to design, develop and implement enterprise-scale real-time data streaming platforms and event-driven solutions. The role will translate business use cases into secure, reliable and production-grade streaming architectures using Confluent Cloud, Apache Kafka, Confluent Cloud for Apache Flink and modern cloud data platforms. The ideal candidate is a hands-on Confluent specialist with strong solution-architecture capability, deep streaming engineering experience and the ability to independently design, build, deploy and support complete real-time data solutions, rather than focusing only on Kafka administration.

Key Responsibilities

• Lead the architecture, design and implementation of enterprise-scale streaming solutions using Confluent Cloud, Apache Kafka and Confluent Cloud for Apache Flink. • Design Kafka topics, producers, consumers, partitions and replication strategies for scalable and reliable event processing. • Build and manage Kafka Connect integrations, managed connectors and Change Data Capture (CDC) pipelines. • Develop Flink SQL solutions for streaming transformations, joins, aggregations, windowing and event-time processing. • Configure and optimize Confluent Flink compute pools, materialized tables and streaming workloads. • Implement Confluent Tableflow integrations with Apache Iceberg, Delta Lake and cloud data platforms. • Design schemas using Avro, JSON Schema and Protobuf, and manage compatibility, versioning and schema evolution through Schema Registry. • Establish stream governance using Stream Catalog, Stream Lineage, data contracts and enterprise governance practices. • Automate Confluent Cloud infrastructure and environment management using the Confluent Terraform Provider. • Integrate streaming deployments with CI/CD pipelines and implement repeatable DevOps practices across environments. • Implement security controls using RBAC, ACLs, service accounts, API keys and secure REST API integrations. • Design and support Cluster Linking and Schema Linking for multi-cluster and cross-environment streaming requirements. • Deliver end-to-end use cases involving CDC, streaming ETL, real-time analytics, event-driven architectures and data-lake integration. • Troubleshoot production issues and improve platform monitoring, performance, reliability, scalability and cost efficiency. • Provide technical leadership, architecture guidance, code/design reviews and knowledge sharing across engineering teams.

Required Technical Skills

• 10+ years of overall engineering experience with strong hands-on experience in Confluent Cloud and Apache Kafka. • Strong hands-on experience with Confluent Cloud for Apache Flink and Flink SQL. • Deep understanding of Kafka topics, producers, consumers, partitioning, Kafka Connect, managed connectors and CDC. • Experience with streaming transformations, joins, aggregations, windowing and event-time processing. • Experience with Schema Registry, Avro, JSON Schema, Protobuf, schema compatibility, versioning and evolution. Movate | Senior Confluent Cloud Kafka & Flink Engineer • Hands-on experience with Terraform, preferably the Confluent Terraform Provider, infrastructure automation and CI/CD pipelines. • Experience implementing Kafka security using RBAC, ACLs, service accounts and API keys. • Good understanding of Cluster Linking, Schema Linking and multi-environment streaming architectures. • Proficiency in SQL and working knowledge of Java or Python. • Proven experience designing and delivering production-grade streaming use cases. • Strong troubleshooting, architecture, problem-solving, communication and stakeholder-management skills. Preferred Skills • Knowledge of Confluent Tableflow and integration with Apache Iceberg or Delta Lake. • Experience with AWS, Microsoft Azure or Google Cloud Platform. • Exposure to Databricks and modern lakehouse architectures. • Confluent certifications or relevant streaming-platform credentials. • Experience optimizing streaming-platform performance, reliability and cloud cost. • Prior technical leadership, architecture ownership, mentoring or cross-team enablement experience.

Qualifications

• Bachelor's degree in Computer Science, Engineering or a related discipline, or equivalent practical experience.

• Ability to translate business requirements into end-to-end real-time streaming architectures.

• Ability to independently design, develop, deploy and support enterprise-grade streaming solutions

Skills Required

Senior SQL Cloud Connect Confluent Apache Kafka Kafka Streams

Learn the skills this job asks for

Free courses, interview questions and practice for each skill.

Work Mode

Work from Office

Job Type

Full Time

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
Movate Technologies logo
Movate Technologies

RecommendedJobs for You

Movate Technologies logo

Chennai, Bengaluru

Movate Technologies logo

Chennai, Bengaluru