4 Confluent Kafka Jobs

10+ years of software development experience building large scale distributed data processing systems/application, Data Engineering or large scale internet systems. Experience of at least 4 years in Developing/ Leading Big Data solution at enterprise scale with at least one end to end implementation Strong experience in programming languages Java/J2EE/Scala. Good experience in Spark/Hadoop/HDFS Architecture, YARN, Confluent Kafka , Hbase, Hive, Impala and NoSQL database. Experience with Batch Processing and AutoSys Job Scheduling and Monitoring Performance analysis, troubleshooting and resolution (this includes familiarity and investigation of Cloudera/Hadoop logs) Work with Cloudera on open issues that would result in cluster configuration changes and then implement as needed Strong experience with databases such as SQL,Hive, Elasticsearch, HBase, etc Knowledge of Hadoop Security, Data Management and Governance Primary Skills: Java/Scala, ETL, Spark, Hadoop, Hive, Impala, Sqoop, HBase, Confluent Kafka, Oracle, Linux, Git, Jenkins CI/CD

About the Role: We are looking for a Senior Engineering Manager with 10+ years of experience and 2 years of people management experience to help scale and modernize Myntra's data platform. The ideal candidate will have a strong background in building scalable data platforms using a combination of open-source technologies and enterprise solutions. The role demands deep technical expertise in data ingestion, processing, serving, and governance, with a strategic mindset to scale the platform 10x to meet the ever-growing data needs across the organization. This is a high-impact role requiring innovation, engineering excellence and system stability, with an opportunity to contribute to OSS projects and build data products leveraging available data assets. Key Responsibilities: Design and scale Myntra's data platform to support growing data needs across analytics, ML, and reporting. Architect and optimize streaming data ingestion pipelines using Debezium, Kafka (Confluent), Databricks Spark and Flink. Lead improvements in data processing and serving layers, leveraging Databricks Spark, Trino, and Superset. Good understanding of open table formats like Delta and Iceberg. Scale data quality frameworks to ensure data accuracy and reliability. Build data lineage tracking solutions for governance, access control, and compliance. Collaborate with engineering, analytics, and business teams to identify opportunities and build / enhance self-serve data platforms. Improve system stability, monitoring, and observability to ensure high availability of the platform. Work with open-source communities and facilitate contributing to OSS projects aligned with Myntras tech stack. Implement cost-efficient, scalable architectures for handling 10B+ daily events in a cloud environment. Management Responsibilities: Technical Guidance : This role will play the engineering lead role for teams within Myntra Data Platform. You will provide technical leadership to a team of excellent data engineers; this requires that you have the technical depth to make complex design decisions and the hands-on ability to lead by example. Execution and Delivery : You will be expected to instill and follow good software development practices and ensure timely delivery of high-quality products. You should be familiar with agile practices as well as be able to adapt these to the needs of the business, with a constant focus on product quality. Team management : You will be responsible for hiring and mentoring your team; helping individuals grow in their careers, having constant dialogue about their aspirations and sharing prompt, clear and actionable feedback about performance. Qualifications: Education: Bachelor's or Masters degree in Computer Science, Information Systems, or a related field. Experience: 10+ years of experience in building large-scale data platforms. 2+ years of people management experience. Expertise in big data architectures using Databricks, Trino, and Debezium. Strong experience with streaming platforms, including Confluent Kafka. Experience in data ingestion, storage, processing, and serving in a cloud-based environment. Experience implementing data quality checks using Great Expectations. Deep understanding of data lineage, metadata management, and governance practices. Strong knowledge of query optimization, cost efficiency, and scaling architectures. Familiarity with OSS contributions and keeping up with industry trends in data engineering. Soft Skills: Strong analytical and problem-solving skills with a pragmatic approach to technical challenges. Excellent communication and collaboration skills to work effectively with cross-functional teams. Ability to lead large-scale projects in a fast-paced, dynamic environment. Passion for continuous learning, open-source collaboration, and building best-in-class data products.

We are looking for a highly skilled Senior Java Developer with strong hands-on experience in cloud platforms, specifically in migrating Java-based applications from AWS to Azure. The ideal candidate will have a deep understanding of Java, Spring Boot, Kubernetes, and both AWS and Azure services, with direct experience in infrastructure, refactoring code for Azure compatibility, and deploying applications in containerized environments. Key Responsibilities: Lead and execute the migration of Java applications from AWS to Azure environments. Analyze source architecture, source code, and AWS service dependencies to identify necessary code and infrastructure remediation. Perform hands-on refactoring and configuration changes to enable application deployment on Azure. Migrate applications and services including EKS to AKS, AWS S3 to Azure Blob Storage, and AWS SDK to Azure SDK. Implement and manage Azure services such as AKS, Azure Functions, Azure App Services, VMs, APIM, and others. Design and update CI/CD pipelines, deployment scripts, and manage Kubernetes environments using Helm charts. Provide application testing support, troubleshooting, and ensure smooth deployment on Azure. Configure and manage related services like Apigee, Kafka connectors, and Azure Blob Storage. Collaborate with DevOps and Infra teams to ensure readiness of IaaS and PaaS environments on Azure. Participate in PostgreSQL data migration (Aurora to Azure PostgreSQL good to have). Required Qualifications & Skills: 8+ years of hands-on experience in Java / Spring Boot application development. Proven experience in cloud migration projects, specifically AWS to Azure. Hands-on experience with AKS, Azure Functions, and Azure DevOps. Experience with AWS and Azure services for application development and deployment. Deep understanding of Azure infrastructure services (IaaS/PaaS). Strong understanding of microservices architecture, containerization, Kubernetes, and Helm. Experience with Apigee, Confluent Kafka, and Spring Boot REST APIs. Proven experience in: AWS to Azure SDK conversion (Must Have) EKS to AKS migration (Must Have) S3 to Azure Blob Storage migration PostgreSQL (Aurora) data migration (Good to Have) Skills : - Senior Java Developer, Java, Spring Boot, Kubernetes, AWS, Azure, AWS to Azure migration, cloud platforms, EKS to AKS migration, AWS S3 to Azure Blob Storage, AWS SDK to Azure SDK, Azure Functions, Azure App Services, Azure VMs, Azure APIM, CI/CD pipelines, deployment scripts, Helm charts, containerized environments, Apigee, Confluent Kafka, Kafka connectors, Azure Blob Storage, IaaS, PaaS, Aurora PostgreSQL, Azure PostgreSQL, application development, microservices, application deployment, cloud migration, Azure infrastructure, Azure DevOps, Spring Boot REST APIs, code remediation, source code analysis, application troubleshooting, application testing support, application refactoring, DevOps collaboration, cloud-native applications, Location : - Hyderabad,Bengaluru,Coimbatore,Pune

Skills : Apache Kafka or Confluent Kafka, Optimization and tuning, in Schema Regitry, KSQL, Connectors, replication across organizations and Cluster LinkingNotice Period: 0- 30 days