Lead Engineer

6 years

0 Lacs

Posted:1 day ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Overview

As a Lead Data Engineer, you will design, build, and maintain scalable backend and distributed systems that power real-time and data-intensive applications. You will have the autonomy to use your expertise in

Java, Scala,

or

Python

—crafting robust microservices, APIs, and integrating event-driven and streaming solutions. This role blends hands-on engineering with architectural responsibility, and offers opportunities to shape our evolving tech stack across batch and streaming environments.

Responsibilities

  • Design, develop, and maintain scalable, production-quality backend microservices and REST/gRPC APIs using your primary language and framework (e.g., Java/Spring Boot, Scala/Akka, Python/FastAPI/Django).
  • Architect and support event-driven and real-time data solutions using messaging or streaming platforms such as Apache Kafka, Apache flink, Apache spark structured streaming, Pulsar, Pub/Sub, or similar.
  • Collaborate in building and optimizing both streaming and batch data pipelines for reliable, timely data delivery.
  • Integrate with, and optimize, relational (PostgreSQL, MySQL) or NoSQL databases, designing schema and high-performance queries.
  • Leverage containerization (Docker) and orchestration (Kubernetes) to build and deploy cloud-native, resilient applications.
  • Contribute to CI/CD pipelines, infrastructure as code, and cloud-native operational practices.
  • Champion secure coding, observability, monitoring, and performance optimization across all services.
  • Collaborate closely with product, data, DevOps, and engineering peers in Agile/Scrum cycles.
  • Mentor team members, participate in code/design reviews, and foster knowledge sharing.

Requirements

  • Bachelor’s degree or higher in Computer Science, Engineering, or a related technical discipline.
  • 6+ years of hands-on software or data engineering experience, including designing and maintaining streaming or real-time data pipelines.
  • Strong expertise with distributed streaming platforms such as Kafka, Flink, Spark Structured Streaming, or Pulsar, and their associated tooling.
  • Strong programming experience in Java, Scala, or Python for backend and distributed systems; proficiency in one major framework (Spring Boot, Django, FastAPI, Akka, etc.).
  • In-depth understanding of event-driven architectures, stateful stream processing, windowing, and exactly-once delivery semantics.
  • Experience architecting robust, high-performance systems optimized for latency, throughput, and resilience.
  • Familiarity with cloud-based streaming services (AWS Kinesis, Google Pub/Sub, Azure Event Hubs) is a plus.
  • Experience working with Docker and Kubernetes for containerization and orchestration is beneficial.
  • Excellent collaboration, problem-solving, and communication skills.

Mock Interview

Practice Video Interview with JobPe AI

Start Java Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Java Skills

Practice Java coding challenges to boost your skills

Start Practicing Java Now

RecommendedJobs for You

chennai, tamil nadu, india

bengaluru, karnataka, india

bengaluru, karnataka, india

chennai, tamil nadu, india

jaipur, rajasthan, india

bengaluru, karnataka, india