Principal / Senior Data Engineer – Product Development

7 years

15 - 30 Lacs

Posted:5 days ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Job Title:

Principal / Senior Data Engineer – Product Development
  • Location: Hyderabad (Work from Office only)
  • Experience: 4 – 7 Years
  • Notice Period: Maximum 15 days
  • Compensation: 15 – 30 LPA

About The Company

We are a new-age, AI-first Digital & Cloud Engineering Services company. Our mission is to combine deep engineering expertise with automation-first thinking and AI-native execution to help clients achieve more with speed, precision, and measurable impact. We operate at the intersection of automation, AI, and agile engineering to deliver scalable, high-performance solutions that enable businesses to move faster and operate smarter.

Role Overview

We are looking for a Principal/Senior Data Engineer to join our product development team. In this role, you will be responsible for building and optimizing large-scale distributed data systems, ensuring high performance, availability, and reliability. You will work on ingestion pipelines, parallel processing frameworks, and distributed storage, while contributing to core product development and best engineering practices.

Roles & Responsibilities

  • Design, develop, and maintain scalable distributed data systems.
  • Implement data ingestion pipelines from various sources such as Amazon S3, Azure Cloud Storage, Google Cloud Storage, Snowflake, BigQuery, PostgreSQL, Kafka, and data lakehouses (e.g., Iceberg).
  • Enable high availability, fault tolerance, and cross-region replication for data systems.
  • Build and optimize Spark connectors for efficient data processing.
  • Manage and integrate third-party systems like Kafka and Kafka Connect.
  • Implement monitoring, error reporting, and performance optimization for ingestion and processing workflows.
  • Contribute to core product development, following engineering best practices and Agile methodologies.
  • Collaborate with cross-functional teams to ensure seamless CI/CD integration and reliable deployments.

Requirements

  • Strong knowledge of distributed systems for large-scale, data-intensive applications.
  • Hands-on experience with parallel/distributed processing frameworks.
  • Proficiency in event-driven architectures and stream processing.
  • Good understanding of Agile development and CI/CD pipelines.
  • Linux fundamentals and shell scripting skills.

Must Have Skills

  • Proficiency in Java or Golang.
  • Deep expertise in Kafka (Kafka Connect, Kafka Streams, Kafka Security).
  • Strong experience with Apache Spark and Spark connector development.
  • Strong foundation in Linux and scripting for automation.
Skills: java,golang,kafka,apache spark,linux and scripting,zookeeper,spark,stream processing

Mock Interview

Practice Video Interview with JobPe AI

Start Java Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Java Skills

Practice Java coding challenges to boost your skills

Start Practicing Java Now

RecommendedJobs for You