Data Engineer - Scala expertise

0 years

0 Lacs

Posted:1 day ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Industry & Sector

A technology services & software exports company operating in the Enterprise Data Engineering and Big Data Analytics sector. We build scalable data platforms, real-time streaming pipelines, and ETL systems that power analytics and data products for global enterprise customers.

Primary Title (best-performing standardized title):

Senior Data Engineer (Scala)

Location & Workplace:

India — On-site

About The Opportunity

We are hiring a hands-on Data Engineer with deep Scala expertise to design, build, and operate high-throughput batch and streaming data pipelines. The role focuses on implementing production-quality Spark jobs, integrating Kafka-based event streams, and ensuring data reliability across the analytics lifecycle. This is an on-site role in India with ownership of end-to-end data solutions for mission-critical workloads.

Role & Responsibilities

  • Design, develop, and maintain scalable data pipelines using Scala and Apache Spark for batch and streaming workloads.
  • Implement Kafka-based ingestion, process streams with structured streaming, and ensure exactly-once or at-least-once guarantees as required.
  • Author efficient Spark SQL transformations and optimize job performance and resource utilization on cluster platforms.
  • Build robust ETL workflows, handle schema evolution, and implement data quality checks and monitoring.
  • Collaborate with data consumers, data scientists, and platform teams to translate requirements into reliable data products and APIs.
  • Participate in CI/CD for data pipelines, troubleshoot production incidents, and create runbooks to improve operational maturity.

Skills & Qualifications

Must-Have
  • Scala
  • Apache Spark
  • Spark SQL
  • Apache Kafka
  • Hadoop HDFS
  • SQL
  • ETL
  • AWS S3

Preferred

  • Databricks
  • Apache Airflow
  • Delta Lake

Benefits & Culture Highlights

  • Fast-paced engineering culture with ownership of end-to-end data products.
  • Opportunities to work on large-scale streaming and analytics for enterprise clients.
  • Structured career growth and technical mentorship within the data engineering practice.
To apply, please highlight your Scala + Spark project experience, examples of Kafka or streaming implementations, and any performance optimization or production debugging you have led.
Skills: sql,scala,apache,apache kafka,etl,spark,apache spark,kafka

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now

RecommendedJobs for You