Scala Data Engineer

Modern Ballistic

8 - 10 years

20 - 30 Lacs

bengaluru

Posted:3 weeks ago| Platform:

Apply

Skills Required

scala azure spark etl sql

Work Mode

Hybrid

Job Type

Full Time

Job Description

Role & responsibilities

Senior Data Engineer

Key Responsibilities

Design, develop, and maintain scalable
data pipelines
using
Scala
and
Apache Spark
.
Optimize
Spark jobs
for performance and cost efficiency in distributed computing environments.
Develop and maintain
SQL queries, stored procedures
, and data transformations for analytics and reporting.
Integrate data from multiple sources ensuring data quality, consistency, and accuracy.
Work closely with
data scientists, analysts, and business stakeholders
to deliver data solutions aligned with requirements.
Implement best practices for
code quality, version control, and CI/CD
in data engineering projects.
Monitor and troubleshoot production data workflows ensuring minimal downtime.
Document technical designs, data models, and ETL processes.

Must-Have Skills

Programming:
Strong expertise in
Scala
(functional programming, concurrency, collections).
Big Data Processing:
Expert in
Apache Spark
(RDD, DataFrame/Dataset API, Spark SQL, optimization techniques).
Database Skills:
Advanced SQL skills for relational and analytical databases (e.g., PostgreSQL, MySQL, Snowflake, Redshift).
ETL/ELT Development:
Experience in designing and implementing large-scale ETL/ELT pipelines.
Data Modeling:
Strong understanding of data warehouse design (Star/Snowflake schema).
Version Control & CI/CD:
Git, Jenkins, or equivalent tools.
Cloud Platforms:
Experience with AWS, Azure, or GCP data services (Glue, Databricks, BigQuery, etc.).
Performance Tuning:
Proven track record of optimizing SQL queries and Spark jobs.

More Jobs at Modern Ballistic

Mainframe Consultant

Hyderabad, Bengaluru

6 - 11 yrs

INR 20 - 30 Lacs

Political Research Analyst

Bengaluru

1 - 6 yrs

INR 3 - 8 Lacs

Geo Political Analyst

Bengaluru

Experience: Not specified

Salary: Not disclosed

Data Scientist

Gandhinagar, Hyderabad, Pune

6.0 - 11.0 yrs

INR 20 - 35 Lacs

Software Developer

Pune

6.0 - 9.0 yrs

INR 20 - 30 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.