Big Data Engineer - Spark / Scala

AVE-Promagne Business Solutions

5 - 10 years

20 - 27 Lacs

mumbai bengaluru

Posted:2 weeks ago| Platform:

Apply

Skills Required

spark data lakes azure scala apache spark sql memory management gcp snowflake ci/cd big data engineering databricks aws

Work Mode

Work from Office

Job Type

Full Time

Job Description

Your Responsibilities
Design and develop scalable data pipelines using Apache Spark and ScalaOptimize and troubleshoot Spark jobs for performance (e.g. memory management, shuffles, skew)Work with massive datasets in on-prem Hadoop clusters or cloud platforms like AWS/GCP/AzureWrite clean, modular Scala code using functional programming principlesCollaborate with data teams to integrate with platforms like Snowflake, Databricks, or data lakesEnsure code quality, documentation, and CI/CD practices are followedMust-Have Skills3+ years of experience with Apache Spark in ScalaDeep understanding of Spark internalsDAG, stages, tasks, caching, joins, partitioningHands-on experience with performance tuning in production Spark jobsProficiency in Scala functional programming (e.g. immutability, higher-order functions, Option/Either)Proficiency in SQLExperience with any major cloud platform: AWS, Azure, or GCP

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now

AVE-Promagne Business Solutions

Business Consulting and Services

CHENNAI Tamil Nadu

Login to

Please Verify Your Phone or Email

Confirm Action

Search

Profile

Upskill and Grow with AI

Big Data Engineer - Spark / Scala