Lead Big Data Engineer Manager

CIRCANA

7 - 10 years

35 - 50 Lacs

pune

Posted:2 weeks ago| Platform:

Apply

Skills Required

java scala big data spark sql

Work Mode

Hybrid

Job Type

Full Time

Job Description

What will you be doing?

As a part of this team, youll work alongside the brightest minds. As a Big Data Lead evaluate domain, financial and technical feasibility of solution ideas with help of all key stakeholders.
Design, develop, and maintain highly scalable data processing applications.

Job Responsibilities:

Write efficient, reusable and well documented code
Deliver big data projects using
Spark, Scala
, Python, SQL
Maintain and tune existing Spark applications to the fullest.
Find opportunities for optimizing existing spark applications.
Work closely with QA, Operations and various teams to deliver error free software on time.
Actively lead / participate daily agile / scrum meetings.
Take responsibility for Apache Spark development and implementation.

Requirements:

Engineering graduates in computer science backgrounds preferred with 8+ years of software development experience with Hadoop framework components(HDFS, Spark, Spark, Scala, PySpark)
Excellent at verbal, written and presentation skills
Ability to present and defend a solution with technical facts & business proficiency
Understanding of data-warehousing and data-modeling techniques
Strong data engineering skills
Knowledge of Core Java, Linux, SQL, and any scripting language
At least 6+ years of experience using Python / Scala, Spark, SQL
Knowledge of shell scripting is a plus
Knowledge of Core and Advance Java is a plus.
Experience in developing and tuning spark applications
Excellent understanding of spark architecture, data frames and tuning spark
Strong knowledge of database concepts, systems architecture, and data structures is a must Process oriented with strong analytical and problem solving skills
Experience in writing Python standalone applications dealing with PySpark API

More Jobs at CIRCANA

DevOps/ Ops Data Engineer

Bengaluru

3 - 6 yrs

INR 6 - 12 Lacs

Urgent Requirement @Circana - Application Support Role - Bangalore

Bengaluru

4 - 6 yrs

INR 12 - 15 Lacs

Engineering Manager

Bengaluru

12 - 18 yrs

INR 35 - 45 Lacs

Urgent Requirement@ Circana For Devops Role - Bangalore

Bengaluru

3 - 5 yrs

INR 13 - 16 Lacs

QA Manager

Bengaluru

12 - 16 yrs

INR 0 - 0 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Java Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.