Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Jobs

Interviews

Home
>
Jobs in chennai
>
Sopra Steria
>
Apache Spark Senior Technical Lead

Apache Spark Senior Technical Lead

Sopra Steria

6 - 12 years

8 - 14 Lacs

chennai

Posted:3 weeks ago| Platform:

Apply

Skills Required

automation linux production support agile scrum oracle release management unix shell scripting analytics python

Work Mode

Work from Office

Job Type

Full Time

Job Description

Job Title:

Technical Lead/Senior Technical Lead

Location:

Chennai

Total Experience Expected

: 06-12 years

Role Overview:

We are looking for a skilled Data Engineer to build and maintain scalable data pipelines, manage large datasets, and support analytics initiatives. This role involves working with Big Data technologies like Spark, Scala, SQL/PLSQL, and cloud-ready environments.

Experience:

8+ years of relevant experience in data engineering / big data development
Proven track record of handling large-scale data solutions

Maintain, develop, and design data ingestion and transformation pipelines using Spark and Scala
Process and optimize SQL and PL/SQL queries for large datasets
Integrate and process data from multiple sources for analytics and reporting
Collaborate with BI and Analytics teams to support reporting and dashboard needs
Ensure data quality, performance, and security
Provide innovative solutions to complex business/technical problems
Identify and resolve technical, integration and development issues
Implement best practices, standards and processes to ensure quality of the final product
Responsible for development of features independently
Continuous build, automated testing, and release management
Participate in status meetings and provide regular updates

Required Skills:

Technical:

Expertise in Spark and Scala for large-scale data processing
Proficiency in Python and SQL, including hands-on experience with PL/SQL
Experience in data integration/ETL workflows;
Strong knowledge of relational databases such as Oracle and PostgreSQL

Professional Competencies:

Excellent verbal and written communication skills
Result-oriented with strong analytical and problem-solving skills
Ability to work in a fast-paced, agile, and collaborative environment

Desired Skills:

Exposure to cloud data services (AWS preferred)
Proficiency in Linux/Unix shell scripting for automation and data operation
Experience working in Agile environments Scrum and/or SAFe frameworks
Exposure to DevOps culture and practices, including CI/CD and automation
Understanding of software engineering lifecycle Development, Testing, and Production Support
Experience in production issue handling and transformation support management

Good to Have Skills:

Exposure to Dataiku preferred
Awareness of cloud and big data architecture principles

More Jobs at Sopra Steria

PySpark Module Lead

Bengaluru

4 - 6 yrs

INR 14 - 15 Lacs

SAP PP Senior Functional Analyst

Bengaluru

6 - 8 yrs

INR 8 - 10 Lacs

SAP ABAP UI5 Module Lead

Bengaluru

2 - 6 yrs

INR 15 - 16 Lacs

Full Stack Developer (Java and React)

Noida

8 - 11 yrs

INR 19 - 27 Lacs

Axway B2B Technical Lead

Noida

6 - 8 yrs

INR 8 - 10 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.