49771 Spark Jobs

Setup a job Alert
JobPe aggregates results for easy application access, but you actually apply on the job portal directly.

5.0 - 8.0 years

27 - 42 Lacs

bengaluru

Work from Office

Job Summary The NetApp Keystone team develops cutting-edge technologies that power NetApp’s pay-as-you-go subscription services, enabling customers to manage data seamlessly on-premises or in the cloud. As a software engineer in this organization, you will work on complex projects, breaking down challenging requirements into simple, scalable solutions while applying engineering best practices. This role offers the opportunity to tackle unsolved customer issues, influence feature improvements across engineering teams, learn storage as a subscription service, and collaborate with peers to deliver an exceptional customer experience. Job Requirements 5+ years’ experience in Data Engineering and ...

Posted 19 hours ago

AI Match Score
Apply

4.0 - 9.0 years

10 - 18 Lacs

gurugram, bengaluru, mumbai (all areas)

Work from Office

Role & responsibilities Location: Bangalore / Pune / Mumbai / Gurgaon / Noida Experience Level: Associate / Senior Associate Experience Range: 4-7 years Key Skills: Python, Spark, Hadoop, NoSQL,Azure Job Description: We are hiring a Data Engineer to design and implement scalable data pipelines and architectures. The ideal candidate should have experience in big data frameworks such as Hadoop and Spark, and hands-on expertise in Python , Azure and NoSQL databases. Responsibilities: Develop and maintain data pipelines for processing large datasets. Work with distributed data systems like Hadoop and Spark. Implement ETL workflows and data transformations. Collaborate with analytics and engineer...

Posted 20 hours ago

AI Match Score
Apply

4.0 - 9.0 years

10 - 18 Lacs

gurugram, bengaluru, mumbai (all areas)

Work from Office

Role & responsibilities Location: Bangalore / Pune / Mumbai / Gurgaon / Noida Experience Level: Associate / Senior Associate Experience Range: 4-7 years Key Skills: Python, Spark, Hadoop, NoSQL,AWS Job Description: We are hiring a Data Engineer to design and implement scalable data pipelines and architectures. The ideal candidate should have experience in big data frameworks such as Hadoop and Spark, and hands-on expertise in Python , AWS and NoSQL databases. Responsibilities: Develop and maintain data pipelines for processing large datasets. Work with distributed data systems like Hadoop and Spark. Implement ETL workflows and data transformations. Collaborate with analytics and engineering ...

Posted 20 hours ago

AI Match Score
Apply

4.0 - 9.0 years

10 - 18 Lacs

gurugram, bengaluru, mumbai (all areas)

Work from Office

Role & responsibilities Location: Bangalore / Pune / Mumbai / Gurgaon / Noida Experience Level: Associate / Senior Associate Experience Range: 4-7 years Key Skills: Python, Spark, Hadoop, NoSQL Job Description: We are hiring a Data Engineer to design and implement scalable data pipelines and architectures. The ideal candidate should have experience in big data frameworks such as Hadoop and Spark, and hands-on expertise in Python and NoSQL databases. Responsibilities: Develop and maintain data pipelines for processing large datasets. Work with distributed data systems like Hadoop and Spark. Implement ETL workflows and data transformations. Collaborate with analytics and engineering teams for ...

Posted 20 hours ago

AI Match Score
Apply

4.0 - 8.0 years

11 - 21 Lacs

pune, chennai

Work from Office

Role: Data Engineer Experience: 4-8 Years Relevant Experience in Data Engineer : 4+ Years Notice Period: Immediate Joiners Only Job Location: Pune and Chennai Key Responsibilities: Mandatory Skill: Spark,SQL and Python Must Have: Relevant experience of 3-7 years as a Data Engineer SQL: 3+ years of experience Spark: 3+ years of experience NoSQL Databases: 1-2 years of experience Experience in programming language like Python Good Understanding of ETL (Extract, Transform, Load) concepts Good analytical and problem-solving skills Knowledge of a ticketing tool like JIRA/SNOW Good communication skills to interact with Customers on issues & requirements. Reach us:If you are interested in this posi...

Posted 21 hours ago

AI Match Score
Apply

6.0 - 8.0 years

15 - 22 Lacs

pune, chennai

Work from Office

Role: Data Engineer Experience: 6-8 Years Relevant Experience in Data Engineer : 6+ Years Notice Period: Immediate Joiners Only Job Location: Pune and Chennai Key Responsibilities: Mandatory Skill: Spark,SQL and Python Must Have: Relevant experience of 6-7 years as a Data Engineer SQL: 3+ years of experience Spark: 5+ years of experience NoSQL Databases: 1-2 years of experience Experience in programming language like Python Good Understanding of ETL (Extract, Transform, Load) concepts Good analytical and problem-solving skills Knowledge of a ticketing tool like JIRA/SNOW Good communication skills to interact with Customers on issues & requirements. Reach us:If you are interested in this posi...

Posted 21 hours ago

AI Match Score
Apply

24.0 - 27.0 years

25 - 30 Lacs

hyderabad

Work from Office

ABOUT THE ROLE Role Description: The role is responsible for leading and charting the course for Corporate Functions, Data & Analytics team that builds and transforms technology capabilities that positively impacts business outcomes. This individual will be responsible for leading a highly talented team that is built for delivering high-end and innovative technologies. The ideal candidate will have a proven track record of leadership in technology-driven environments for Finance and HR business area and has a passion for fostering innovation and excellence in the biotechnology industry. Additionally, collaboration with cross-functional and global teams is required to ensure seamless integrat...

Posted 21 hours ago

AI Match Score
Apply

5.0 - 10.0 years

7 - 12 Lacs

pune

Work from Office

Title and Summary Software Engineer II_Dev/Ops (CI/CD tools (e.g., Jenkins, Git).Chef, XLR, Linux) Job Title Overview Software Engineer II Data Platform Engineering Location Pune, India About the Role As a Software Engineer II on the enterprise-wide Data Platform team, you will focus on automating infrastructure, streamlining deployment processes, and improving system reliability. Youll work closely with senior engineers to build and maintain DevOps pipelines, monitor distributed systems, and support platform operations using technologies like NiFi, Spark, MinIO, Kubernetes, Airflow, and cloud-native tools. Key Responsibilities Develop and maintain CI/CD pipelines for automated deployment an...

Posted 21 hours ago

AI Match Score
Apply

6.0 - 9.0 years

14 - 24 Lacs

pune, chennai

Work from Office

Role: Data Engineer Experience: 6-9Years Relevant Experience in Data Engineer: 6+ Years Notice Period: Immediate Joiners Only Job Location: Pune and Chennai Key Responsibilities: Mandatory Skill: Spark,SQL and Python Must Have: Relevant experience of 6-9 years as a Data Engineer Experience in programming language like Python Good Understanding of ETL (Extract, Transform, Load) concepts Good analytical and problem-solving skills Knowledge of a ticketing tool like JIRA/SNOW Good communication skills to interact with Customers on issues & requirements. Reach us:If you are interested in this position and meet the above qualifications, please reach out to me directly at swati@cielhr.com and share...

Posted 21 hours ago

AI Match Score
Apply

5.0 - 8.0 years

7 - 14 Lacs

pune, chennai

Hybrid

Senior Data Engineer Experience: 6-8 Years Relevant Exp : 5 Years Location : Pune/Chennai Notice Period : Immediate Joiner Requirements: Mandatory Skills : SPARK, PYTHON, SQL Bachelor's or Master's degree in Computer Science, Engineering, or a related field. 5+ years of experience as a Data Engineer or similar role. Proficiency in Spark, Scala, Hive, Python, and Snowflake. Strong understanding of ETL processes and data warehousing concepts. Experience with SQL and NoSQL databases. Excellent problem-solving skills and attention to detail. Strong communication and collaboration skills. Ability to work independently and as part of a team. Preferred Qualifications: Experience with cloud services...

Posted 21 hours ago

AI Match Score
Apply

3.0 - 8.0 years

9 - 13 Lacs

bengaluru

Work from Office

Role & responsibilities Develop, test, and maintain high-quality Python applications. Write efficient, reusable, and reliable code following best practices. Optimize applications for performance, scalability, and security. Collaborate with cross-functional teams to define, design, and deliver new features. Design and manage databases using SQL to support application functionality. Think from a customer's perspective to provide the best user experience. Participate in code reviews to maintain code quality and share knowledge. Troubleshoot and resolve software defects and issues. Continuously learn and apply new technologies and best practices. Propose and influence architectural decisions to ...

Posted 21 hours ago

AI Match Score
Apply

5.0 - 8.0 years

15 - 30 Lacs

ahmedabad

Work from Office

About Us Zuru Tech is digitalizing the construction process of buildings all around the world. We have a multi-national team developing the worlds first digital building fabrication platform, you design, we build it! We at ZURU develop the Zuru Home app, a BIM software meant for the general public, architects, and engineers, from here anyone can buy, design, and send to manufacturing any type of building with complete design freedom. Welcome to the future! What are you Going to do? Architect and develop complex data pipelines, ETL/ELT workflows, and data models on platforms such as Snowflake, Databricks, Azure Synapse, Redshift, BigQuery, etc. Build scalable data transformation pipelines usi...

Posted 21 hours ago

AI Match Score
Apply

6.0 - 7.0 years

15 - 25 Lacs

pune, chennai

Work from Office

Role: Data Engineer Experience: 6-9Years Relevant Experience in Data Engineer: 6+ Years Notice Period: Immediate Joiners Only Job Location: Pune and Chennai Key Responsibilities: Mandatory Skill: Spark,SQL and Python Must Have: Relevant experience of 6-9 years as a Data Engineer Experience in programming language like Python Good Understanding of ETL (Extract, Transform, Load) concepts Good analytical and problem-solving skills Knowledge of a ticketing tool like JIRA/SNOW Good communication skills to interact with Customers on issues & requirements. Reach us:If you are interested in this position and meet the above qualifications, please reach out to me directly at swati@cielhr.com and share...

Posted 21 hours ago

AI Match Score
Apply

5.0 - 10.0 years

0 - 2 Lacs

pune, chennai

Work from Office

Mandatory Skill: 1. Spark 2. SQL 3. Python JD: Must Have: • Relevant experience of 5-8yrs as a Data Engineer. • Preferred experience in related technologies as follows: • SQL: 2-4 years of experience • Spark: 1-2 years of experience • NoSQL Databases: 1-2 years of experience • Database Architecture: 2-3 years of experience • Cloud Architecture: 1-2 years of experience • Experience in programming language like Python • Good Understanding of ETL (Extract, Transform, Load) concepts • Good analytical and problem-solving skills • Inclination for learning & be self-motivated. • Knowledge of ticketing tool like JIRA/SNOW. • Good communication skills to interact with Customers on issues & requiremen...

Posted 21 hours ago

AI Match Score
Apply

6.0 - 8.0 years

19 - 25 Lacs

pune, chennai

Hybrid

Role: Data Engineer Experience: 6-9Years Relevant Experience in Data Engineer: 5+ Years Notice Period: Immediate Joiners Only Job Location: Pune and Chennai Key Responsibilities: Mandatory Skill: Spark,SQL and Python Must Have: Relevant experience of 6-9 years as a Data Engineer Experience in programming language like Python Good Understanding of ETL (Extract, Transform, Load) concepts Good analytical and problem-solving skills Knowledge of a ticketing tool like JIRA/SNOW Good communication skills to interact with Customers on issues & requirements. Reach us:If you are interested in this position and meet the above qualifications, please reach out to me directly at swati@cielhr.com and share...

Posted 21 hours ago

AI Match Score
Apply

5.0 - 10.0 years

25 - 27 Lacs

hyderabad

Remote

This is a remote position. Location - Hyderabad/Bangalore/Gurugram/Pune/Mumbai Work type: Remote but physical onboarding will be conducted & candidate needs to visit office in 3 to 6 month for conference Key Points Must Have Advanced Java proficient- Microservices Spring boot Writing SQL Queries (proficient) AWS 4-5 Yrs in Java, Exp:2-3 exp - Spark Good to have Unix Shell scripting JD - Minimum of 8 years of experience in building complex Data Platforms and Data Engineering solutions. - Minimum of 6 years of hands on experience in architecture and development of data solutions in AWS environment using AWS Services - Experience with big data technologies such as: Spark, EMR, Hadoop, Hive, - E...

Posted 21 hours ago

AI Match Score
Apply

8.0 - 12.0 years

60 - 80 Lacs

noida

Work from Office

Design and manage cloud-native ML platforms supporting training, inference, and model lifecycle automation. Build ML/ETL pipelines using Apache Airflow / AWS MWAA and distributed data workflows using Apache Spark (EMR/Glue).

Posted 22 hours ago

AI Match Score
Apply

0 years

0 Lacs

chennai, tamil nadu, india

On-site

Company Description At Void's Laboratory, we craft digital experiences designed to captivate and engage audiences by combining creativity, strategy, and innovation. From stunning graphic designs to high-energy Instagram Reels and viral YouTube Shorts, we specialize in transforming ideas into powerful visual stories. Whether bringing a brand to life or enhancing a digital presence, Void's Laboratory is dedicated to creating unforgettable visual content. Our creative team operates as a digital laboratory where visions are brought to life with a spark of magic. We take care of our customers whole digital journey from video production to lead generations. Role Description This is a full-time, on...

Posted 22 hours ago

AI Match Score
Apply

5.0 years

0 Lacs

gurgaon, haryana, india

On-site

Position Summary This is the Requisition for Employee Referrals Campaign and JD is Generic. We are looking for Associates with 5+ years of experience in delivering solutions around Data Engineering, Big data analytics and data lakes, MDM, BI, and data visualization. Experienced to Integrate and standardize structured and unstructured data to enable faster insights using cloud technology. Enabling data-driven insights across the enterprise. Job Responsibilities He/she should be able to design implement and deliver complex Data Warehousing/Data Lake, Cloud Data Management, and Data Integration project assignments. Technical Design and Development – Expertise in any of the following skills. Any...

Posted 22 hours ago

AI Match Score
Apply

6.0 - 8.0 years

0 Lacs

coimbatore, tamil nadu, india

On-site

About The Company NovintiX is a fast-growing engineering and digital transformation consultancy serving top Life Sciences, MedTech, and Healthcare clients across the US, Ireland, and Europe. We specialise in delivering high-impact digital programs, engineering services, and talent solutions that accelerate innovation, efficiency, and compliance. Responsbilities Design and implement data pipelines for supply chain data (e.g., inventory, shipping, procurement). Develop and maintain data warehouses and data lakes. Ensure data quality, integrity, and security. Collaborate with supply chain stakeholders to identify analytics requirements. Develop data models and algorithms for predictive analytic...

Posted 22 hours ago

AI Match Score
Apply

175.0 years

0 Lacs

chennai, tamil nadu, india

On-site

At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career. Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express. How will you make an impact in this role? You’ll play a key role in driving automation, building robust data integration services, and enabling seamless connectivi...

Posted 22 hours ago

AI Match Score
Apply

8.0 years

0 Lacs

hyderabad, telangana, india

On-site

Senior Data Scientist About the Global Analytics Team The mission of Global Analytics is to lead HEINEKEN into becoming a data-driven company and the best-connected brewer. As a team, we foster a data-driven entrepreneurial culture across the company. We act as an incubator for smart data products in all business areas from sales to logistics, marketing, and purchasing rapidly launching value-creating use cases, such as optimized spare parts management and smarter media spending. This year, our focus is to scale these and other use cases to as many countries as possible around the globe. Our team comprises data scientists, engineers, business intelligence specialists, and analytics translato...

Posted 22 hours ago

AI Match Score
Apply

0 years

0 Lacs

india

Remote

Job description Job Type: Remote | Full-time Salary: Competitive, based on experience & performance (budget under INR 5 LPA CTC) At WrittenlyHub, we're redefining what it means to create content and shape a workplace culture that’s as dynamic as we are. We’re looking for a Social Media Manager to elevate our brand presence on LinkedIn and Instagram. If you’re passionate about crafting compelling content, building community connections, and driving brand visibility, this is the role for you! What You’ll Do: Create and Curate Content: Develop posts, articles, and stories that grab attention and engage our B2B audience. Analyze & Optimize: Track performance and adjust strategies to maximize eng...

Posted 22 hours ago

AI Match Score
Apply

3.0 - 6.0 years

11 - 21 Lacs

bengaluru

Hybrid

About Narayana Health: Narayana Health is headquartered in Bengaluru, India, and operates a network of hospitals in India and Overseas. Our mission is to deliver high quality, affordable healthcare services to the broader population. Narayana Health Group is Indias leading healthcare provider and one of the largest hospital groups in the country with a network of 21 hospitals, 5 heart centers, and 19 primary care facilities. The NH group treats over 2.6 Million patients every year from over 78 countries covering 30+ medical specialties. Our Centers of Excellence help in treating Adult & Pediatric patients and we have one of the largest transplant centers in India. We have a strong presence a...

Posted 22 hours ago

AI Match Score
Apply

9.0 years

0 Lacs

delhi

Remote

Established in 2004, OLIVER is the world's first and only specialist in designing, building, and running bespoke in-house agencies and marketing ecosystems for brands. We partner with over 300 clients in 40+ countries and counting. Our unique model drives creativity and efficiency, allowing us to deliver tailored solutions that resonate deeply with audiences. As a part of The Brandtech Group , we're at the forefront of leveraging cutting-edge AI technology to revolutionise how we create and deliver work. Our AI solutions enhance efficiency, spark creativity, and drive insightful decision-making, empowering our teams to produce innovative and impactful results. Role: Product Marketing Manager...

Posted 22 hours ago

AI Match Score
Apply

Exploring Spark Jobs in India

The demand for professionals with expertise in Spark is on the rise in India. Spark, an open-source distributed computing system, is widely used for big data processing and analytics. Job seekers in India looking to explore opportunities in Spark can find a variety of roles in different industries.

Top Hiring Locations in India

  1. Bangalore
  2. Pune
  3. Hyderabad
  4. Chennai
  5. Mumbai

These cities have a high concentration of tech companies and startups actively hiring for Spark roles.

Average Salary Range

The average salary range for Spark professionals in India varies based on experience level: - Entry-level: INR 4-6 lakhs per annum - Mid-level: INR 8-12 lakhs per annum - Experienced: INR 15-25 lakhs per annum

Salaries may vary based on the company, location, and specific job requirements.

Career Path

In the field of Spark, a typical career progression may look like: - Junior Developer - Senior Developer - Tech Lead - Architect

Advancing in this career path often requires gaining experience, acquiring additional skills, and taking on more responsibilities.

Related Skills

Apart from proficiency in Spark, professionals in this field are often expected to have knowledge or experience in: - Hadoop - Java or Scala programming - Data processing and analytics - SQL databases

Having a combination of these skills can make a candidate more competitive in the job market.

Interview Questions

  • What is Apache Spark and how is it different from Hadoop? (basic)
  • Explain the difference between RDD, DataFrame, and Dataset in Spark. (medium)
  • How does Spark handle fault tolerance? (medium)
  • What is lazy evaluation in Spark? (basic)
  • Explain the concept of transformations and actions in Spark. (basic)
  • What are the different deployment modes in Spark? (medium)
  • How can you optimize the performance of a Spark job? (advanced)
  • What is the role of a Spark executor? (medium)
  • How does Spark handle memory management? (medium)
  • Explain the Spark shuffle operation. (medium)
  • What are the different types of joins in Spark? (medium)
  • How can you debug a Spark application? (medium)
  • Explain the concept of checkpointing in Spark. (medium)
  • What is lineage in Spark? (basic)
  • How can you monitor and manage a Spark application? (medium)
  • What is the significance of the Spark Driver in a Spark application? (medium)
  • How does Spark SQL differ from traditional SQL? (medium)
  • Explain the concept of broadcast variables in Spark. (medium)
  • What is the purpose of the SparkContext in Spark? (basic)
  • How does Spark handle data partitioning? (medium)
  • Explain the concept of window functions in Spark SQL. (advanced)
  • How can you handle skewed data in Spark? (advanced)
  • What is the use of accumulators in Spark? (advanced)
  • How can you schedule Spark jobs using Apache Oozie? (advanced)
  • Explain the process of Spark job submission and execution. (basic)

Closing Remark

As you explore opportunities in Spark jobs in India, remember to prepare thoroughly for interviews and showcase your expertise confidently. With the right skills and knowledge, you can excel in this growing field and advance your career in the tech industry. Good luck with your job search!

cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Featured Companies