48 Hadoop Jobs

You are invited to join Citi as an Officer, Big Data Engineer -C10- Hybrid based in Chennai, India. At Citi, we are shaping the future of banking with a focus on innovation and evolution. As part of our global team, you will have access to resources for your well-being and opportunities for personal and professional growth. **Role Overview:** As a Big Data Engineer at Citi, you will be responsible for working on Big data platforms such as Hadoop and Hive. Your role will involve proficiency in programming languages like Python and PySpark, along with SQL for database management. Strong working knowledge of program languages and excellent communication skills are essential for this position. *...

Your role and responsibilities As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform...

Job Title: Data Engineer AWS + Hadoop Location: Bangalore Experience: 7+ Years About the Role We’re looking for a seasoned Data Engineer with hands-on expertise in AWS data services and the Hadoop ecosystem . You will design, build, and optimize batch/streaming data pipelines, enable reliable data ingestion/processing, and support analytics, ML, and BI use cases at scale. Key Responsibilities Design and implement scalable ETL/ELT pipelines for batch and streaming workloads. Build data ingestion frameworks using Kafka/Kinesis , and process data with Spark (PySpark/Scala). Develop and optimize data lakes and data warehouses on AWS (S3, Glue, EMR, Athena, Redshift). Manage and tune Hadoop ecosy...

In the role of Senior Associate in data and analytics engineering at PwC, you will focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. Your responsibilities will include designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be tasked with developing and implementing data pipelines, data integration, and data transformation solutions to transform raw data into actionable insights for informed decision-making and driving business growth. **Key Responsibilities:** - Design, develop, and optimize data pipelines and ETL processes using PySpark or Scala to extract, transform, a...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and d...

As an Associate Software Developer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big ...

Hadoop Developer Exp- 4 yrs to 8 yrs Location - Indore Must-Have Extensive experience and hands on implementation experience with Spark, Scala, Impala, Hive, Kafka, SQOOP Good-to-Have Extensive knowledge with Data frames, Data Sets and RDDs Location Indore Job Function IT INFRASTRUCTURE SERVICES Role Developer Job Id 392540 Desired Skills Big Data | Hadoop Desired Candidate Profile Qualifications : BACHELOR OF ENGINEERING

Python Developer Location- Indore Exp - 4 to 8 years Must-Have Python, Unix Shell Scripting, OOPS Concepts Good-to-Have Hadoop, ML Packages Location Indore Job Function IT INFRASTRUCTURE SERVICES Role Developer Job Id 392546 Desired Skills Python | Unix Shell Scripting Desired Candidate Profile Qualifications : BACHELOR OF ENGINEERING

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and d...

Join us as a Data Analyst in Client Insights team. The Client Insights team exist to create new data products and insights for direct consumption by Barclays corporate clients, and run a range of existing products marketed under Client Insights in Global Transaction Banking, by commercialising the vast data we hold on our clients, their products, markets and competitors. The purpose of the role is to run analytics and reporting for the Market & Customer Insights product within Client Insights, utilising the existing Vantage and Hadoop platforms. It will also involve working with the rest of Client Insights, project leads, and operations team to deliver ad-hoc reporting, new analysis and data...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and d...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developing strea...

AIA Hyd drive Role : Data Scientist AIML Experience : 4 to 13 Years Relevant Experience : 2+ Years Location : Pan India Notice Period : Immediate to 60 days Mode of Interview - In-Person (29th November 2025) Job Description: 1. Be a hands on problem solver with consultative approach, who can apply Machine Learning & Deep Learning algorithms to solve business challenges Use the knowledge of wide variety of AI/ML techniques and algorithms to find what combinations of these techniques can best solve the problem Improve Model accuracy to deliver greater business impact Estimate business impact due to deployment of model 2. Work with the domain/customer teams to understand business context , data...

JD : Technical Skills: Languages: Scala, Java • Big Data Orchestration: Airflow, Spark on Kubernetes, Yarn, Oozie Big Data Processing: Hadoop, Kafka, Spark & Spark Structured Streaming. Experience on SOLID & DRY principles with Good Software Architecture & Design implementation experience Advanced Scala experience (e.g. Functional Programming, using Case classes, Complex Data Structures & Algorithms) Proficient in developing automated frameworks for unit & integration testing. Experience with Docker and Helm and related container technologies. Proficient in deploying and managing Spark workloads on Kubernetes clusters. Experience in evaluation and implementation of Data Validation & Data Qua...

Company Description About Sopra Steria Sopra Steria, a major Tech player in Europe with 50,000 employees in nearly 30 countries, is recognised for its consulting, digital services and solutions. It helps its clients drive their digital transformation and obtain tangible and sustainable benefits. The Group provides end-to-end solutions to make large companies and organisations more competitive by combining in-depth knowledge of a wide range of business sectors and innovative technologies with a collaborative approach. Sopra Steria places people at the heart of everything it does and is committed to putting digital to work for its clients in order to build a positive future for all. In 2024, t...

About Agoda At Agoda, we bridge the world through travel. Our story began in 2005, when two lifelong friends and entrepreneurs, driven by their passion for travel, launched Agoda to make it easier for everyone to explore the world. Today, we are part of Booking Holdings [NASDAQ: BKNG], with a diverse team of over 7,000 people from 90 countries, working together in offices around the globe. Every day, we connect people to destinations and experiences, with our great deals across our millions of hotels and holiday properties, flights, and experiences worldwide. No two days are the same at Agoda. Data and technology are at the heart of our culture, fueling our curiosity and innovation. If you’r...

Apache Spark Technical Lead - French Language Full-time Company Description About Sopra Steria Sopra Steria, a major Tech player in Europe with 50,000 employees in nearly 30 countries, is recognised for its consulting, digital services and solutions. It helps its clients drive their digital transformation and obtain tangible and sustainable benefits. The Group provides end-to-end solutions to make large companies and organisations more competitive by combining in-depth knowledge of a wide range of business sectors and innovative technologies with a collaborative approach. Sopra Steria places people at the heart of everything it does and is committed to putting digital to work for its clients...

As an Associate Lead Data Scientist, you will have the exciting opportunity to work with a dynamic team of researchers, data scientists, and developers. Your primary focus will be on developing and optimizing cutting-edge AI solutions in various industries such as commerce, agriculture, insurance, financial markets, and procurement. Here is a breakdown of your responsibilities: Key Responsibilities: - Develop, optimize, and lead ML, NLP, Deep Learning, and Generative AI model/projects. - Research and implement state-of-the-art algorithms for supervised and unsupervised learning. - Handle large-scale datasets in distributed environments. - Apply the best ML approaches based on an understandin...

As a Lead Data Analyst at Target, you will be exploring data technologies and applying mathematical techniques to derive business insights. Your role will involve determining the best approach to gather, model, manipulate, analyze, and present data. You will lead an agile team, actively participating in ceremonies and team activities. You will have opportunities to continuously upskill by staying current with new technologies through formal training, peer training groups, and self-directed education. Key Responsibilities: - Develop data and metrics to support key business strategies, initiatives, and decisions. - Explore data technologies and apply mathematical techniques to derive business ...

As a Consultant at Capgemini Invent, your role will involve engaging in project activities related to the Information lifecycle. You will work on tasks such as building and managing Business data lakes, ingesting data streams, developing machine learning models, visualizing data, and empowering Information consumers with agile Data Models. Additionally, you will specialize in Business Models and architectures across various Industry verticals. Key Responsibilities: - Engage in project activities related to the Information lifecycle - Build and manage Business data lakes and ingest data streams - Develop machine learning and predictive models for data analysis - Visualize data and empower Inf...

About Agoda At Agoda, we bridge the world through travel. Our story began in 2005, when two lifelong friends and entrepreneurs, driven by their passion for travel, launched Agoda to make it easier for everyone to explore the world. Today, we are part of Booking Holdings [NASDAQ: BKNG], with a diverse team of over 7,000 people from 90 countries, working together in offices around the globe. Every day, we connect people to destinations and experiences, with our great deals across our millions of hotels and holiday properties, flights, and experiences worldwide. No two days are the same at Agoda. Data and technology are at the heart of our culture, fueling our curiosity and innovation. If you’r...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and d...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and d...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and d...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and d...