57 Hadoop Jobs

5 - 9 years of professional experience as a Data Analyst with good decision-making, analytical and problem-solving skills. Working knowledge / experience of Big Data frameworks like Hadoop, Hive and Spark. Hands-on experience in query languages like HQL or SQL (Spark SQL) for Data exploration. Data mapping: Determine the data mapping required to join multiple data sets together across multiple sources. Documentation - Data Mapping, Subsystem Design, Technical Design, Business Requirements. Exposure to Logical to Physical Mapping, Data Processing Flow to measure the consistency, etc. Data Asset design / build: Working with the data model / asset generation team to identify critical data eleme...

Job Title: Data Engineer Experience: 6 to 8 Years Job Id: J0226-0467 Location: Hyderabad CGI is looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines and systems. The ideal candidate will work closely with data scientists, analysts, and business teams to ensure high-quality, reliable, and optimized data solutions. Key Responsibilities: Design, develop, and maintain scalable data pipelines and ETL processes Process and transform large volumes of structured and unstructured data Build and optimize data workflows using Python and PySpark Work with Hadoop ecosystem for distributed data processing Develop and optimize complex queries using SQL Ensure data qual...

Country/Region: IN Requisition ID: 33069 Work Model: Position Type: Salary Range: Location: INDIA - NOIDA- BIRLASOFT OFFICE Title: Technical Lead-Testing Services Description: Area(s) of responsibility Job Overview We are seeking a detail-oriented and experienced QA Manual Tester with Database expertise to join our team. In this role, you will be responsible for conducting manual tests to ensure the software created by developers fits its purpose. Your duties will include reviewing and analyzing system specifications, executing test scripts and reviewing results, reporting and documenting technical issues, and handling database testing. Your expertise in database management will be crucial i...

As an Applications Development Programmer Analyst at our organization, you will play a vital role in establishing and implementing new or updated application systems and programs in collaboration with the Technology team. Your primary focus will be on contributing to activities related to applications systems analysis and programming. Your responsibilities will include: - Utilizing your knowledge of applications development procedures and concepts - Identifying and defining necessary system enhancements - Analyzing issues, providing recommendations, and implementing solutions - Using your understanding of business processes, system processes, and industry standards to solve complex problems ...

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. Job Title: Senior, Data Science Job purpose You will be part of our GDS Assurance Digital, helping EY’s sector and service line professionals to gain insight from data. You will work with multi-disciplinary teams across the entire region to support global clients. You will support the development of analytical and statistical models, algorith...

Role Overview: A career within Data and Analytics services at PwC will provide you with the opportunity to help organizations uncover enterprise insights and drive business results using smarter data analytics. The focus is on a collection of organizational technology capabilities, including business intelligence, data management, and data assurance. This helps clients drive innovation, growth, and change within their organizations to keep up with the changing nature of customers and technology. Making impactful decisions by leveraging data, understanding and navigating risk, and helping clients gain a competitive edge are key aspects of this role. Key Responsibilities: - Design, develop, an...

Must have minimum 7+ years of experience in Data Migration and Data Transformation projects on Azure cloud Proven expertise in building large-scale batch and real-time data pipelines with data processing frameworks in AWS and Azure cloud platforms Design and develop pipelines, ETL and analytical processes on Azure cloud using data services like Azure Data Factory, Azure Data Lake, Azure Databricks, Azure Synapse including Spark & SQL Pools Hands-on experience in Microsoft Fabric for implementing end-to-end data pipelines, Real-Time Analytics, OneLake integration, and Data Activator features Demonstrated experience with ETL development both on-premises and in the cloud using IoT, Azure Stream...

Job Title - Retail Specialized Data Scientist – Level 9 – SnC GN Data & AI Management Level: 09 - Consultant Location: Bangalore / Gurgaon / Mumbai / Chennai / Pune / Hyderabad / Kolkata Must have skills: A solid understanding of retail industry dynamics, including key performance indicators (KPIs) such as sales trends, customer segmentation, inventory turnover, and promotions. Strong ability to communicate complex data insights to non-technical stakeholders, including senior management, marketing, and operational teams. Meticulous in ensuring data quality, accuracy, and consistency when handling large, complex datasets. Gather and clean data from various retail sources, such as sales transa...

As a Data Engineering Analyst at Citi, your role will involve creating client-centric analytic solutions to business problems, owning and delivering multiple complex analytic projects, and managing stakeholders across various functions and regions. Your day-to-day responsibilities will include: - Creating client-centric analytic solutions aligned with business needs - Owning and delivering multiple complex analytic projects - Managing stakeholders across various functions and regions - Delivering high-class presentations to share solutions with business stakeholders and senior management - Managing projects by creating project plans and assigning responsibilities To excel in this role, you s...

You are invited to join Citi as an Officer, Big Data Engineer -C10- Hybrid based in Chennai, India. At Citi, we are shaping the future of banking with a focus on innovation and evolution. As part of our global team, you will have access to resources for your well-being and opportunities for personal and professional growth. **Role Overview:** As a Big Data Engineer at Citi, you will be responsible for working on Big data platforms such as Hadoop and Hive. Your role will involve proficiency in programming languages like Python and PySpark, along with SQL for database management. Strong working knowledge of program languages and excellent communication skills are essential for this position. *...

Your role and responsibilities As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform...

Job Title: Data Engineer AWS + Hadoop Location: Bangalore Experience: 7+ Years About the Role We’re looking for a seasoned Data Engineer with hands-on expertise in AWS data services and the Hadoop ecosystem . You will design, build, and optimize batch/streaming data pipelines, enable reliable data ingestion/processing, and support analytics, ML, and BI use cases at scale. Key Responsibilities Design and implement scalable ETL/ELT pipelines for batch and streaming workloads. Build data ingestion frameworks using Kafka/Kinesis , and process data with Spark (PySpark/Scala). Develop and optimize data lakes and data warehouses on AWS (S3, Glue, EMR, Athena, Redshift). Manage and tune Hadoop ecosy...

In the role of Senior Associate in data and analytics engineering at PwC, you will focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. Your responsibilities will include designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be tasked with developing and implementing data pipelines, data integration, and data transformation solutions to transform raw data into actionable insights for informed decision-making and driving business growth. **Key Responsibilities:** - Design, develop, and optimize data pipelines and ETL processes using PySpark or Scala to extract, transform, a...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and d...

As an Associate Software Developer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big ...

Hadoop Developer Exp- 4 yrs to 8 yrs Location - Indore Must-Have Extensive experience and hands on implementation experience with Spark, Scala, Impala, Hive, Kafka, SQOOP Good-to-Have Extensive knowledge with Data frames, Data Sets and RDDs Location Indore Job Function IT INFRASTRUCTURE SERVICES Role Developer Job Id 392540 Desired Skills Big Data | Hadoop Desired Candidate Profile Qualifications : BACHELOR OF ENGINEERING

Python Developer Location- Indore Exp - 4 to 8 years Must-Have Python, Unix Shell Scripting, OOPS Concepts Good-to-Have Hadoop, ML Packages Location Indore Job Function IT INFRASTRUCTURE SERVICES Role Developer Job Id 392546 Desired Skills Python | Unix Shell Scripting Desired Candidate Profile Qualifications : BACHELOR OF ENGINEERING

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and d...

Join us as a Data Analyst in Client Insights team. The Client Insights team exist to create new data products and insights for direct consumption by Barclays corporate clients, and run a range of existing products marketed under Client Insights in Global Transaction Banking, by commercialising the vast data we hold on our clients, their products, markets and competitors. The purpose of the role is to run analytics and reporting for the Market & Customer Insights product within Client Insights, utilising the existing Vantage and Hadoop platforms. It will also involve working with the rest of Client Insights, project leads, and operations team to deliver ad-hoc reporting, new analysis and data...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and d...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developing strea...

AIA Hyd drive Role : Data Scientist AIML Experience : 4 to 13 Years Relevant Experience : 2+ Years Location : Pan India Notice Period : Immediate to 60 days Mode of Interview - In-Person (29th November 2025) Job Description: 1. Be a hands on problem solver with consultative approach, who can apply Machine Learning & Deep Learning algorithms to solve business challenges Use the knowledge of wide variety of AI/ML techniques and algorithms to find what combinations of these techniques can best solve the problem Improve Model accuracy to deliver greater business impact Estimate business impact due to deployment of model 2. Work with the domain/customer teams to understand business context , data...

JD : Technical Skills: Languages: Scala, Java • Big Data Orchestration: Airflow, Spark on Kubernetes, Yarn, Oozie Big Data Processing: Hadoop, Kafka, Spark & Spark Structured Streaming. Experience on SOLID & DRY principles with Good Software Architecture & Design implementation experience Advanced Scala experience (e.g. Functional Programming, using Case classes, Complex Data Structures & Algorithms) Proficient in developing automated frameworks for unit & integration testing. Experience with Docker and Helm and related container technologies. Proficient in deploying and managing Spark workloads on Kubernetes clusters. Experience in evaluation and implementation of Data Validation & Data Qua...

Company Description About Sopra Steria Sopra Steria, a major Tech player in Europe with 50,000 employees in nearly 30 countries, is recognised for its consulting, digital services and solutions. It helps its clients drive their digital transformation and obtain tangible and sustainable benefits. The Group provides end-to-end solutions to make large companies and organisations more competitive by combining in-depth knowledge of a wide range of business sectors and innovative technologies with a collaborative approach. Sopra Steria places people at the heart of everything it does and is committed to putting digital to work for its clients in order to build a positive future for all. In 2024, t...

About Agoda At Agoda, we bridge the world through travel. Our story began in 2005, when two lifelong friends and entrepreneurs, driven by their passion for travel, launched Agoda to make it easier for everyone to explore the world. Today, we are part of Booking Holdings [NASDAQ: BKNG], with a diverse team of over 7,000 people from 90 countries, working together in offices around the globe. Every day, we connect people to destinations and experiences, with our great deals across our millions of hotels and holiday properties, flights, and experiences worldwide. No two days are the same at Agoda. Data and technology are at the heart of our culture, fueling our curiosity and innovation. If you’r...