61 Hadoop Jobs - Page 2

JD : Technical Skills: Languages: Scala, Java • Big Data Orchestration: Airflow, Spark on Kubernetes, Yarn, Oozie Big Data Processing: Hadoop, Kafka, Spark & Spark Structured Streaming. Experience on SOLID & DRY principles with Good Software Architecture & Design implementation experience Advanced Scala experience (e.g. Functional Programming, using Case classes, Complex Data Structures & Algorithms) Proficient in developing automated frameworks for unit & integration testing. Experience with Docker and Helm and related container technologies. Proficient in deploying and managing Spark workloads on Kubernetes clusters. Experience in evaluation and implementation of Data Validation & Data Qua...

Company Description About Sopra Steria Sopra Steria, a major Tech player in Europe with 50,000 employees in nearly 30 countries, is recognised for its consulting, digital services and solutions. It helps its clients drive their digital transformation and obtain tangible and sustainable benefits. The Group provides end-to-end solutions to make large companies and organisations more competitive by combining in-depth knowledge of a wide range of business sectors and innovative technologies with a collaborative approach. Sopra Steria places people at the heart of everything it does and is committed to putting digital to work for its clients in order to build a positive future for all. In 2024, t...

About Agoda At Agoda, we bridge the world through travel. Our story began in 2005, when two lifelong friends and entrepreneurs, driven by their passion for travel, launched Agoda to make it easier for everyone to explore the world. Today, we are part of Booking Holdings [NASDAQ: BKNG], with a diverse team of over 7,000 people from 90 countries, working together in offices around the globe. Every day, we connect people to destinations and experiences, with our great deals across our millions of hotels and holiday properties, flights, and experiences worldwide. No two days are the same at Agoda. Data and technology are at the heart of our culture, fueling our curiosity and innovation. If you’r...

Apache Spark Technical Lead - French Language Full-time Company Description About Sopra Steria Sopra Steria, a major Tech player in Europe with 50,000 employees in nearly 30 countries, is recognised for its consulting, digital services and solutions. It helps its clients drive their digital transformation and obtain tangible and sustainable benefits. The Group provides end-to-end solutions to make large companies and organisations more competitive by combining in-depth knowledge of a wide range of business sectors and innovative technologies with a collaborative approach. Sopra Steria places people at the heart of everything it does and is committed to putting digital to work for its clients...

As an Associate Lead Data Scientist, you will have the exciting opportunity to work with a dynamic team of researchers, data scientists, and developers. Your primary focus will be on developing and optimizing cutting-edge AI solutions in various industries such as commerce, agriculture, insurance, financial markets, and procurement. Here is a breakdown of your responsibilities: Key Responsibilities: - Develop, optimize, and lead ML, NLP, Deep Learning, and Generative AI model/projects. - Research and implement state-of-the-art algorithms for supervised and unsupervised learning. - Handle large-scale datasets in distributed environments. - Apply the best ML approaches based on an understandin...

As a Lead Data Analyst at Target, you will be exploring data technologies and applying mathematical techniques to derive business insights. Your role will involve determining the best approach to gather, model, manipulate, analyze, and present data. You will lead an agile team, actively participating in ceremonies and team activities. You will have opportunities to continuously upskill by staying current with new technologies through formal training, peer training groups, and self-directed education. Key Responsibilities: - Develop data and metrics to support key business strategies, initiatives, and decisions. - Explore data technologies and apply mathematical techniques to derive business ...

As a Consultant at Capgemini Invent, your role will involve engaging in project activities related to the Information lifecycle. You will work on tasks such as building and managing Business data lakes, ingesting data streams, developing machine learning models, visualizing data, and empowering Information consumers with agile Data Models. Additionally, you will specialize in Business Models and architectures across various Industry verticals. Key Responsibilities: - Engage in project activities related to the Information lifecycle - Build and manage Business data lakes and ingest data streams - Develop machine learning and predictive models for data analysis - Visualize data and empower Inf...

About Agoda At Agoda, we bridge the world through travel. Our story began in 2005, when two lifelong friends and entrepreneurs, driven by their passion for travel, launched Agoda to make it easier for everyone to explore the world. Today, we are part of Booking Holdings [NASDAQ: BKNG], with a diverse team of over 7,000 people from 90 countries, working together in offices around the globe. Every day, we connect people to destinations and experiences, with our great deals across our millions of hotels and holiday properties, flights, and experiences worldwide. No two days are the same at Agoda. Data and technology are at the heart of our culture, fueling our curiosity and innovation. If you’r...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and d...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and d...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and d...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and d...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and d...

About this role: Wells Fargo is seeking for a Senior Data Management Analyst. In this role, you will: Lead or participate in moderately complex programs and initiatives for data quality, governance, and metadata activities Design and conduct moderately complex analysis to identify and remediate data quality, data integrity, process, and control gaps Analyze, assess, and test data controls and data systems to ensure quality and risk compliance standards are met and adhere to data governance standards and procedures Identify data quality metrics and execute data quality audits to benchmark the state of data quality Develop recommendations for optimal approaches to resolve data quality issues a...

About this role: Wells Fargo is seeking a Software Engineering Senior Manager. We believe in the power of working together because great ideas can come from anyone. Through collaboration, any employee can have an impact and make a difference for the entire company. Explore opportunities with us for a career in a supportive environment where you can learn and grow In this role, you will: Manage, coach, and develop a team or teams of experienced engineers and engineering managers in roles with moderate complexity and risk, responsible for building high quality capabilities with modern technology Ensure adherence to the Banking Platform Architecture, and meeting non-functional requirements with...

As a BigData Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering...

Expert-level Python programming skills with solid understanding of algorithms, data structures, and OOP. Strong grounding in Deep Learning, Machine Learning, and Generative AI. Strong understanding of LLMs (Large Language Models) and transformer-based architectures. Hands-on experience with LangChain, LangGraph, and other LLM orchestration frameworks. Proficiency in RAG (Retrieval-Augmented Generation) design and implementation. Experience in document ingestion, data embedding, and vector database management (FAISS, Pinecone, Chroma, Weaviate). Familiarity with TensorFlow, PyTorch, and Hugging Face ecosystems. Experience and knowledge on AI Agents Strong knowledge of mathematical foundations...

As a Senior Engineer, AVP at Deutsche Bank, you will play a crucial role in building and delivering significant components of engineering solutions to meet complex business goals. You will collaborate closely with the business and be part of a dynamic, creative, and innovative team, working towards making a tangible impact. Key Responsibilities: - Join the dbSleuth Team within Regulatory & Cross Product IT to develop and deliver Trader and Counterparty surveillance solutions across all business segments - Contribute to building surveillance systems in a fast-paced, agile environment using technologies like React for UI development, Python/Spark/Scala for services, and Hadoop Big Data for ano...

As an Applications Development Sr Programmer Analyst in the Information Management team of Services Technologies, you will be focusing on Big Data and public cloud adoption projects. Your role involves the establishment and implementation of new or revised application systems and programs in coordination with the Technology team, with the primary objective of contributing to applications systems analysis and programming activities. **Key Responsibilities:** - Conduct feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish new or revised applications systems and programs to meet specific business needs or user area...

As a Data Scientist in our team, your role will be to lead the development and implementation of advanced analytics solutions to derive actionable consumer insights from large datasets. **Key Responsibilities:** - Design and implement statistical models and machine learning algorithms to analyze consumer behavior and market trends. - Analyze large datasets to identify consumer preferences, behaviors, and market trends. - Communicate insights effectively through compelling visualizations and presentations. - Collaborate with cross-functional teams to translate insights into actionable business strategies. **Qualifications Required:** - Master's or PhD degree in a quantitative field. - 5 years...

The Applications Development Senior Programmer Analyst position is an intermediate level role that involves collaborating with the Technology team to establish and implement new or updated application systems and programs. Your main objective will be to contribute to applications systems analysis and programming activities. Responsibilities: - Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, and model development. - Monitor and control all phases of the development process. - Provide user and operational support. - Analyze complex problems and recommend security measures post-implementation. - Consult with users/cl...

In the Global Assessments & People Analytics & Insights group at Citigroup, you will be solving business problems with workforce and business data. Analyzing data to facilitate evidence-based decision making will be a key responsibility. Utilizing statistical models to predict future outcomes and providing actionable insights will be integral to your role. The mission is to equip decision makers with data-driven insights through analytics to make informed decisions about individuals, teams, and organizations in order to enhance business performance. - Collaborate with cross-functional teams, including data scientists, project managers, HR partners, and business stakeholders. - Understand dat...

Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : Apache Hadoop Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Engineer, you will analyze, design, code, and test multiple components of application code across one or more clients. You will perform maintenance, enhancements, and/or development work in a dynamic environ...

DESCRIPTION Do you want to join an innovative team of scientists who use machine learning and statistical techniques to create state-of-the-art solutions for providing better value to Amazon’s customers? Do you want to build and deploy advanced algorithmic systems that help optimize millions of transactions every day? Are you excited by the prospect of analyzing and modeling terabytes of data to solve real world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you like to innovate and simplify? If yes, then you may be a great fit to join the Machine Learning and Data Sciences team for India Consumer Businesses. If you ...

DESCRIPTION Do you want to join an innovative team of scientists who use machine learning and statistical techniques to create state-of-the-art solutions for providing better value to Amazon’s customers? Do you want to build and deploy advanced algorithmic systems that help optimize millions of transactions every day? Are you excited by the prospect of analyzing and modeling terabytes of data to solve real world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you like to innovate and simplify? If yes, then you may be a great fit to join the Machine Learning and Data Sciences team for India Consumer Businesses. If you ...