21920 Hadoop Jobs - Page 11

Job Description Job Title: Mid-level Data Science Associate Consultant Job Type: Full-time Location: Remote - LATAM Job Summary: ZS's Insights & Analytics group partners with clients to design and deliver solutions to help them tackle a broad range of business challenges. Our teams work on multiple projects simultaneously, leveraging advanced data analytics and problem-solving techniques. Our recommendations and solutions are based on rigorous research and analysis underpinned by deep expertise and thought leadership. Key Responsibilities: Design and implement advanced analytical and ML models to solve complex business challenges. Apply data mining, predictive modeling, and NLP techniques to...

Education : Bachelors or Masters in Computer Science or an equivalent area Skill-sets At least 5+ years of experience working in search infrastructure software engineering role. Proven leadership experience (e.g. as tech lead, lead architect or similar positions). Experience with Large, Distributed infrastructures. Especially the Hadoop stack and NoSQL Experience with Cassandra, Chef, AWS, and Jenkins a plus (not all are required). Ability to deal with large datasets and optimize query performance Solid understanding of the full web technology stack (e.g. from browser to data source). Solid understanding of computer science principles (OOP, Design patterns, algorithms, data structures etc.) ...

Integrate and fine-tune OpenAI s GPT models for AI-assisted content generation. Develop retrieval-augmented generation (RAG) pipelines Design scalable AI architectures to analyze and synthesize pharmaceutical marketing assets. Integrate AI-powered asset recommendation systems, leveraging structured metadata from PostgreSQL / Snowflake aligning with provided business rules to tailor AI-generated outputs to brand messaging Qualifications Required Skills 5+ years of experience in machine learning / AI engineering, preferably with LLMs. Proficiency in Azure, Ubuntu, Python, SQL, TensorFlow, PyTorch, LangChain, and OpenAI APIs. Experience with retrieval-augmented generation (RAG) and natural lang...

An ideal individual is someone who has deep data engineering skills around ETL, data modeling, database architecture and big data solutions. This individual should have strong business judgement, excellent written and verbal communication skills. 1. Develop data products, infrastructure and data pipelines leveraging AWS services (such as Redshift, Kinesis, EMR, Lambda etc.) and internal BDT tools (Datanet, Cradle, QuickSight etc. 2. Improve existing solutions/build solutions to improve scale, quality, IMR efficiency, data availability, consistency & compliance. 3. Partner with Software Developers, Business Intelligence Engineers, MLEs, Scientists, and Product Managers to develop scalable and...

Identifying the Opportunities for Business growth Support business in meeting the Budgets through Analytical Insights Communicate results and ideas to key decision makers Key Accountabilities Regular Portfolio Health Check-ups through Business Insights Identifying areas of growth and areas of sluggishness within portfolio Drive insight led actionable to help achieve portfolio targets Support Stakeholders in Business Reviews Support key business initiatives for data driven decisioning Job Duties & responsibilities Structure, define and execute data analysis to uncover insights and inform decision making for digital bank. Collaborate with regional & local counterparts to define and align perfo...

Data Collection & Cleaning : Gather structured and unstructured data from various sources, including sensors, databases, and APIs. Exploratory Data Analysis (EDA) : Identify patterns, trends, and anomalies using statistical techniques and visualization tools. Data Preprocessing and Feature Engineering Machine Learning Model Development : Build predictive models using machine learning algorithms to solve business problems or optimize operations. Deep Learning Frameworks Expertise: Cloud-Based AI Deployment Skills Deployment & Monitoring : Implement models into production and monitor performance over time. Stakeholder Communication : Translate complex findings into actionable insights for tech...

Analyze existing Hadoop, Pig, and Spark scripts from Dataproc and refactor them into Databricks-native PySpark. Implement data ingestion and transformation pipelines using Delta Lake best practices. Apply conversion rules and templates for automated code migration and testing. Conduct data validation between legacy and migrated environments (schema, count, and data-level checks). Collaborate on developing AI-driven tools for code conversion, dependency extraction, and error remediation. Ensure best practices for code versioning, error handling, and performance optimization. Participate in UAT, troubleshooting, and post-migration validation activities. Technical Skills Core: Python, PySpark, ...

Lead design and execution of Dataproc Databricks PySpark migration roadmap. Define modernization strategy , including data ingestion, transformation, orchestration, and governance. Architect scalable Delta Lake and Unity Catalog -based solutions. Manage and guide teams on code conversion, dependency mapping, and data validation. Collaborate with platform, infra, and DevOps teams to optimize compute costs and performance. Own the automation & GenAI acceleration layer , integrating code parsers, lineage tools, and validation utilities. Conduct performance benchmarking, cost optimization, and platform tuning (Photon, Auto-scaling, Delta Caching). Mentor senior and mid-level developers, ensuring...

Model Development Individual Contributor - Work independently with team lead(s) Hands-on programming and development Data Analysis Problem Solving - work toward getting the optimal solution of a given problem Tuning & Optimization Conduct risk based tuning of AML scenarios and maintain standards for BTL (Below the Line) ATL (Above the Line) alert testing Support ongoing optimization to the effectiveness of all in scope BAU transaction monitoring systems, scenarios and rules Model Testing & UAT Perform UAT and systems integraton testing of AML model for Significant experience and direct knowledge of AML Transaction Monitoring systems and preferably Oracle Mantas, Prime BSA and Actimize is a b...

At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and data transformation solutions. At PwC - AC, we are looking for an Azure Senior Manager- Data & AI who will have: Passion for technology, in the space...

Overview Join the Prodapt team in supporting a unified, scalable, and secure Jupyter-based environment for data science and machine learning. You will help build, maintain, and optimize the platform that empowers analysts, engineers, and scientists to explore data, develop models, and collaborate at scale. Responsibilities Develop, maintain, and enhance the Notebook platform built on JupyterLab, supporting both cloud and on-premises deployments. Integrate and optimize connections to diverse data sources (BigQuery, Hive, Teradata, Hadoop, Spark, etc.). Enable and support distributed data processing and analytics using Spark/PySpark and Dataproc. Implement and maintain platform features for co...

Overview Join the Prodapt team in building a unified, cloud-native environment for scalable machine learning training and experimentation. You will help design, develop, and optimize robust workflows that empower data scientists and engineers to efficiently explore, train, and validate ML models at scale. Responsibilities Overall experience of 10+ years with proven track recordof over-achieving engineering, platform delivery and scaling targets in highvolume, innovativeand fast-paced high-pressure environment; proven results in delivery on platform products. Solid proficiency in programming languages such as Python, Go and Java Experience with cloud platforms (e.g., GCP, AWS, Azure) and cont...

About Agoda Agoda is an online travel booking platform for accommodations, flights, and more. We build and deploy cutting-edge technology that connects travelers with a global network of 4.7M hotels and holiday properties worldwide, plus flights, activities, and more. Based in Asia and part of Booking Holdings, our 7,100+ employees representing 95+ nationalities in 27 markets foster a work environment rich in diversity, creativity, and collaboration. We innovate through a culture of experimentation and ownership, enhancing the ability for our customers to experience the world. Our Purpose - Bridging the World Through Travel We believe travel allows people to enjoy, learn and experience more ...

About Agoda Agoda is an online travel booking platform for accommodations, flights, and more. We build and deploy cutting-edge technology that connects travelers with a global network of 4.7M hotels and holiday properties worldwide, plus flights, activities, and more. Based in Asia and part of Booking Holdings, our 7,100+ employees representing 95+ nationalities in 27 markets foster a work environment rich in diversity, creativity, and collaboration. We innovate through a culture of experimentation and ownership, enhancing the ability for our customers to experience the world. Our Purpose - Bridging the World Through Travel We believe travel allows people to enjoy, learn and experience more ...

About the Role: We are seeking skilled Data Scientists with a strong foundation in Python and SQL to join our growing Data & Analytics team. You will work on end-to-end data-driven solutions — from data cleaning to model deployment — enabling key insights for strategic decisions. Key Responsibilities: Analyze large, complex datasets to extract meaningful business insights. Build and deploy machine learning and predictive models . Work on projects involving risk analytics, fraud detection, and data enrichment . Use Python and SQL for data processing, analysis, and automation. Collaborate with cross-functional teams to translate data findings into actionable business strategies. Skills Require...

Roles and Responsibilities Client Impact Provide creative input on projects across a range of industries and problem statements Contribute to the development of analytics strategies and programs for regional and global clients by leveraging data and technology solutions to unlock client value Collaborate with Mastercard team to understand clients needs, agenda, and risks Develop working relationship with client analysts/managers, and act as trusted and reliable partnerTeam Collaboration & Culture Collaborate with senior project delivery consultants to identify key findings, prepare effective presentations, and deliver recommendations to clients Independently identify trends, patterns, issues...

About Agoda Agoda is an online travel booking platform for accommodations, flights, and more. We build and deploy cutting-edge technology that connects travelers with a global network of 4.7M hotels and holiday properties worldwide, plus flights, activities, and more. Based in Asia and part of Booking Holdings, our 7,100+ employees representing 95+ nationalities in 27 markets foster a work environment rich in diversity, creativity, and collaboration. We innovate through a culture of experimentation and ownership, enhancing the ability for our customers to experience the world. Our Purpose - Bridging the World Through Travel We believe travel allows people to enjoy, learn and experience more ...

Job Title: AI Solution Architect Location: Remote Key Responsibilities: •Technical Strategy & Roadmap: Define and execute comprehensive ML/AI strategy aligned with business objectives, including LLM infrastructure, retrieval pipelines, and generative workflows •Architecture Oversight: Lead system architecture decisions for scalable ML platforms, ensuring robust model deployment and operational excellence •Cross-functional Collaboration: Partner closely with product management, engineering, and business stakeholders to translate requirements into technical solutions •Model Development: Actively participate in designing, training, and optimizing machine learning models, maintaining technical c...

As an Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorporati...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developing strea...

AI/ML Engineer Location: Bangalore EXP: 5 to 8Yrs Mandatory skills: Python, Pyspark, SQL, Traditional ML, MLOPS Job Summary: The primary purpose of this role is to design, build and maintain the data pipelines & ML ops systems, conducting experiments & performing statistical analysis, EDA & bringing insights aiding fine-tune models, training & retraining ML models as needed that enable the organization to process large volumes of data & also productionize, scale & manage AI/ML models. The main goal includes support to optimizing model training and inference. This role will harness AI/ML platform capabilities and help accelerate the development of Data & AI/ML driven products. Roles & Respons...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data PlatformResponsibilities:Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFSExperienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platformExperience in developing streaming...

Introduction In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology. Your Role And Responsibilities As a Data Engineer at IBM, you'll play a vital role in the development, design of application, provide regular support/guidance to project teams on complex coding, issue resolution and execution. Your primary responsibilities include: Lead the design and construction of new solutions using th...

Data Engineer/Senior Data Engineer Location: Chennai Experience: 2 - 8 Years Role Description The Data Engineer will be responsible for designing and developing data engineering solutions, creating and maintaining data models, building Extract Transform Load (ETL) pipelines, implementing data warehousing, and performing data analytics on large datasets. Qualifications · Data Engineering and Data Modeling skills · Experience with Extract Transform Load (ETL) pipelines · Expertise in implementing data warehousing solutions · Analytical skills for performing data analytics on large datasets · Strong programming skills in languages like Python, Java, or Scala · Experience with Big Data and cloud...

As an Associate Software Developer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big ...