21920 Hadoop Jobs - Page 27

Job Description Job Title: Technical Lead L1 Req Id: 110273 City: Pune State/Province: Maharashtra Posting Start Date: 11/11/25 Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients’ most complex digital transformation needs. Leveraging our holistic portfolio of capabilities in consulting, design, engineering, and operations, we help clients realize their boldest ambitions and build future-ready, sustainable businesses. With over 230,000 employees and business partners across 65 countries, we deliver on the promise of helping our customers, colleagues, and communities thrive in ...

As a GCP Data Engineer, you will be responsible for implementing and architecting solutions on Google Cloud Platform using components of GCP. Your expertise in Apache Beam, Google Dataflow, and Apache Spark will be crucial in creating end-to-end data pipelines. Your experience in technologies like Python, Hadoop, Spark, SQL, Big Query, and others will play a vital role in delivering high-quality solutions. Key Responsibilities: - Implement and architect solutions on Google Cloud Platform - Create end-to-end data pipelines using Apache Beam, Google Dataflow, and Apache Spark - Utilize technologies like Python, Hadoop, Spark, SQL, Big Query, Cloud Storage, and others - Program in Java, Python,...

As a Senior Machine Learning Manager at Wayfair's Advertising Optimization & Automation Science team, you will play a crucial role in leading a team focused on developing intelligent, ML-powered systems for personalized recommendations and campaign automation within Wayfair's advertising platform. Your responsibilities will include: - Owning the strategy, roadmap, and execution of supplier advertising intelligence and automation solutions - Leading the development of GenAI-powered creative optimization, ML-based recommendation systems, and campaign automation to drive incremental ad revenue and improve supplier outcomes - Building, coaching, and managing a team of ML scientists to develop in...

As a Manager - Business Consulting at HSBC, you will play a crucial role in assessing operational risks, providing analytical support to global/regional businesses, and delivering end-to-end projects. Your responsibilities will include: - Continually reassessing operational risks associated with the role and business, considering various factors such as economic conditions, legal requirements, and technological impacts. - Providing analytical support for customer analytics, product analytics, and portfolio analytics in projects using various analytic techniques. - Delivering projects independently and assisting in more complex analyses under the supervision of the team lead. - Producing high...

About BNP Paribas India Solutions Established in 2005, BNP Paribas India Solutions is a wholly owned subsidiary of BNP Paribas SA, European Union’s leading bank with an international reach. With delivery centers located in Bengaluru, Chennai and Mumbai, we are a 24x7 global delivery center. India Solutions services three business lines: Corporate and Institutional Banking, Investment Solutions and Retail Banking for BNP Paribas across the Group. Driving innovation and growth, we are harnessing the potential of over 10000 employees, to provide support and develop best-in-class solutions. About BNP Paribas Group BNP Paribas is the European Union’s leading bank and key player in international b...

As an Infrastructure Lead/Architect at our customer's team, you will be responsible for architecting, designing, and implementing next-generation cloud infrastructure solutions. Your role will be crucial in driving cloud and data platform initiatives, ensuring system scalability and security, and acting as a technical leader to shape the backbone of our customers" mission-critical applications. Key Responsibilities: - Architect, design, and implement robust, scalable, and secure AWS cloud infrastructure utilizing services such as EC2, S3, Lambda, RDS, Redshift, and IAM. - Lead the end-to-end design and deployment of high-performance, cost-efficient Databricks data pipelines, ensuring seamles...

As a Hadoop Big Data Trainer at Wing Educations, you will play a crucial role in leading engaging training sessions on Hadoop and Big Data concepts for students and professionals. Your responsibilities will include: - Preparing training materials to ensure comprehensive coverage of Hadoop and Big Data tools such as HDFS, MapReduce, Hive, HBase, and Pig - Customizing content to cater to different learning needs and levels of expertise - Conducting hands-on demos and exercises to facilitate practical understanding of the concepts - Staying updated with the latest industry trends in Hadoop and Big Data technologies - Assessing trainees" progress and providing constructive feedback to help them ...

Role Overview: You are an experienced Cloud (GCP) Data and AI engineer who will be responsible for developing and implementing AI and data engineering solutions in alignment with the bank's AI strategy. You will work collaboratively with business functions to build and deploy robust and scalable solutions to improve operational efficiency and enhance customer experience. As part of a cross-functional agile delivery team, you will bring an innovative approach to data engineering and data science, focusing on using the latest technologies and practices. Key Responsibilities: - Build and implement data engineering and AI/ML solutions in Securities Services by preparing data, conducting feature ...

As a Senior Product Support Engineer - Hadoop SME, your role will involve designing, optimizing, migrating, and scaling Hadoop and Spark-based data processing systems. You will collaborate with customer engineering teams to deliver high-throughput applications and solve complex data challenges. If you are passionate about working in dynamic environments and cutting-edge data solutions, this role is for you. Key Responsibilities: - Design and optimize distributed Hadoop-based applications for low-latency, high-throughput performance. - Provide expert-level support for data or performance issues in Hadoop and Spark jobs and clusters. - Work extensively with large-scale data pipelines using Had...

The Role The Data Engineer is accountable for developing high quality data products to support the Bank’s regulatory requirements and data driven decision making. A Data Engineer will serve as an example to other team members, work closely with customers, and remove or escalate roadblocks. By applying their knowledge of data architecture standards, data warehousing, data structures, and business intelligence they will contribute to business outcomes on an agile team. Responsibilities Developing and supporting scalable, extensible, and highly available data solutions Deliver on critical business priorities while ensuring alignment with the wider architectural vision Identify and help address ...

We are looking for a dynamic professional who brings a unique blend of software development expertise and business analysis acumen. The ideal candidate will have hands-on experience in coding and system design, coupled with a strong understanding of business processes and stakeholder management. Key Responsibilities: Collaborate with stakeholders to gather and analyze business requirements. Translate business needs into technical specifications and solutions. Participate in system design, development, and testing phases. Work closely with development teams to ensure business requirements are met. Create and maintain documentation including BRDs, FRDs, and user stories. Conduct gap analysis a...

Job Responsibilities Conduct virtual training Co-ordinate Internship programs (operational) Evaluate projects and analyse feedback Enhance course material & course delivery based on feedback to improve training and internship effectiveness Location: Mysore, Bangalore Description of the Profile We are looking for training and Internship co-ordinators with 2 to 4 years of teaching experience and technology know-how in two or more of the following areas: Artificial Intelligence concepts awareness, Hands-on experince is preferred Java – Java programming, Spring, Angular / React, Bootstrap Big Data – Python programming, Hadoop, Spark, Scala, Mongo DB, NoSQL Data Science – Python for data science,...

At TEKsystems , were partnering with a global leader in data-driven digital transformation, and we're on the lookout for skilled Senior Data Engineers to build robust, scalable, and cloud-native data platforms. If you're passionate about designing high-performance data pipelines, working with cutting-edge cloud technologies, and driving insights across enterprise and analytics ecosystems – we want to hear from you! What we’re looking for: 8-10 years of Data Engineer experience Senior Data Engineer 8–10 years’ experience in design, architecture, or development in Analytics and Data Warehousing Must have 3+ years of experience in development projects using AWS/Cloud Services like S3, Glue, Ath...

We are seeking a highly skilled and experienced Senior Data Engineer with strong expertise in Streaming Data and Big Data Technologies , AWS & Scala Mandatory . The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks. Key Responsibilities: Architect and implement scalable data pipelines for real-time, batch, structured, and unstructured data . Design and develop solutions using AWS services such as EMR, Kinesis, Glue, Athena, S3, CloudFormation, API Gateway . Work extensively with streaming platforms like Kafka, Flink, Spark Streaming . Develop and optimize data ingestion workflows using Apache ...

Key Responsibilities Design and implement ETL/ELT pipelines for large-scale data processing and analytics. Develop and optimize analytical SQL queries for performance and scalability. Work with Big Data frameworks such as Hadoop, Spark, and Kafka . Design, build, and maintain data warehouses and data models supporting reporting and analytics. Parse and transform Call Detail Records (CDR) and other telecom-related data efficiently. Collaborate with data scientists, analysts, and business stakeholders to ensure smooth data flow and availability. Ensure data quality, integrity, and governance across distributed systems. Required Skills 510 years of hands-on experience in data engineering or a r...

ABOUT QUINCE Founded in 2018, Quince was built to challenge the idea that nice things have to cost a lot. Our mission is simple: to make really high quality essentials for really low prices, produced fairly and sustainably. We believe everyone deserves exceptional craftsmanship and timeless design without the traditional markups. Quince is a direct-to-consumer (DTC) model that cuts out middlemen and leverages just-in-time manufacturing to minimize waste and maximize value. Quince is a tech company disrupting the retail industry by putting AI, analytics and automation at the center of everything we do. Our unwavering commitment to excellence and company values guide our teams and actions: Cus...

Azure Services: Azure SQL Database, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake, etc. Programming Languages: T-SQL, PySpark, Spark SQL, Fair knowledge on KQL. Data Modeling: ERD, Dimensional Modeling ETL Tools: Azure Data Factory, Fair Knowledge of SSIS Big Data Technologies: Fair knowledge on Hadoop and Spark Performance Tuning and Troubleshooting Version Control: Git, Azure DevOps

Overview: At Mastercard, were building the future of intelligent infrastructurewhere data science meets automation, and AI drives operational excellence. We are looking for a Senior Data Scientist to join our Engineering team and lead the transformation of massive operations datasets into predictive insights and autonomous systems. This role is ideal for someone passionate about building scalable machine learning solutions, developing Large Language Models (LLMs), and pioneering agentic AI systems that optimize engineering workflows and decision-making. Role : As a Senior Data Scientist, you will: Analyze large-scale operations data to build predictive models for system performance, anomaly ...

Title and Summary Consultant, Performance AnalyticsServices within Mastercard is responsible for acquiring, engaging, and retaining customers by managing fraud and risk, enhancing cybersecurity, and improving the digital payments experience. We provide value-added services and leverage expertise, data-driven insights, and execution. Our Advisors & Consulting Services team combines traditional management consulting with Mastercards rich data assets, proprietary platforms, and technologies to provide clients with powerful strategic insights and recommendations. Our teams work with a diverse global customer base across industries, from banking and payments to retail and restaurants. The Advisor...

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Informatica PowerCenter Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with various teams to understand their needs, developing solutions, and ensuring that applications function seamlessly within the existing infrastructure. You will also engage in problem-solv...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : SAP BW/4HANA Data Modeling & Development Good to have skills : NA Educational Qualification : Minimum 15 years of full time education Project Role :Application Developer Project Role Description :Design, build and configure applications to meet business process and application requirements. Must have Skills :SAP BW/4HANA Data Modeling & DevelopmentGood to Have Skills :Job Requirements :Key Responsibilities : Roles and Responsibilities:- Expected to perform independently and become an SME.- Required ac...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : PySpark Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure project milestones are met, facilitating discussions to address challenges, and guiding your team in implementing effective solutions. You will also engage in strategic pl...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Apache Spark Good to have skills : MySQL, Python (Programming Language), Google BigQueryMinimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with various teams to understand their needs, developing innovative solutions, and ensuring that applications are optimized for perfor...

As an Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorporat...