26862 Hadoop Jobs - Page 2

Job Description: As a Data Engineer, you will be responsible for designing, developing, and maintaining the data infrastructure that powers our technology platform. You will work closely with cross-functional teams to build scalable data pipelines, optimize data workflows, and ensure the reliability and performance of our data systems. Responsibilities: Design, develop, and maintain ETL pipelines to collect, process, and store data from various sources. Work with APIs, databases, and other data sources to integrate data into the data warehouse. Implement and maintain data validation and monitoring processes to ensure data accuracy and reliability. Collaborate with data scientists, analysts, ...

Key Responsibilities Design, develop, and maintain scalable data pipelines and ETL processes Build and operate data platforms using modern cloud and big data technologies Act as an individual contributor (~60%), delivering high-quality, production-ready code Coach and mentor data engineers on best practices and engineering standards Perform code reviews, design reviews, and ensure testing and deployment quality Monitor and optimize data infrastructure performance and reliability Resolve complex technical challenges and manage technical debt Ensure DevSecOps practices are embedded into daily engineering work Collaborate with Engineering Managers, Product Owners, Business Analysts, and Scrum M...

We are seeking an experienced ETL/SQL/Python Testing Engineer to design, develop, and execute test cases for data pipelines, ETL processes, and database systems. The ideal candidate will possess strong expertise in SQL querying, ETL validation, Python scripting, and test automation to ensure data accuracy, completeness, and optimal performance. Your future duties and responsibilities: Develop and execute ETL test cases to validate data extraction, transformation, and loading processes Perform ETL pipeline testing in an ADB (Azure Databricks) environment Write complex SQL queries to verify data integrity, consistency, and correctness across source and target systems Automate ETL testing workf...

Job description Hiring for Hadoop Developer Mandatory Skills: Hadoop, bigdata, spark Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and detailed funct...

You have over 7 years of experience in Big Data with a strong expertise in Spark and Scala. Your mandatory skills include proficiency in Big Data primarily Spark and Scala, along with a strong knowledge in HDFS, Hive, Impala, Unix, Oracle, and Autosys. It is essential to have strong communication skills and experience in Spark streaming, not limited to Spark batch. Additionally, you should have experience with NoSQL databases such as HBase, Mongo, and Couchbase. Your core skills should encompass PySpark, Python, and SQL. You should also have experience in machine learning with ML Libraries, Scikit-learn, PySpark Mlib, statistical methods, regression, classification, and clustering. In terms ...

Role Overview: As an AI Engineer at Merkle, your main responsibility will be to lead and manage customer analysis deep dives, execute the strategies outlined by senior leadership, and manage day-to-day communication with clients. Key Responsibilities: - Develop algorithms and build predictive models from the ground up, using machine learning and deep learning frameworks. - Build AI models from scratch and assist product managers and other stakeholders with analysis and implementation. - Transform machine learning models into APIs that can be integrated with other applications. - Provide training for AI engineers on model development and deployment. - Utilize advanced knowledge in Machine Lea...

Role Overview: The EY Data and Analytics team specializes in information management, advanced analytics, and business intelligence, aiming to implement strategies and systems that yield high returns on investment for clients. Consultants strive to foster a culture within organizations that promotes the creative and intelligent use of information and technology to achieve better business outcomes. As a Senior Associate in the Business Intelligence, Data Warehousing, and Big Data space at EY, you will collaborate with long-term clients to unlock the value of their data and engage in a variety of projects encompassing traditional BI, DW, big data, and advanced analytics. Key Responsibilities: -...

As an AI Engineer at our Coimbatore location, you will be responsible for designing, developing, and deploying AI models to enhance our products and services. You will collaborate with data scientists, software engineers, and product teams to build scalable AI-powered applications. **Key Responsibilities:** - Design, develop, and optimize machine learning and deep learning models for real-world applications. - Collaborate with data scientists to transform prototypes into production-ready AI systems. - Work with large datasets to train, validate, and fine-tune AI models. - Integrate AI models into scalable cloud or on-premise architectures. - Develop APIs and pipelines for deploying AI soluti...

As a Replacement Data Analytics AI/ML at Fiserv, you will be responsible for leveraging your expertise in computer science, data science, statistics, mathematics, or related fields to contribute to the development and implementation of AI/ML solutions. Your role will involve utilizing Python, SQL, and data science libraries such as pandas, scikit-learn, TensorFlow, and PyTorch to drive data-driven insights and decision-making processes. Key Responsibilities: - Utilize proficiency in Python, SQL, and data science libraries to analyze and manipulate data effectively. - Apply experience with big data technologies like Spark, Hadoop, and cloud platforms such as AWS, GCP, and Azure to handle larg...

As a Machine Learning Engineer at our company, you will play a crucial role in developing and deploying machine learning models and intelligent systems. Your responsibilities will include: - **Coding:** Write clean, efficient, and well-documented Python code following OOP principles. You should have experience with Python and related libraries such as TensorFlow, PyTorch, and Scikit-Learn. Your tasks will involve handling the entire ML pipeline, from data ingestion and preprocessing to model training, evaluation, and deployment. - **End-to-End ML Application Development:** Design, develop, and deploy machine learning models into production environments, ensuring they are robust, scalable, an...

Role Overview: At Citi, you will be part of a team that is shaping the future of banking by developing high-quality data products to support the Banks regulatory requirements and data-driven decision-making. As a Data Engineer, you will work closely with customers, set an example for the team, and contribute to business outcomes on an agile team by applying your knowledge of data architecture standards, data warehousing, data structures, and business intelligence. Key Responsibilities: - 5-8 years of relevant experience in Big Data platforms such as Hadoop, Hive, or Snowflake for data storage and processing - Proficiency in data modeling techniques, design, optimization, and maintenance of d...

Role Overview: As the Team Lead of Data Engineering, you will be responsible for driving the design, development, and optimization of data engineering pipelines and services with a strong software engineering mindset. Your role will also involve fostering growth and collaboration within the team, mentoring junior colleagues, and refining processes to ensure excellence. If you are excited about making a lasting impact both technically and as a team leader, we are eager to meet you. Key Responsibilities: - Write maintainable, scalable code primarily in Python, with experience in Rust or C# considered a plus. - Process and manipulate data using Polars and Pandas, scaled via Apache Ray. - Utiliz...

TCS is conducting weekday Virtual Drive on 8th Jan, 26 for the role of Data Engineer Role Data Engineer Location: Bangalore, Pune, Chennai, Gurugram Experience: 7+ yrs of experience Notice Period: 0 to 30 days Date of Interview: 8th Jan, 26 Mode of Interview: Virtual Mode(Teams or Webex) Responsibilities: Must have 7+ yrs of experience in IT Domain. Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQL Experience working on Data Engineering projects Good Understanding of SQL Good understanding of Unix and HDFS commands Communication Experience working on Data Analytics and Pyspark Exposure to Tableau & SAS Ex-TCSers are not considered for the role. Kindly at...

DESCRIPTION Do you want to join an innovative team of scientists who use machine learning and statistical techniques to create state-of-the-art solutions for providing better value to Amazon’s customers? Do you want to build and deploy advanced algorithmic systems that help optimize millions of transactions every day? Are you excited by the prospect of analyzing and modeling terabytes of data to solve real world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you like to innovate and simplify? If yes, then you may be a great fit to join the Machine Learning and Data Sciences team for India Consumer Businesses. If you ...

Proven experience as a Data Scientist or Data Analyst Experience in data mining Understanding of machine-learning and operations research Knowledge of R, SQL and Python; familiarity with Scala, Java or C++ is an asset Experience using business intelligence tools (e.g. Tableau) and data frameworks (e.g. Hadoop) Analytical mind and business acumen Strong math skills (e.g. statistics, algebra) Problem-solving aptitude Excellent communication and presentation skills BSc/BA in Computer Science, Engineering or relevant field; graduate degree in Data Science or other quantitative field is preferred Job Types: Full-time, Permanent, Fresher, Part-time Pay: ₹588,582.47 - ₹1,845,430.60 per year Benefit...

Job Summary: We are seeking an experienced and passionate Data Science Trainer to deliver high-quality training in data science, analytics, and related technologies. The trainer will be responsible for teaching core data science concepts, mentoring learners, and preparing them for real-world industry applications through hands-on training and projects. Key Responsibilities: Deliver instructor-led training sessions in Data Science (offline). Teach fundamentals and practical applications of Machine Learning and Deep Learning. Conduct hands-on sessions using Python for data analysis and modeling. Train learners on Excel and Advanced Excel for data analysis. Explain and demonstrate data visualiz...

DESCRIPTION Do you want to join an innovative team of scientists who use machine learning and statistical techniques to create state-of-the-art solutions for providing better value to Amazon’s customers? Do you want to build and deploy advanced algorithmic systems that help optimize millions of transactions every day? Are you excited by the prospect of analyzing and modeling terabytes of data to solve real world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you like to innovate and simplify? If yes, then you may be a great fit to join the Machine Learning and Data Sciences team for India Consumer Businesses. If you ...

ITIDATA an EXl Company Tasks Cypher or Gremlin query languages, Neo4J, Python, PySpark, Hive, Hadoop graph theory, Experience in creating and managing knowledge graphs using Neo4J. Requirements Looking for an exciting opportunity in graph databases ? We are hiring Neo4J Developers with 7-10 years of experience in data engineering , including 2-3 years of hands-on experience with Neo4J . Benefits 🔹 Key Skills & Responsibilities: ✅ Expertise in Cypher or Gremlin query languages ✅ Strong understanding of graph theory ✅ Experience in creating and managing knowledge graphs using Neo4J ✅ Optimizing performance and scalability of graph databases ✅ Researching & implementing new technology solutions...

About BNP Paribas India Solutions Established in 2005, BNP Paribas India Solutions is a wholly owned subsidiary of BNP Paribas SA, European Union’s leading bank with an international reach. With delivery centers located in Bengaluru, Chennai and Mumbai, we are a 24x7 global delivery center. India Solutions services three business lines: Corporate and Institutional Banking, Investment Solutions and Retail Banking for BNP Paribas across the Group. Driving innovation and growth, we are harnessing the potential of over 10000 employees, to provide support and develop best-in-class solutions. About BNP Paribas Group BNP Paribas is the European Union’s leading bank and key player in international b...

As part of the Astellas commitment to delivering value for our patients, our organisation is currently undergoing transformation to achieve this critical goal. This is an opportunity to work on digital transformation and make a real impact within a company dedicated to improving lives. DigitalX our new information technology function is spearheading this value driven transformation across Astellas. We are looking for people who excel in embracing change, manage technical challenges and have exceptional communication skills. We are seeking a skilled and proactive Application Administrator with strong Linux expertise to manage, monitor, and optimize enterprise applications hosted on Linux serv...

Job Title: Full Stack Engineer (Data Platform & Analytics) Role Overview : We are looking for a versatile Full Stack Engineer to lead the development and optimization of our enterprise data platform. You will bridge the gap between complex data engineering and user-centric applications, focusing on building automated workflows, data lineage systems, and seamless reporting integrations within the Microsoft Azure ecosystem. Key Responsibilities : End-to-End Platform Development: Design and maintain full-stack applications (React/Vue frontend & Python/Java backend) for data governance, access requests, and automated approval engines. Data Virtualization & Querying: Leverage Starburst (Enterpris...

We’re Hiring: DevOps Manager Location: Nanakramguda, Hyderabad Employment Type: Full-Time Experience: 6+ Years At Coschool, we’re building AI-powered learning solutions that create real-world impact. If you enjoy solving complex infrastructure problems and want to scale systems that support Generative AI, this is your opportunity. Make an Impact: Join a fast-growing startup with a go-to-market product and help scale our platform from the ground up. Work on Cutting-Edge Tech: Be at the forefront of LLMOps, MLOps, and AI-driven systems Grow with the Company: Thrive in a high-ownership environment that values learning, adaptability, and leadership. Innovative Culture: Collaborate with a team th...

TCS is Hiring for AWS Data Engineer & Python Skill: AWS Data Engineer & Python Experience: 05-10 years (mandatory) Joining Location: PAN INDIA DRIVE MODE : In-Person Drive WALK IN DRIVE DATE: 08th January 2026 **WALK IN DRIVE LOCATION: Chennai ** ROLES AND RESPONSIBILITIES: Create and maintain optimal data pipeline architecture for efficient and reliable data processing Assemble large, complex data sets that meet functional / non-functional business requirements. Database management, ETL process, Data modelling, ensuring data quality and integrity. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure...

About the Role We are looking for a highly skilled Data Engineer to design, build, and maintain robust data pipelines and scalable data infrastructure. You will work closely with analytics, product, and engineering teams to enable high-quality data availability for business insights, machine learning, and operational processes. This role is ideal for an engineer who enjoys solving complex data problems, optimizing systems, and ensuring clean, reliable data flows. Key Responsibilities Design, develop, and maintain scalable ETL/ELT pipelines using modern data engineering tools. Build and optimize data lakes, data warehouses, and streaming architectures . Work with large and complex datasets to...

Role Overview: At PwC, you will work as a Senior Associate in the Data, Analytics & Specialist Managed Service tower in India. Your role involves solving complex business issues from strategy to execution, demonstrating critical thinking, and leading client engagements. You will be responsible for ticket quality and deliverables review, status reporting, adherence to SLAs, incident management, change management, and problem management. Additionally, you will collaborate with clients directly, manage workstreams, and contribute to cross-team collaboration. Your work will involve escalation/risk management and upholding the firm's code of ethics and business conduct. Key Responsibilities: - Us...