21920 Hadoop Jobs - Page 25

About The Role Project Role : Data Architect Project Role Description : Define the data requirements and structure for the application. Model and design the application data structure, storage and integration. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Architect, you will define the data requirements and structure for the application. Your typical day will involve modeling and designing the application data structure, storage, and integration, ensuring that the data architecture aligns with the overall business objectives and te...

About The Role Project Role : Custom Software Engineer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Apache Hadoop Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Custom Software Engineer, you will engage in the design, construction, and configuration of applications tailored to meet specific business processes and application requirements. Your typical day will involve collaborating with cross-functional teams to gather requirements, developing innovative solutions, and ensuring that applications are optim...

Do you want to shape the future of fintech and healthtech? Energized by challenges and inspired by bold goals? Ready to elevate your career alongside driven and talented colleagues? If that sounds like you, explore a career at Alegeus today. Opportunity Happens Here . Are you energized by data challenges and driven to transform insights into action? At Alegeus , we’re unlocking the potential of data to revolutionize healthcare and financial services. As a Data Scientist , you’ll play a critical role in building scalable models, infrastructure, and solutions that shape our data-driven future. Your Role in Driving Innovation You’ll work closely with engineering, product, and business teams to ...

Primary Skills: Design Skills: Data Analysis, Data Architecture, Data Strategy, Design of Databases, Data Warehouses, and Data Products Development Skills: Snowflake, Azure Data Factory (ADF), SQL Server / MySQL Performance Optimization of Database Queries and Experience on Indexing Leadership: Should be able to lead the team and provide technical and architectural guidance to the team. Should be able to enforce the processes and guidelines across the team. Others: Should be good in communication and should be able to communicate the Design to Larger Technical & Non-Technical audience. Secondary Skills: SSIS / Pentaho, Power BI / Tableau, Python

Data Engineer - Databricks Job Description The Data Engineer - Databricks will be responsible for building and optimizing our data pipelines, architectures, and data sets. He will work closely with data scientists, analysts, and other engineers to support their data needs and maximize the value of our data processing capabilities. Responsibilities · Design, develop, and maintain scalable and robust data pipelines on Databricks. · Collaborate with data scientists and analysts to understand data requirements and deliver solutions. · Optimize and troubleshoot existing data pipelines for performance and reliability. · Ensure data quality and integrity across various data sources. · Implement dat...

6-7+ years of Experience in Hadoop or any Cloud Bigdata components (specific to the Data Engineering role), Hadoop hands on (airflow, oozie, hive, hdfs, sqoop, pig, map, reduce ) 4+ years of Exp in Spark (Spark Batch, Streaming, Mlibetc). Candidates should possess proficiency in utilizing the Apache Spark framework. 6-7+ years of experience in Python programming language. 4+ years of experience with pyspark data transformation(json,csv,rdbms,stream) pipeline design , development and deployment with kubernate/onprem platform (not cloud based). 2+ years of experience in designing and implementing data workflows with Apache Airflow. Kafka or equivalent Cloud Bigdata components (specific to the ...

Job Role: Data Engineer Exp: 5+ Years Loc: Bangalore Deep Hadoop ecosystem knowledge: Spark, HDFS, Hive, Iceberg. Batch and streaming ETL pipeline design scalability and reliability Python & Unix proficiency, materialized views, data structures/algorithms. Data warehouse security, compliance, and operational excellence. Automated pipeline design & optimization, platform collaboration Monitoring and logging: Prometheus, Grafana, Jenkins/GitHub Actions Testing frameworks: JUnit/pytest , code cleanliness Skills -Big data solutions, Hadoop data warehouse, analytics infrastructure. Building scalable pipelines, system optimization, architectural reviews. Spark, HDFS, Hive, Iceberg, Kafka, Flink, P...

We are looking for a skilled Senior Data Engineer with 6-12 years of experience to join our team at Syneos Health, playing a crucial role in driving data-driven insights and strategic decision-making. The ideal candidate will have a strong background in designing and implementing large-scale data systems, ensuring data quality, and collaborating with cross-functional teams. Roles and Responsibility Design, develop, and maintain large-scale data pipelines and architectures. Ensure high-quality data by implementing robust testing and validation procedures. Collaborate with cross-functional teams to identify business requirements and develop solutions. Develop and implement data governance poli...

Skills - Hadoop , Hive , HDFS , ETL Processes , CI/CD Data Engineer Job Description: As a Data Engineer on our team, you will work on our Hadoop-based data warehouse, contributing to scalable and reliable big data solutions for analytics and business insights. This is a hands-on role focused on building, optimizing, and maintaining large data pipelines and warehouse infrastructure. Key Responsibilities Design, develop, and maintain robust data pipelines in Hadoop and related ecosystems, ensuring data reliability, scalability, and performance. Implement data ETL processes for batch and streaming analytics requirements. Optimize and troubleshoot distributed systems for ingestion, storage, and ...

We are looking for a skilled Senior Data Engineer with 6-12 years of experience to join our team at Syneos Health, playing a crucial role in driving data-driven insights and strategic decision-making. The ideal candidate will have a strong background in designing and implementing large-scale data systems, ensuring data quality, and collaborating with cross-functional teams. Roles and Responsibility Design, develop, and maintain large-scale data pipelines and architectures. Ensure high-quality data processing and analysis across various platforms. Collaborate with cross-functional teams to identify business requirements and develop solutions. Develop and implement data governance policies and...

We are looking for a skilled Lead Azure Data Engineer with 8 to 15 years of experience in the Pharmaceutical & Life Sciences industry, specifically at Syneos Health. The ideal candidate will have expertise in designing and implementing data pipelines using Azure. Roles and Responsibility Design and implement scalable data pipelines using Azure. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data architectures on Azure. Ensure data quality and integrity by implementing robust testing and validation procedures. Provide technical guidance and mentorship to junior team members. Stay up-to-date with emerging trends and tec...

DESCRIPTION Do you want to join an innovative team of scientists who use machine learning and statistical techniques to create state-of-the-art solutions for providing better value to Amazon’s customers? Do you want to build and deploy advanced algorithmic systems that help optimize millions of transactions every day? Are you excited by the prospect of analyzing and modeling terabytes of data to solve real world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you like to innovate and simplify? If yes, then you may be a great fit to join the Machine Learning and Data Sciences team for India Consumer Businesses. If you ...

DESCRIPTION Do you want to join an innovative team of scientists who use machine learning and statistical techniques to create state-of-the-art solutions for providing better value to Amazon’s customers? Do you want to build and deploy advanced algorithmic systems that help optimize millions of transactions every day? Are you excited by the prospect of analyzing and modeling terabytes of data to solve real world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you like to innovate and simplify? If yes, then you may be a great fit to join the Machine Learning and Data Sciences team for India Consumer Businesses. If you ...

Country India Working Schedule Full-Time Work Arrangement Hybrid Relocation Assistance Available No Posted Date 11-Nov-2025 Job ID 13677 Description and Requirements Role Value Description : MetLife is the leading provider of Group Benefits. The Group Disability technology organization is a diverse team of technologists, all working towards the common goal of ensuring the customer is at the center of everything we do. As a Lead data engineer you are responsible for the design, development, implementation and maintenance of solutions supporting Disability & Absence products at MetLife - products that provide income protection and job protection to millions of employees across the United State...

DESCRIPTION AWS Sales, Marketing, and Global Services (SMGS) is responsible for driving revenue, adoption, and growth from the largest and fastest growing small- and mid-market accounts to enterprise-level customers including public sector. AWS Global Services includes experts from across AWS who help our customers design, build, operate, and secure their cloud environments. Customers innovate with AWS Professional Services, upskill with AWS Training and Certification, optimize with AWS Support and Managed Services, and meet objectives with AWS Security Assurance Services. Our expertise and emerging technologies include AWS Partners, AWS Sovereign Cloud, AWS International Product, and the Ge...

DESCRIPTION Do you want to join an innovative team of scientists who use machine learning and statistical techniques to create state-of-the-art solutions for providing better value to Amazon’s customers? Do you want to build and deploy advanced algorithmic systems that help optimize millions of transactions every day? Are you excited by the prospect of analyzing and modeling terabytes of data to solve real world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you like to innovate and simplify? If yes, then you may be a great fit to join the Machine Learning and Data Sciences team for India Consumer Businesses. If you ...

DESCRIPTION AWS Global Services includes experts from across AWS who help our customers design, build, operate, and secure their cloud environments. Customers innovate with AWS Professional Services, upskill with AWS Training and Certification, optimize with AWS Support and Managed Services, and meet objectives with AWS Security Assurance Services. Our expertise and emerging technologies include AWS Partners, AWS Sovereign Cloud, AWS International Product, and the Generative AI Innovation Center. You’ll join a diverse team of technical experts in dozens of countries who help customers achieve more with the AWS cloud. Are you a Data Analytics specialist? Do you have Data Warehousing, Hadoop/D...

DESCRIPTION Have you ever ordered a product from Amazon and been amazed at how fast it gets to you? Every day Amazon engineers are relentlessly working to decrease the time between Click to Deliver for your products. The Amazon Fulfillment Technologies (AFT) team owns all of the software and infrastructure which powers Amazon's world-class fulfillment engine. Our team is building complex, massive data systems to capture data during every step in the automated pipeline and use that data to proactively predict efficiency and cost improvements to deliver the packages fast to our customers. As an Amazon.com Big Data Engineer you will be working in one of the world's largest and most complex data...

Job Title: Data Engineer (Freelancer) Company: 360Digitmg Department: Information Technology / Data & Analytics Division Reporting To: Head – Data & Digital Infrastructure Role Summary The Data Engineer will be responsible for designing, developing, and maintaining robust data pipelines and architectures that support the Ministry’s digital transformation initiatives. The role involves integrating multiple data sources, ensuring data accuracy and availability, and supporting analytics, reporting, and evidence-based policy decisions. Key Responsibilities Design, build, and maintain data pipelines and ETL/ELT processes to collect, transform, and store data from various systems and external sour...

Job Description We are looking for an enthusiastic and skilled Data Engineer with hands-on experience in designing, developing, and maintaining scalable data pipelines using distributed data processing technologies. The candidate will work closely with senior engineers and data scientists to support data-driven analytics, insights, and product development. Key Responsibilities Design and develop efficient data pipelines for batch and streaming data processing. Work with big data technologies such as Hadoop, Apache Spark, Apache Flink, and Apache Kafka to handle large-scale datasets. Support the data science and analytics teams by building ETL processes and transforming raw data into usable f...

DESCRIPTION AWS Sales, Marketing, and Global Services (SMGS) is responsible for driving revenue, adoption, and growth from the largest and fastest growing small- and mid-market accounts to enterprise-level customers including public sector. AWS Global Services includes experts from across AWS who help our customers design, build, operate, and secure their cloud environments. Customers innovate with AWS Professional Services, upskill with AWS Training and Certification, optimize with AWS Support and Managed Services, and meet objectives with AWS Security Assurance Services. Our expertise and emerging technologies include AWS Partners, AWS Sovereign Cloud, AWS International Product, and the Ge...

DESCRIPTION AWS Global Services includes experts from across AWS who help our customers design, build, operate, and secure their cloud environments. Customers innovate with AWS Professional Services, upskill with AWS Training and Certification, optimize with AWS Support and Managed Services, and meet objectives with AWS Security Assurance Services. Our expertise and emerging technologies include AWS Partners, AWS Sovereign Cloud, AWS International Product, and the Generative AI Innovation Center. You’ll join a diverse team of technical experts in dozens of countries who help customers achieve more with the AWS cloud. Are you a Data Analytics specialist? Do you have Data Warehousing, Hadoop/D...

Potential candidates should have hands-on experience in applying first principles methods, machine learning, data mining, and text mining techniques to build analytics prototypes that work on massive datasets. Candidate should have proficiency in Python, expertise in Entity extraction, document classification, Natural Language Processing (NLP) & Natural Language Generation (NLG). Experience of developing commonly used predictive models like - Linear Regression, Decision Trees, SVM. KNN, Gradient Boost, Random Forest etc. Proficiency in cloud platforms like GCP, including experience with deploying AI applications. Solid programming skills in Python and experience with relevant libraries and f...

Roles & Responsibilities: Take ownership of complex software projects from conception to deployment Manage software delivery scope, risk, and timeline Possesses strong rapid prototyping skills and can quickly translate concepts into working code Provide technical guidance and mentorship to junior developers Contribute to both front-end and back-end development using cloud technology Develop innovative solution using generative AI technologies Conduct code reviews to ensure code quality and adherence to best practices Create and maintain documentation on software architecture, design, deployment, disaster recovery, and operations Identify and resolve technical challenges effectively Stay upda...

Overview: We are seeking a highly motivated and experienced data scientist to help us in leading the team of Gen-Ai Engineers involved. You are required to lead manage all the processes from data extraction, cleaning, and pre-processing, to training models and deploying them to production. The ideal candidate will be passionate about artificial intelligence and stay up-to-date with the latest developments in the field. Key Responsibilities: Utilize frameworks like Langchain for developing scalable and efficient AI solutions. Integrate vector databases such as Azure Cognitive Search, Weavite, or Pinecone to support AI model functionalities. Work closely with cross-functional teams to define p...