121 Hadoop Ecosystem Jobs

Job Description: You should have a minimum of 8 to 10 years of experience in Java, REST API, and Spring boot. Additionally, hands-on experience in Angular JS, React JS, or View JS is required. A Bachelors degree or higher in computer science, data science, or a related field is a must. You should also possess hands-on experience with data cleaning, visualization, and reporting, along with experience working in an agile environment. Excellent analytical and problem-solving skills, as well as excellent communication and interpersonal skills, are essential. Key Responsibilities: - Minimum 8 to 10 years of experience in Java, REST API, Spring boot - Hands-on experience in Angular JS, React JS, o...

Strong Python programming skills. Experience in workflow orchestration using Apache Airflow. Experience in productionizing machine learning models in Domino run-time environment. Experience in building data pipelines using Python and PySpark. Strong SQL skills and experience in extracting data from different databases (Hive, SnowFlake, etc.), performing data transformation, etc. Preferable experience working with Hadoop ecosystem - HDFS, Hive. Experience working with a job scheduler, preferably Control-M. Experience with Unix-based command line interface and Bash scripts. Experience in developing and querying APIs - Restful, OpenAPI, etc. Strong understanding of DevOps and CI/CD principles; ...

Spark/Scala - Job Description Qualifications: Bachelor of Engineering Desired Skills: Scala, Spark, Unix Must-Have Skills Minimum 4+ years of experience in development of Spark Scala. Experience in designing and developing solutions for Big Data using Hadoop ecosystem technologies such as HDFS, Spark, Hive, Parquet File format, YARN, MapReduce, Sqoop. Good experience in writing and optimizing Spark jobs, Spark SQL, and handling both batch and streaming data processing. Experience in writing and optimizing complex Hive and SQL queries to process large datasets, including proficiency with UDFs, tables, joins, and views. Experience in debugging Spark code. Working knowledge of basic UNIX comman...

Responsibilities & Requirements: Strong hands-on experience in Python programming and PySpark. Experience using AWS services such as RedShift, Glue, EMR, S3, and Lambda. Experience working with Apache Spark and the Hadoop ecosystem. Must have Data Warehouse experience with AWS Redshift or Hive. Experience in implementing security measures for data protection. Expertise in building and testing complex data pipelines for ETL processes (batch and near real time). Qualifications Bachelor of Technology

Must Have: AWS Redshift, Glue, PySpark Key Responsibilities & Requirements Strong hands-on experience in Python programming and PySpark. Experience using AWS services such as RedShift, Glue, EMR, S3, and Lambda. Experience working with Apache Spark and Hadoop ecosystem. Proficiency in writing and optimizing SQL for data manipulations. Familiarity with scheduling tools; experience with Airflow is preferable. Data warehouse experience with AWS Redshift or Hive is a must. Experience in implementing security measures for data protection. Qualifications Bachelor of Engineering

As the Data Team Lead, you will play a crucial role in driving the strategy, governance, and operational excellence of the enterprise data platform. Your responsibilities will include: - Leading and managing vendor Data Engineering and Architecture teams, allocating tasks and planning resources effectively. - Acting as the primary owner of the Data Platform strategy and roadmap. - Overseeing Data Platform reporting activities such as system go-lives, KPI tracking, usage insights, and FinOps monitoring. - Serving as the subject matter expert for the Data Platform ecosystem, including Snowflake, AWS, Glue, etc. - Defining and evolving the long-term platform strategy in alignment with business ...

About The Role Project Role : Custom Software Engineer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Apache Hadoop Good to have skills : Python (Programming Language) Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day will involve collaborating with team members to understand project needs, developing innovative solutions, and ensuring that...

About The Role Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : Apache Hadoop Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education , Summary As a Software Development Engineer, you will analyze, design, code, and test multiple components of application code across one or more clients. You will perform maintenance, enhancements, and/or development work in a...

About The Role Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : Apache Hadoop Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education , Summary As a Software Development Engineer, you will analyze, design, code, and test multiple components of application code across one or more clients. You will perform maintenance, enhancements, and/or development work in a...

Position Summary To be a technology expert architecting solutions and mentoring people in BI / Reporting processes with prior expertise in the Pharma domain. Job Responsibilities o Technology Leadership – Lead guide the team independently or with little support to design, implement deliver complex reporting and BI project assignments. o Technical portfolio – Expertise in a range of BI and hosting technologies like the AWS stack (Redshift, EC2), Qlikview, QlikSense, Tableau, Microstrategy, Spotfire o Project Management – Get accurate briefs from the Client and translate into tasks for team members with priorities and timeline plans. Must maintain high standards of quality and thoroughness. Sh...

Job Overview The Senior Software Engineer will do the design, development, and delivery of advanced big data solutions within the Hadoop ecosystem. This role involves architecting and implementing scalable data processing frameworks, ensuring high performance and reliability across distributed systems. The engineer will research and evaluate emerging technologies to optimize data workflows and meet evolving business needs. Additionally, the position requires hands-on expertise in Cloudera distribution and related tools, ensuring seamless orchestration and integration of data pipelines. The Senior Software Engineer will also be responsible for maintaining operational excellence, meeting SLA r...

Title and Summary The Software Engineer II will contribute to the design, development, and maintenance of big data solutions within the Hadoop ecosystem The role involves working with distributed data processing frameworks and supporting the creation of reliable, high-performance data pipelines The engineer will be responsible for hands-on development and troubleshooting using the Cloudera distribution, along with related ecosystem tools such as Apache Ozone, Apache Iceberg, Apache Airflow, and Apache NiFi The position requires hands on experience in Apache Spark to support large-scale, massively parallel data processing tasks The Software Engineer II will collaborate closely with senior tea...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Data Engineering Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :We are looking for a highly skilled and experienced ETL Lead with a strong background in Data Warehousing, ETL processes, and Big Data technologies. The ideal candidate should have hands-on experience with Cloudera tools, excellent SQL/PLSQL skills, and the ability to lead a team while working closely with clients in the Banking/Insurance domain. Rol...

Role Overview: As a Lead Spark Scala Engineer under ICG TTS Operations Technology (OpsTech) Group, you will be responsible for developing and optimizing production-grade Spark applications in Scala. Your role will involve providing technical leadership, conducting code reviews, enforcing best practices, and optimizing performance. Your expertise in Spark, Scala, RDBMS, CI/CD tools, and other relevant technologies will be crucial in contributing to applications, systems analysis, and programming activities. Key Responsibilities: - Develop, test, and deploy production-grade Spark applications in Scala, ensuring optimal performance, scalability, and resource utilization. - Provide technical lea...

Role Overview: You will be working as a Lead Spark Scala Engineer under ICG TTS Operations Technology (OpsTech) Group to assist in the implementation of the next generation Digital Automation Platform and Imaging Workflow Technologies. Your role will involve managing development teams in the distributed systems Eco-System and collaborating effectively as a team player. Your primary objective will be to contribute to applications, systems analysis, and programming activities. Key Responsibilities: - Develop, test, and deploy production-grade Spark applications in Scala, ensuring optimal performance, scalability, and resource utilization. - Provide technical leadership and guidance to a team o...

Role Overview: As the Applications Development Group Manager at our company, you will be responsible for leading a team in establishing and implementing new or revised application systems and programs in coordination with the Technology Team. Your main objective will be to drive applications systems analysis and programming activities. Key Responsibilities: - Manage multiple teams of professionals to accomplish established goals and conduct personnel duties for the team (e.g. performance evaluations, hiring, and disciplinary actions) - Provide strategic influence and exercise control over resources, budget management, and planning while monitoring end results - Utilize in-depth knowledge of ...

As a Senior Data Engineer at EY Advisory - Data and Analytics, you will have the opportunity to leverage your expertise in the Financial Services domain to design, build, and maintain scalable data pipelines and solutions. Your role will involve working with big data ecosystems and cloud technologies like GCP, Azure, or AWS to process large datasets efficiently. Here are the primary skills and key responsibilities for this role: - Strong knowledge in Spark and a good understanding of the Spark framework, including performance tuning. - Proficiency in Scala and SQL. - Hands-on experience in designing and building scalable data pipelines. - Experience with one of the Cloud technologies - GCP, ...

Role Overview: You will be part of the Infra & DevOps team within DWS India, responsible for providing shared services across build, release, and QA Automation space. Your main responsibilities will include building and maintaining non-prod and prod environments, setting up alerting and monitoring systems, and transitioning projects to L2 support teams post Go Live. You will collaborate closely with stakeholders such as client Product Owners, Digital Design Organisation, Business Analysts, Developers, and QA teams to ensure program delivery. Key Responsibilities: - Drive automation, including automated build, test, and deployment processes - Support and manage Data/Digital systems architectu...

About The Role Project Role : Custom Software Engineer Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : PySpark Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various stakeholders to gather requirements, overseeing the development process, and ensuring that the applications meet the specified needs and quality standards. You wil...

About The Role Project Role : Custom Software Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : PySpark Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Engineer, you will engage in a dynamic work environment where you will analyze, design, code, and test various components of application code across multiple clients. Your day will involve collaborating with team members to ensure the successful implementation of software...

Overview The Financial Solutions BizOps team is looking for a Site Reliability Engineer with strong expertise in Apache NiFi and Apache Spark to support our mission-critical data workflows and analytics platforms. This role is key to ensuring the smooth, reliability, and efficient operation of our production systems that power day-to-day business functions.You will be responsible for monitoring, troubleshooting, and supporting complex data processing pipelines and integrations in real time. Your work will directly impact business operations, decision-making, and customer experience.Business Operations is leading the DevOps transformation at Mastercard through our tooling and by being an advo...

Role Overview: You should have a minimum of 8 to 10 years of experience in Java, REST API, and Spring Boot. Additionally, hands-on experience in either AngularJS, ReactJS, or VueJS is required. A background in computer science, data science, or a related field at a Bachelors degree level or higher is essential. You should possess hands-on experience with data cleaning, visualization, and reporting. Working in an agile environment should be familiar to you. Your strong analytical and problem-solving skills, along with excellent communication and interpersonal abilities, will be crucial for this role. Key Responsibilities: - Minimum 8 to 10 years of experience in Java, REST API, and Spring Boo...

As a Solution Architect at Capgemini, you will play a crucial role in designing and implementing data science architectures to support advanced analytics, AI/ML models, and business intelligence. Your responsibilities will include: - Developing robust ETL pipelines using PySpark, Python, and modern frameworks for processing large-scale datasets. - Architecting and deploying solutions on cloud platforms like AWS, Azure, or Google Cloud using services such as Azure Data Factory, Databricks, S3, and BigQuery. - Collaborating with data scientists to ensure that the infrastructure supports predictive modeling, statistical analysis, and machine learning workflows. - Implementing CI/CD pipelines fo...

As a candidate for the position, here is a summary of the job description: Role Overview: - You should have expertise in Neo4j, including its core concepts, Cypher query language, and best practices. - Responsible for designing and implementing graph database solutions, creating and maintaining graph schemas, models, and architectures. - Your role will involve migrating data from relational or other databases into Neo4j and optimizing Cypher queries for performance to ensure efficient data retrieval and manipulation. - Essential to have familiarity with graph theory, graph data modeling, and other graph database technologies. - Developing and optimizing Cypher queries, as well as integrating...

As a Pre-Sales Solution Engineer in India, your role will involve engaging with customers in the evaluation process, conducting product demonstrations, and supporting marketing activities. Your main focus will be on pre-sales experience with software or analytics products, demonstrating expertise in various technical skills and tools such as OLAP, Microsoft Analysis services, data engineering, ETL, Hadoop ecosystem, AWS, Azure, GCP Cluster, Tableau, Microstrategy, BI tools, Hive QL, Spark SQL, PLSQL, TSQL, SQL programming, MDX queries, Linux, Python, Java, and JavaScript. Key Responsibilities: - Act as the primary point of contact for customer interactions - Handle product demonstrations for...