121 Hadoop Ecosystem Jobs - Page 3

We are seeking a highly skilled and motivated Big Data Engineer to join our data engineering team. The ideal candidate will have hands-on experience with Hadoop ecosystem, Apache Spark, and programming expertise in Python (PySpark), Scala, and Java. You will be responsible for designing, developing, and optimizing scalable data pipelines and big data solutions to support analytics and business intelligence initiatives.

We are seeking a highly skilled and motivated Big Data Engineer to join our data engineering team. The ideal candidate will have hands-on experience with Hadoop ecosystem, Apache Spark, and programming expertise in Python (PySpark), Scala, and Java. You will be responsible for designing, developing, and optimizing scalable data pipelines and big data solutions to support analytics and business intelligence initiatives.

As a Senior Data Engineer (Scala) at EY Advisory - Data and Analytics, you will have the opportunity to leverage your expertise in the Financial Services domain and Big Data ecosystem to design, build, and maintain scalable data pipelines and solutions. Your role will involve working with Spark, Scala, SQL, and Cloud technologies like GCP, Azure, or AWS to manage and process large datasets efficiently. Additionally, you will be expected to participate in all aspects of the Big Data solution delivery life cycle, from analysis to production deployment and support. **Key Responsibilities:** - Strong knowledge in Spark with a good understanding of the Spark framework and performance tuning - Pro...

Role Overview: As an experienced Oracle Big Data Service (BDS) Specialist at Kenexai, your main responsibility will be to design, implement, and maintain the Oracle BDS infrastructure. Your expertise in Oracle BDS cluster setup, configuration, administration, and performance optimization will be crucial in managing Hadoop ecosystem components within the Oracle Cloud Infrastructure (OCI). Key Responsibilities: - Design and deploy Oracle BDS clusters on OCI - Configure BDS cluster topologies including HA and non-HA setups - Set up and configure cluster nodes (master, utility, worker, edge nodes) - Implement cluster security with Kerberos authentication and Ranger policies - Configure network s...

As a Sr. Data Engineer/Architect at Barclays, you will play a vital role in driving innovation and excellence in the digital landscape. You will utilize cutting-edge technology to enhance digital offerings, ensuring exceptional customer experiences. Working alongside a team of engineers, business analysts, and stakeholders, you will tackle complex technical challenges that require strong analytical skills and problem-solving abilities. **Key Responsibilities:** - Experience and understanding in ETL, APIs, various data formats (JSON, Avro, Parquet) and experience in documenting/maintaining interface inventories. - Deep understanding of AWS services (e.g., Glue, S3, Databricks, Snowflake) and ...

Job Description: You will be responsible for leveraging your strong expertise in Snowflake, Hadoop ecosystem, PySpark, and SQL to enable data-driven decision-making across the organization. Key Responsibilities: - Utilize your expertise in Snowflake, Hadoop ecosystem, PySpark, and SQL to support data-driven decision-making. - Play a key role in enabling the organization to make informed decisions based on data analysis. Qualifications Required: - Strong expertise in Snowflake, Hadoop ecosystem, PySpark, and SQL. Note: No additional details about the company were provided in the job description. Job Description: You will be responsible for leveraging your strong expertise in Snowflake, Hadoop...

Educational Requirements Bachelor of Engineering Service Line Strategic Technology Group Responsibilities Power Programmer is an important initiative within Global Delivery to develop a team of Full Stack Developers who will be working on complex engineering projects, platforms and marketplaces for our clients using emerging technologies., They will be ahead of the technology curve and will be constantly enabled and trained to be Polyglots., They are Go-Getters with a drive to solve end customer challenges and will spend most of their time in designing and coding, End to End contribution to technology oriented development projects., Providing solutions with minimum system requirements and in...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : PySpark Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :Seeking a forward-thinking professional with an AI-first mindset to design, develop, and deploy enterprise-grade solutions using Generative and Agentic AI frameworks that drive innovation, efficiency, and business transformation. As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact...

About The Role Project Role : Security Consulting Practitioner Project Role Description : Advise clients on their business protection journey by shaping security strategy, designing solutions, and providing guidance to strengthen cyber resilience. Must have skills : Security Platform Engineering Good to have skills : NA Minimum 12 year(s) of experience is required Educational Qualification : 15 years full time education Summary :The Platform Management Manager will lead the design, deployment, and operational excellence of QRadar, Splunk, and Hadoop platforms. This role involves managing a team of analysts and engineers, ensuring platform scalability, performance, and alignment with security...

About The Role Project Role : Custom Software Engineer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Apache Hadoop Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Custom Software Engineer, you will engage in the design, construction, and configuration of applications tailored to meet specific business processes and application requirements. Your typical day will involve collaborating with cross-functional teams to gather requirements, developing innovative solutions, and ensuring that applications are optim...

As a Lead Data Engineer at Manyata Tech Park, your role will involve the following responsibilities: - Strong expertise in Java (8+) & Spring Boot for building RESTful microservices & enterprise integrations. - Hands-on experience with the Hadoop ecosystem including HDFS, Hive/Spark, and Oozie/Sqoop for building production-grade data pipelines. - Proficiency in Google Cloud Platform (GCP) across data services such as BigQuery, Dataproc, Cloud Storage, Dataflow/Composer, & IAM/networking basics. - Experience in CI/CD & automation using Git-based workflows, familiarity with containerization & cloud deployment patterns. Nice to have: - Experience with schema management, data quality, lineage, &...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Apache Hadoop Good to have skills : Python (Programming Language) Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day will involve collaborating with team members to understand project needs, developing innovative solutions, and ensuring that ap...

About The Role Project Role : Software Development Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : Apache Hadoop Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Engineer, you will analyze, design, code, and test multiple components of application code across one or more clients. You will perform maintenance, enhancements, and/or development work in a dynamic environment. Roles & Responsibilities: Expected to perform in...

About The Role Project Role : Software Development Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : Apache Hadoop Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Engineer, you will analyze, design, code, and test multiple components of application code across one or more clients. You will perform maintenance, enhancements, and/or development work in a dynamic environment. Roles & Responsibilities: Expected to perform in...

Required Skills & Experience-Pharma Domain 5+ years of experience in IT with 3+ years in Big Data and Cloud Data Engineering. Strong expertise in Hadoop ecosystem HDFS, Hive, Sqoop, Spark. Proficiency in PySpark , SQL , and Python for data transformation and automation. Hands-on experience with Databricks notebooks and DBFS . Deep knowledge of AWS Cloud Services (S3, Glue, Redshift, Lambda, DMS, Athena, EC2, IAM). Experience with Azure Data Factory, Azure Synapse, and Azure Data Lake (ADLS) . Familiarity with Snowflake , DBT , and Airflow for pipeline orchestration and transformation. Strong understanding of data quality, performance tuning, and optimization techniques in Spark. Experience w...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Data Engineering Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :We are looking for a highly skilled and experienced ETL Lead with a strong background in Data Warehousing, ETL processes, and Big Data technologies. The ideal candidate should have hands-on experience with Cloudera tools, excellent SQL/PLSQL skills, and the ability to lead a team while working closely with clients in the Banking/Insurance domain. Rol...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Apache Spark Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. Your typical day will involve collaborating with team members to understand project needs, developing innovative solutions, and ensuring that applications are optimized for performance and usability. You will engage in prob...

As a Senior Data Architect at Niveus Solutions, you will play a pivotal role in designing, building, and maintaining robust data platforms on Azure and GCP. Your responsibilities will include: - Solutioning and Consultation - Developing and implementing comprehensive data architectures, including data warehouses, data lakes, and data lake houses on Azure and GCP platforms. - Designing and creating data models that align with business requirements and support efficient data analysis and reporting. - Developing and optimizing ETL/ELT pipelines using tools like Databricks, Azure Data Factory, or GCP Data Fusion to extract, transform, and load data into various data stores. - Designing and imple...

As a Data Governance Architect at Tiger Analytics, your role involves a mix of hands-on work, customer interaction, and technical team management. Your primary responsibility will be to design, architect, deploy, and maintain big data-based data governance solutions. Specifically, you will: - Manage the technical aspects throughout the entire lifecycle of big data-based data governance projects, including requirement analysis, platform selection, architecture design, and deployment. - Scale the solutions within a cloud-based infrastructure. - Collaborate with business consultants, data scientists, engineers, and developers to create data solutions. - Explore innovative technologies for solvi...

As a Business Analytics Analyst (Officer) in the Internal Audit Analytics Team at Citi, your role involves working with the Digital Solutions and Innovation (DSI) team within the Citi Internal Audit Innovation function to identify opportunities, design, develop, and implement analytics to support audit activities. Your proficiency in analytics technology and tools will contribute to enhancing audit efficiency and effectiveness while having a functional knowledge of banking processes and related risks and controls. **Key Responsibilities:** - Participate in the innovative use of audit analytics through direct involvement in all audit phases. - Support defining data needs, designing, and execu...

Job Title: Hadoop Administrator Location: Chennai, India Experience: 4+yrs of experience in IT, with At least 3+ years of experience with cloud and system administration. At least 3 years of experience with and strong understanding of big data technologies in Hadoop ecosystem Hive, HDFS, Map/Reduce, Flume, Pig, Cloudera, HBase Sqoop, Spark etc. Company: Smartavya Analytica Private limited is a niche Data and AI company. Based in Pune, we are pioneers in data-driven innovation, transforming enterprise data into strategic insights. Established in 2017, our team has experience in handling large datasets up to 20 PBs in a single implementation, delivering many successful data and AI projects acr...

As a Business Analytics Int Analyst at Citi, you will be part of the Digital Solutions and Innovation team within the Citi Internal Audit Innovation function. Your role will involve working with members of Internal Audit to identify opportunities, design, develop, and implement analytics to support audit activities, as well as automation activities to enhance efficiency and expand coverage. You will need to be proficient in analytics technology and tools, have functional knowledge of banking processes, and related risks and controls. **Key Responsibilities:** - Participate in the innovative use of audit analytics through all phases of audits - Support defining data needs, designing, and exec...

As a Senior Spark Data Engineer at Barclays, you will play a crucial role in the evolution of the digital landscape, driving innovation and excellence. Your main responsibilities will include: - Designing, building, and maintaining data processing systems using Apache Spark and related big data technologies. - Ensuring data quality, integrity, and security throughout the data lifecycle. - Developing and maintaining data processing frameworks and reusable components. - Creating and maintaining documentation for data pipelines and processes. - Supporting the migration of legacy data processing systems to modern big data platforms. - Utilizing technologies such as Spark, Hive, Solace, Kafka, Ja...

As a Data Engineer in our company, your role will involve designing and implementing data migration, ingestion, processing, and analytics pipelines using a variety of technologies including AWS (S3, Glue, Lambda, Athena, RDS Aurora, Databricks) and Azure (ADF, ADLS, Synapse, Databricks). You will be expected to apply your strong expertise in SQL, data modeling, schema design, and data quality management. Additionally, you will need to ensure governance, security, compliance, metadata management, MDM, and data catalog practices are followed. Working with big data, NoSQL, relational DBs, and data warehouse solutions will be part of your responsibilities. Building real-time pipelines with Kafka...

As an Applications Development Senior Programmer Analyst at Citi, you will be responsible for participating in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. Your role will involve contributing to applications systems analysis and programming activities. You will have the opportunity to work on various tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establishing new or revised applications systems to meet specific business needs. Additionally, you will monitor and control all phases of the development process, provide...