54 Hadoop Ecosystem Jobs - Page 2

Core Requirements 8+ years with Linux, Bash, Python, SQL. 4+ years with Spark, Hadoop ecosystem, and team leadership. Strong AWS experience: EMR, Glue, Athena, Redshift. Proven expertise in designing data flows and integration APIs. Passion for solving complex problems using modern tech. Preferred Skills Degree in CS or related field. Python, C++, or similar programming language. Experience with petabyte-scale data, data catalogs (Hive, Glue), and pipeline tools (Airflow, dbt). Familiarity with AWS and/or GCP.

As a Big Data Engineer at our company, you will be an integral part of our data engineering team. Your primary responsibility will be to design, develop, and optimize scalable data pipelines and big data solutions. To excel in this role, you should have hands-on experience with the Hadoop ecosystem, Apache Spark, and programming languages such as Python (PySpark), Scala, and Java. Your expertise in these technologies will enable you to support analytics and business intelligence initiatives effectively. By leveraging your skills, you will contribute to the success of our data-driven projects and help drive insights that can positively impact our business. If you are a highly skilled and moti...

This position falls under the ICG TTS Operations Technology (OpsTech) Group, focusing on assisting in the implementation of a next-generation Digital Automation Platform and Imaging Workflow Technologies. The ideal Candidate should have relevant experience in managing development teams within the distributed systems Eco-System and must exhibit strong teamwork skills. The candidate is expected to possess superior technical knowledge of current programming languages, technologies, and leading-edge development tools. The primary objective of this role is to contribute to applications, systems analysis, and programming activities. As a Lead Spark Scala Engineer, the candidate should have hands-o...

As an expert in Google Cloud Platform (GCP) services, Docker, Kubernetes, and Hadoop ecosystem, you will play a crucial role in the infrastructure development of _VOIS India. Your responsibilities will include leveraging GCP services such as Data Fusion, Data Flow, Pub/Sub, Kubernetes, and Cloud Storage to enhance the efficiency and quality of our operations. You will be expected to have hands-on experience with Google Cloud Build, Terraform, Ansible, and Infrastructure as code (IaaC) to ensure a secure and scalable multi-tenancy infrastructure. Your expertise in Secure by Design concept and GCP IAM will be essential in maintaining a robust and secure architecture. In addition, your strong D...

Oracle Health Data Intelligence is seeking a Senior Software Engineer to join the HealtheCare Care Coordination team. In this role, you will write and configure code based on technical specifications, following the Agile Methodology for timely delivery. Your responsibilities will include enhancing existing software, participating in code reviews, collaborating on technical designs, debugging issues, and identifying process improvements. Additionally, you will provide software release support, mentor new associates, and contribute to training programs. To excel in this role, you should have experience with distributed systems, building highly available services, service-oriented design patter...

We are looking for a Hadoop Developer with hands-on experience in managing, developing data solutions on Hadoop ecosystems. The candidate should have strong technical expertise in data lake design, data pipelines, and real-time/batch data processing. Required Candidate profile 3+ Yrs in Manage & support Cloudera Hadoop on-premise clusters. Work on data modelling, governance, migrations, application development. Proficiency in Spark, Hive, Impala, Kafka, related tools. Perks and benefits To be disclosed post interview

As a Business Analytics Analyst (Officer) at Citi in the Internal Audit Analytics Team, you will be an integral part of the Digital Solutions and Innovation (DSI) team, focusing on leveraging analytics to enhance audit efficiency and effectiveness. Your role involves working closely with Internal Audit members to identify opportunities, develop analytics, and automate activities to improve audit performance and coverage. Your key responsibilities will include actively participating in audit analytics initiatives, defining data needs, executing audit analytics in alignment with professional standards, and supporting the automation of audit testing processes. You will collaborate with audit te...

6+ years of experience in information technology, Minimum of 3-5 years of experience in managing and administering Hadoop/Cloudera environments. Cloudera CDP (Cloudera Data Platform), Cloudera Manager, and related tools. Hadoop ecosystem components (HDFS, YARN, Hive, HBase, Spark, Impala, etc.). Linux system administration with experience with scripting languages (Python, Bash, etc.) and configuration management tools (Ansible, Puppet, etc.) Tools like Kerberos, Ranger, Sentry), Docker, Kubernetes, Jenkins Cloudera Certified Administrator for Apache Hadoop (CCAH) or similar certification. Cluster Management, Optimization, Best practice implementation, collaboration and support.

As a Data Governance Architect at Tiger Analytics, you will play a crucial role in designing, architecting, deploying, and maintaining big data-based data governance solutions. Your responsibilities will include technical management throughout the project life cycle, collaboration with various teams, exploring new technologies, and leading a team of data governance engineers. You are expected to have a minimum of 10 years of technical experience, with at least 5 years in the Hadoop ecosystem and 3 years in Data Governance Solutions. Hands-on experience with Data Governance Solutions is essential, along with a good understanding of data catalog, business glossary, metadata, data quality, data...

You will be working as a Data Architect at Niveus Solutions, a dynamic organization focused on utilizing data for business growth and decision-making. Your role will be crucial in designing, building, and maintaining robust data platforms on Azure and GCP. As a Senior Data Architect, your responsibilities will include: - Developing and implementing comprehensive data architectures such as data warehouses, data lakes, and data lake houses on Azure and GCP. - Designing data models aligned with business requirements to support efficient data analysis and reporting. - Creating and optimizing ETL/ELT pipelines using tools like Databricks, Azure Data Factory, or GCP Data Fusion. - Designing scalab...

You should have a Bachelors Degree in Computer Science, Computer Engineering or related technical field, while a Masters Degree or other advanced degree is preferred. With 4-6+ years of total experience, you should possess at least 2+ years of relevant experience in Big Data platforms. Your skill set should include strong analytical, problem solving, and communication/articulation skills. Furthermore, you are expected to have 3+ years of experience with big data and the Hadoop ecosystem, including Spark, HDFS, Hive, Sqoop, Hudi, Parquet, Apache Nifi, and Kafka. Proficiency in Scala/Spark is required, and knowledge of Python is considered a plus. Hands-on experience with Oracle and MS-SQL dat...

The Applications Development Intermediate Programmer Analyst position is a role at an intermediate level where you will be responsible for participating in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. Your main objective will be to contribute to applications systems analysis and programming activities. Your responsibilities will include utilizing your knowledge of applications development procedures and concepts, as well as basic knowledge of other technical areas to identify and define necessary system enhancements. This will involve using script tools, analyzing/interpreting code, consulting with users, cl...

You are a highly skilled and detail-oriented ETL QA - Technical Lead with a solid background in Big Data Testing, the Hadoop ecosystem, and SQL validation. Your primary responsibility will be leading end-to-end testing efforts for data/ETL pipelines across various big data platforms. You will be working closely with cross-functional teams in an Agile environment to ensure the quality and integrity of large-scale data solutions. Your key responsibilities include designing and implementing test strategies for validating large datasets, transformations, and integrations. You will be hands-on testing Hadoop-based data platforms such as HDFS, Hive, and Spark. Additionally, you will develop comple...

The Applications Development Intermediate Programmer Analyst position is an intermediate level role where you will be responsible for contributing to the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. Your main objective will be to assist in applications systems analysis and programming activities. You will utilize your knowledge of applications development procedures and concepts, along with basic knowledge of technical areas, to identify and define necessary system enhancements. This includes using script tools, analyzing code, and consulting with users, clients, and other technology groups to recommend programm...

As an ETL Testing & Big Data professional, you will be responsible for designing and implementing ETL test strategies based on business requirements. Your role involves reviewing and analyzing ETL source code, as well as developing and executing test plans and test cases for ETL processes. Data validation and reconciliation using SQL queries will be a key aspect of your responsibilities. Monitoring ETL jobs, resolving issues affecting data accuracy, and performing performance testing on ETL processes to focus on optimization are crucial tasks in this role. Ensuring data quality and integrity across various data sources, along with coordinating with development teams to troubleshoot issues an...

You should hold a Bachelor's degree in Physics, Mathematics, Engineering, Metallurgy, or Computer Science, along with an MSc in a relevant field such as Physics, Mathematics, Engineering, Computer Science, Chemistry, or Metallurgy. Additionally, you should possess at least 8 years of experience in Data Science and Analytics delivery. Your expertise should include deep knowledge of machine learning, statistics, optimization, and related fields. Proficiency in programming languages like R and Python is essential, as well as experience with machine learning skills such as Natural Language Processing (NLP) and deep learning techniques. Furthermore, you should have hands-on experience with deep l...

As an experienced professional with 5 to 10 years of experience in the field of information technology, you will be responsible for creating data models for corporate analytics in compliance with standards, ensuring usability and conformance across the enterprise. Your role will involve developing data strategies, ensuring vocabulary consistency, and managing data transformations through intricate analytical relationships and access paths, including data mappings at the data-field level. Collaborating with Product Management and Business stakeholders, you will identify and evaluate data sources necessary to achieve project and business objectives. Working closely with Tech Leads and Product ...

We are looking for a talented Python QA Automation Engineer with expertise in cloud technologies, specifically Google Cloud Platform (GCP). As a Python QA Automation Engineer, you will be responsible for designing, implementing, and maintaining automated testing frameworks to ensure the quality and reliability of software applications deployed on GCP. This role requires a strong background in Python programming, QA automation, and cloud-based environments. You will collaborate with internal teams to solve complex problems in quality and development, while gaining a deep understanding of networking and access technologies in the Cloud. Your responsibilities will include leading or contributin...

The Applications Development Senior Programmer Analyst position is a vital role where you will participate in establishing and implementing new or revised application systems and programs in collaboration with the Technology team. Your main goal will be to contribute to applications systems analysis and programming activities. Your responsibilities will include conducting tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and implementing new or revised applications systems and programs to meet specific business needs or user areas. You will be responsible for monitoring and controlling all phases of the d...

You should have strong experience in PySpark, Python, Unix scripting, SparkSQL, and Hive. You must be proficient in writing SQL queries, creating views, and possess excellent oral and written communication skills. Prior experience in the Insurance domain would be beneficial. A good understanding of the Hadoop Ecosystem including HDFS, Map Reduce, Pig, Hive, Oozie, and Yarn is required. Knowledge of AWS services such as Glue, AWS S3, Lambda function, Step Function, and EC2 is essential. Experience in data migration from platforms like Hive/S3 to Data Bricks is a plus. You should be able to prioritize, plan, organize, and manage multiple tasks efficiently while delivering high-quality work. As...

As a skilled candidate for this position, you should possess a minimum of 8 to 10 years of experience in Java, REST API, and Spring Boot. Additionally, you must have hands-on experience with AngularJS, ReactJS, or VueJS. A bachelor's degree or higher in computer science, data science, or a related field is required. Your role will involve working with data cleaning, visualization, and reporting, requiring practical experience in these areas. Previous exposure to an agile environment is essential for success in this position. Your excellent analytical and problem-solving skills will be key assets in meeting the job requirements. In addition to the mandatory qualifications, familiarity with th...

As a Java Developer, you will be responsible for utilizing your 8 to 10 years of experience in Java, REST API, and Spring boot to develop efficient and scalable solutions. Your expertise in Angular JS, React JS, or View JS will be essential for creating dynamic and interactive user interfaces. A Bachelors degree or higher in computer science, data science, or a related field is required to ensure a strong foundation in software development. Your role will involve hands-on experience with data cleaning, visualization, and reporting, enabling you to contribute to data-driven decision-making processes. Working in an agile environment, you will apply your excellent analytical and problem-solving...

We are looking for a highly skilled and motivated Python, AWS, Big Data Engineer to join our data engineering team. The ideal candidate should have hands-on experience with the Hadoop ecosystem, Apache Spark, and programming expertise in Python (PySpark), Scala, and Java. Your responsibilities will include designing, developing, and optimizing scalable data pipelines and big data solutions to support analytics and business intelligence initiatives. Virtusa is a company that values teamwork, quality of life, and professional and personal development. We are proud to have a team of 27,000 people globally who care about your growth and seek to provide you with exciting projects, opportunities, ...

The Applications Development Technology Lead Analyst role is a senior position where you will be responsible for implementing new or updated application systems and programs in collaboration with the Technology team. Your main objective will be to lead applications systems analysis and programming activities. Your responsibilities will include partnering with various management teams to ensure the integration of functions to achieve goals, identifying necessary system enhancements for new products and process improvements, resolving high-impact problems/projects by evaluating complex business processes, providing expertise in applications programming, ensuring application design aligns with ...

As a Site Reliability Engineering (SRE) Technical Leader on the Network Assurance Data Platform (NADP) team at Cisco ThousandEyes, you will be responsible for ensuring the reliability, scalability, and security of the cloud and big data platforms. Your role will involve representing the NADP SRE team, contributing to the technical roadmap, and collaborating with cross-functional teams to design, build, and maintain SaaS systems operating at multi-region scale. Your efforts will be crucial in supporting machine learning (ML) and AI initiatives by ensuring the platform infrastructure is robust, efficient, and aligned with operational excellence. You will be tasked with designing, building, and...