78 Hadoop Administration Jobs

Role Overview: You will be responsible for Hadoop Administration, with a focus on maintaining, troubleshooting, and monitoring Hadoop clusters and various components. Your role will involve installing, configuring, and integrating analytical tools with Hadoop. Additionally, you will be expected to troubleshoot application problems across different environments and platforms. Key Responsibilities: - Minimum 4 years of experience in Hadoop Administration, specifically in production support projects - Installation, configuration, maintenance, troubleshooting, and monitoring of Hadoop clusters and components such as HDFS, HBase, Hive, Sentry, Hue, Yarn, Sqoop, Spark, Oozie, ZooKeeper, Flume, and...

Role L1 - Admin & Operation Support Required Technical Skill Set Big data Analytics, Hadoop(Cloudera) with Hive, Map reduce, Cloudera Manager, Oracle ,Unix 4 Desired Relevant Hadoop Experience 1 to 3 Years 5 Overall Experience Max 3 Years Must-Have Big data Analytics, Hadoop(Cloudera) with Hive, Map reduce, Sqoop, Ambari/Cloudera Manager, Oracle ,Unix ,Scripting Good-to-Have MSTR ,Informatica Responsibilities Experience between 1-3 years in below fields Good Experience in handling multiple DB. Knowledge on ITSM process ,Alert handling, production support Hadoop, Informatica and Support. Pre-processing using Hive. Experience in Big data security and data privacy. Experience in real time repli...

Preferred candidate profile Deep understanding of Linux, networking and security fundamentals. Experience working with AWS cloud platform and infrastructure. Experience working with infrastructure as code with Terraform or Ansible tools. Experience managing large BigData clusters in production (at least one of -- Cloudera, Hortonworks, EMR). Excellent knowledge and solid work experience providing observability for BigData platforms using tools like Prometheus, InfluxDB, Dynatrace, Grafana, Splunk etc. Expert knowledge on Hadoop Distributed File System (HDFS) and Hadoop YARN. Decent knowledge of various Hadoop file formats like ORC, Parquet, Avro etc. Deep understanding of Hive (Tez), Hive LL...

About The Role Project Role : Application Designer Project Role Description : Assist in defining requirements and designing applications to meet business process and application requirements. Must have skills : Alteryx Good to have skills : Hadoop Administration Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Designer, you will assist in defining requirements and designing applications to meet business process and application requirements. Your typical day will involve collaborating with various stakeholders to gather insights, analyzing user needs, and translating them into functional specifications. You will en...

About The Role Project Role : Application Support Engineer Project Role Description : Act as software detectives, provide a dynamic service identifying and solving issues within multiple components of critical business systems. Must have skills : Hadoop Administration Good to have skills : PySpark Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Support Engineer, you will act as software detectives, providing a dynamic service that identifies and resolves issues within various components of critical business systems. Your typical day will involve collaborating with team members to troubleshoot problems, analyzing ...

About The Role Project Role : Application Support Engineer Project Role Description : Act as software detectives, provide a dynamic service identifying and solving issues within multiple components of critical business systems. Must have skills : Hadoop Administration Good to have skills : PySpark Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Support Engineer, you will act as software detectives, providing a dynamic service that identifies and resolves issues within various components of critical business systems. Your typical day will involve collaborating with team members to troubleshoot problems, analyzing ...

About The Role Project Role : Application Support Engineer Project Role Description : Act as software detectives, provide a dynamic service identifying and solving issues within multiple components of critical business systems. Must have skills : Hadoop Administration Good to have skills : PySpark Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Support Engineer, you will act as software detectives, providing a dynamic service that identifies and resolves issues within various components of critical business systems. Your typical day will involve collaborating with team members to troubleshoot problems, analyzing ...

Key Responsibilities: Install, configure, and manage Hadoop clusters, including HDFS, YARN, Hive, HBase, and other ecosystem components. Monitor and manage Hadoop cluster performance, capacity, and security. Perform routine maintenance tasks such as upgrades, patching, and backups. Implement and maintain data ingestion processes using tools like Sqoop, Flume, and Kafka. Ensure high availability and disaster recovery of Hadoop clusters. Collaborate with development teams to understand requirements and provide appropriate Hadoop solutions. Troubleshoot and resolve issues related to the Hadoop ecosystem. Maintain documentation of Hadoop environment configurations, processes, and procedures. Req...

Must-Have 5+ years of hands on experience managing a multi-node Hadoop cluster (preferably Cloudera distribution) Python or Shell scripting) 5+ years hands on experience administering HDFS, YARN, Hive, HBase, Impala services for stability and scalability Strong understanding of core Hadoop concepts and design principles Strong experience integrating Hadoop environments with Active Directory / Kerberos services and 3rd party tools Strong understating of Linux Operating System concepts, memory, CPU, storage and networks Experience in at least one scripting language (Shell, Python, Perl or other) Familiarity with configuration management and deployment tools Ability to proactively identify, tro...

Candidate Specification: Minimum 6 years of experience into Hadoop Admin Job Description: Looking for Support Specialist with 8+ years of Platform support Experience (Hadoop / Spark / Airflow) Monitor and maintain platform performance across production and staging environments Troubleshoot and resolve technical issues related to platform functionality, integrations, and user access Collaborate with development, QA, and infrastructure teams to ensure smooth deployment and operation of applications Contact Person: Sheena Rakesh Email ID: sheena@gojobs.biz

Job Summary The Big Data Engineer is responsible for designing, developing, and maintaining large-scale data processing systems. The role includes building efficient data pipelines, working with distributed technologies, and ensuring data availability, reliability, and performance for analytics and business use cases. Key Responsibilities 1. Data Pipeline Development Build scalable ETL/ELT pipelines for ingesting and transforming large datasets. Develop batch and real-time data processing solutions using Apache Spark, Kafka, Hive, Flink , or similar tools. Optimize data workflows for performance and cost. 2. Big Data Ecosystem Ownership Work with Hadoop ecosystem components (HDFS, Hive, HBas...

A Big Data Architect designs and manages the infrastructure for collecting, processing, and analyzing large, complex datasets. This role involves creating data architectures, ensuring data security and integrity, and collaborating with various teams to support business needs and drive data-driven insights. Key Responsibilities: Data Architecture Design: Designing and implementing scalable and resilient data architectures for both batch and streaming data processing. Data Modeling: Developing data models and database structures to ensure efficient data storage and retrieval. Data Security and Governance: Ensuring data security, integrity, and compliance with relevant regulations. Data Integra...

Job Description: Looking for Lead Platform Support Specialist with 8+ years of Platform support Experience (Hadoop / Spark / Airflow) Monitor and maintain platform performance across production and staging environments. Troubleshoot and resolve technical issues related to platform functionality, integrations, and user access. Collaborate with development, QA, and infrastructure teams to ensure smooth deployment and operation of applications. Document incidents, resolutions, and platform changes in internal knowledge bases. Implement automation scripts and tools to improve platform reliability and reduce manual tasks. Participate in on-call rotations and respond to critical incidents outside ...

Roles and Responsibilities : Manage Hadoop clusters on Cloudera platform, ensuring high availability and performance. Design, implement, and maintain ETL processes using Hive, Impala, Spark, and Python scripts. Troubleshoot issues related to HDFS, HBase, and other Big Data technologies in the stack. Configure and manage data storage policies, replication, and fault tolerance. Implement and manage security policies, including Kerberos for authentication and Ranger or Sentry for authorization. Conduct regular security audits and compliance checks. Deploy Cloudera clusters from scratch, including hardware and software configuration. Configure clusters to meet specific business requirements and ...

In this role, you will: Hadoop Admin is responsible for building different solutions on Big Data Platform CDP and ODP Environment Builds and Engineering Solutions through pipeline creation Proficient in Shell scripting, YAML, Python and Ansible Automations Use Agile /DevOps methodology to deliver quality software. Proficient in VAST Administration Guide team members in arriving at and delivering the right solutions. Monitor and improve the performance of Hadoop platforms. CDP / ODP Migration / Upgrade experience Agile proficient and experience in other agile methodologies. Ideally certified. Strong communication & networking skills Ability to work autonomously and take accountability to exec...

Role & responsibilities In this role, you will: Hadoop Admin is responsible for building different solutions on Big Data Platform CDP and ODP Environment Builds and Engineering Solutions through pipeline creation Proficient in Shell scripting, YAML, Python and Ansible Automations Use Agile /DevOps methodology to deliver quality software. Proficient in VAST Administration Guide team members in arriving at and delivering the right solutions. Monitor and improve the performance of Hadoop platforms. CDP / ODP Migration / Upgrade experience Agile proficient and experience in other agile methodologies. Ideally certified. Strong communication & networking skills Ability to work autonomously and tak...

Role: Hadoop Operations Admin Experience: 3+yrs Notice period: Only 15-30days Location: Remote Package: 10LPA max Support for 2 different categories, Hadoop Platform Support for Hadoop on Google Cloud Dataproc Cluster Performance Optimization & Hive DB Support on Google Cloud Dataproc Administer Customers Hadoop file system and platform including directories, disk space and scheduled platform-wide processes. The service includes performing administrative functions including: Autoscaling, sizing up or down the number of worker nodes needed on the cluster Setting. Google Monitoring for creating dashboard and monitoring performance, Setting Alerting for various Dataproc services and mapping it ...

We are looking for a skilled Hadoop Admin with 7 to 12 years of experience, located in Hyderabad, Bangalore, Chennai, and Bhubaneshwar. The ideal candidate will have hands-on experience in building EKS clusters, Spark on EKS, AWS (EMR, S3, RDS), Python as programming skills, Shell scripting, and any CI/CD. Roles and Responsibility Manage and maintain large-scale Hadoop clusters for high availability and performance. Design and implement scalable data processing pipelines using Spark and Airflow instances. Integrate Ranger and Hive Metastore services in EKS for secure data storage and access. Collaborate with cross-functional teams to identify and resolve technical issues. Develop and impleme...

Job Title: Hadoop Administrator Location: Chennai, India Experience: 4+yrs of experience in IT, with At least 3+ years of experience with cloud and system administration. At least 3 years of experience with and strong understanding of big data technologies in Hadoop ecosystem Hive, HDFS, Map/Reduce, Flume, Pig, Cloudera, HBase Sqoop, Spark etc. Company: Smartavya Analytica Private limited is a niche Data and AI company. Based in Pune, we are pioneers in data-driven innovation, transforming enterprise data into strategic insights. Established in 2017, our team has experience in handling large datasets up to 20 PBs in a single implementation, delivering many successful data and AI projects acr...

About The Role Project Role : Application Designer Project Role Description : Assist in defining requirements and designing applications to meet business process and application requirements. Must have skills : Alteryx Good to have skills : Hadoop Administration Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Designer, you will assist in defining requirements and designing applications to meet business process and application requirements. Your typical day will involve collaborating with various stakeholders to gather insights, analyzing user needs, and translating them into functional specifications. You will en...

About The Role Project Role : Application Support Engineer Project Role Description : Act as software detectives, provide a dynamic service identifying and solving issues within multiple components of critical business systems. Must have skills : Hadoop Administration Good to have skills : PySpark Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Support Engineer, you will act as software detectives, providing a dynamic service that identifies and resolves issues within various components of critical business systems. Your typical day will involve collaborating with team members to troubleshoot problems, analyzing ...

About The Role Project Role : Application Designer Project Role Description : Assist in defining requirements and designing applications to meet business process and application requirements. Must have skills : Alteryx Good to have skills : Hadoop Administration Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Designer, you will assist in defining requirements and designing applications to meet business process and application requirements. Your typical day will involve collaborating with various stakeholders to gather insights, analyzing user needs, and translating them into functional specifications. You will en...

Looking to onboard a skilled Hadoop Admin with 5-12 years of experience to join our team in Bangalore. The ideal candidate will have a strong background in Big Data technologies and programming languages such as Python, Scala. Roles and Responsibility Design, develop, and implement scalable data processing systems using Hadoop and Spark. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data pipelines and architectures. Troubleshoot and resolve complex technical issues related to data processing and storage. Ensure high availability and performance of data systems and applications. Participate in code reviews and contrib...

Job Title: Hadoop Administrator Experience : 3 - 6 years in Systems Administration with at least the last 3 years in Hadoop Cluster Administration in Cloudera or Horton Works Shifts : 24*7 (Rotational Shift) Mode : Onsite Location : Chennai, India Department : IT Infrastructure and Operations Company : Smart Analytica is niche Data and AI company. Based in Pune, we are pioneers in data-driven innovation, transforming enterprise data into strategic insights. Established in 2017, our team has experience in handling large datasets up to 20 PBs in a single implementation, delivering many successful data and AI projects across major industries, including retail, finance, telecom, manufacturing, i...

Job Title: Hadoop Administrator Lead Experience : 6 -12 years in Systems Administration with at least the last 3 years in Hadoop Cluster Administration in Cloudera or Horton Works Shifts : 24*7 (Rotational Shift) Mode : Onsite Location : Chennai, India Department : IT Infrastructure and Operations Company : Smart Analytica Private limited is niche Data and AI company. Based in Pune, we are pioneers in data-driven innovation, transforming enterprise data into strategic insights. Established in 2017, our team has experience in handling large datasets up to 20 PBs in a single implementation, delivering many successful data and AI projects across major industries, including retail, finance, tele...