Hadoop Administrator

What you will be doing:

• Service Management: Administer, configure, and maintain Hadoop ecosystem services within both Cloudera Data Platform (CDP) and Cloudera Distributed Hadoop (CDH), including HDFS, YARN, Hive, Spark, Ranger, Sentry, Kerberos security, KMS, KTS, Zookeeper, and more.
• Job Scheduling and Workflow Management: Utilize Oozie, Zena, Airflow to schedule and orchestrate complex data jobs and workflows, meeting business requirements efficiently. This includes day-end SLA jobs to ensure timely data processing.
• Security and Access Control: Manage security measures such as Kerberos authentication, safeguarding Hadoop clusters and data in both CDP and CDH environments. Implement and maintain role-based access control (RBAC) policies in Ranger and Sentry.
• Job Monitoring and Tuning: Set up robust monitoring systems, including advanced tools like Unravel, to track cluster health, job execution, and resource utilization in both CDP and CDH environments. Continuously fine-tune configurations for optimized performance.
• Issue Resolution and Troubleshooting: Identify and troubleshoot issues related to job failures, data processing, and cluster performance in both CDP and CDH environments. Develop and implement solutions to mitigate recurring problems.
• Cross-Functional Collaboration: Act as a bridge between technical teams, including application support, development, and scheduling. Facilitate effective communication to understand and address their requirements and issues.

What you will need:

• 7 to 12 Years of experience as a Hadoop Administrator and Big Data Engineer, with expertise in managing a wide range of Hadoop ecosystem services across CDP and CDH environments, including day-end SLA jobs.
• Deep understanding of security practices, including Kerberos, Ranger, and Sentry, in both CDP and CDH.
• Proficiency in job scheduling and orchestration using Zena, Oozie, and Airflow across both environments.
• Strong scripting skills (e.g., Bash, Python) and experience with automation frameworks.
• Excellent problem-solving and troubleshooting abilities.
• Familiarity with advanced monitoring tools like Unravel.
• Relevant certifications (e.g., Cloudera Certified Administrator, AWS Certified Big Data) are advantageous.

Added bonus if you have:

• End to End automation integration know-how.
• Multi Cloud knowledge (Hands on Experience) .