JD-Cloudera Professionals

Look for 5-8 years relevant experience profiles.

Key Responsibilities: Cloudera Cluster Management: Install, configure, manage, and monitor Cloudera Hadoop clusters, ensuring high availability, performance, and security. This includes managing HDFS, Hive, Hue, Knox, Ranger, Solr, Spark, Tez, YARN, Zookeeper and other ecosystem components. Performance Optimization: Tune Hadoop, Hive, and Spark jobs and configurations for optimal performance, efficiency, and resource utilization. This includes optimizing queries, managing partitions, and leveraging in-memory capabilities. Troubleshooting and Support: Diagnose and resolve issues related to Linux servers, networks, cluster health, job failures, and performance bottlenecks. Work closely with Cloudera Vendor to manage software releases, perform upgrades, and remediate vulnerabilities. Provide on-call support and collaborate with cross functional teams to ensure smooth operations. Security and Governance: Implement and manage security measures within the Cloudera environment, including Kerberos, Apache Ranger, and Atlas, to ensure data governance and compliance.

Data and Application Migration: Migrate Hadoop, Hive and Spark Data and applications to Azure cloud services. Ensure data integrity, performance tuning, and validation.

Automation and Scripting: Develop scripts (e.g., shell, Ansible, Python) for automating administrative tasks, deployments, and monitoring. Work with users to develop, debug, optimize Hive/Spark/Python programs that connect to the Cloudera environment. Documentation:

Create and maintain documentation for system configurations, operational procedures, and troubleshooting knowledge bases. Required Skills and Experience:

Strong experience with Cloudera Hadoop distribution. Expertise in Hive and Spark for data processing and analytics. Expertise in Hadoop ecosystem components like HDFS, YARN, Hive, Spark, and Sqoop. Expertise in Linux, Network, Ansible, DNS, Kerberos, LDAP/AD, MySQL, PostgreSQL, Jupyterhub. Expertise in Linux shell scripts, Ansible, Python, C/C++, Java. Working knowledge of Microsoft Azure cloud and big data migration to cloud. Strong problem-solving, analytical, and communication skills.