We are currently seeking a Cloudera Solution Specialist to join our team in Bangalore, Karntaka (IN-KA), India (IN).
Job Duties: Key Responsibilities:
- Develop and articulate long-term strategic goals for data architecture vision and establish data standards for enterprise systems.
- Utilize various cloud technologies, including Azure, AWS, GCP, and data platforms like Databricks and Snowflake.
- Conceptualize and create an end-to-end vision outlining the seamless flow of data through successive stages.
- Institute processes for governing the identification, collection, and utilization of corporate metadata, ensuring accuracy and validity.
- Implement methods and procedures for tracking data quality, completeness, redundancy, compliance, and continuous improvement.
- Evaluate and determine governance, stewardship, and frameworks for effective data management across the enterprise.
- Develop comprehensive strategies and plans for data capacity planning, data security, life cycle data management, scalability, backup, disaster recovery, business continuity, and archiving.
- Identify potential areas for policy and procedure enhancements, initiating changes where required for optimal data management.
- Formulate and maintain data models and establish policies and procedures for functional design.
- Offer technical recommendations to senior managers and technical staff in the development and implementation of databases and documentation.
- Stay informed about upgrades and emerging database technologies through continuous research.
- Collaborate with project managers and business leaders on all projects involving enterprise data.
- Document the data architecture and environment to ensure a current and accurate understanding of the overall data landscape.
- Design and implement data solutions tailored to meet customer needs and specific use cases.
- Provide thought leadership by recommending the most suitable technologies and solutions for various use cases, spanning from the application layer to infrastructure.
Basic Qualifications:
- 8+ years of hands-on experience with various database technologies (insert examples).
- 6+ years of experience with Cloud-based systems and Enterprise Data Architecture, driving end-to end technology solutions.
- Ability to travel at least 25%.
Preferred Skills:
- Possess certifications in AWS, Azure, and GCP to complement extensive hands-on experience.
- Demonstrated expertise with certifications in Snowflake.
- Valuable ""Big 4"" Management Consulting experience or exposure to multiple industries.
- Undergraduate or graduate degree preferred.
- Minimum Skills Required: Key Responsibilities:
- Cloudera Cluster Management:
Install, configure, manage, and monitor Cloudera Hadoop clusters, ensuring high availability, performance, and security. This includes managing HDFS, Hive, Hue, Knox, Ranger, Solr, Spark, Tez, YARN, Zookeeper and other ecosystem components. - Performance Optimization:
Tune Hadoop, Hive, and Spark jobs and configurations for optimal performance, efficiency, and resource utilization. This includes optimizing queries, managing partitions, and leveraging in-memory capabilities. - Troubleshooting and Support:
Diagnose and resolve issues related to Linux servers, networks, cluster health, job failures, and performance bottlenecks. Work closely with Cloudera Vendor to manage software releases, perform upgrades, and remediate vulnerabilities. Provide on-call support and collaborate with cross functional teams to ensure smooth operations. - Security and Governance:
Implement and manage security measures within the Cloudera environment, including Kerberos, Apache Ranger, and Atlas, to ensure data governance and compliance. - Data and Application Migration:
Migrate Hadoop, Hive and Spark Data and applications to Azure cloud services. Ensure data integrity, performance tuning, and validation. - Automation and Scripting:
Develop scripts (e.g., shell, Ansible, Python) for automating administrative tasks, deployments, and monitoring. Work with users to develop, debug, optimize Hive/Spark/Python"
