Cloud Platform Administrator

As a Cloud Platform Administrator, your primary role will involve managing and optimizing a cloud-based environment to ensure smooth operations. Your key responsibilities will include: - User & Access Management: - Creating users, setting roles, and managing access controls. - Cluster & Resource Management: - Provisioning clusters, monitoring resource usage, and optimizing performance. - Job Management: - Scheduling, managing, and optimizing jobs and workflows. - Monitoring & Troubleshooting: - Monitoring system performance and troubleshooting any issues that arise. - Platform Maintenance: - Managing updates, backups, integrations, and disaster recovery. - Collaboration: - Working closely with data teams and cloud administrators to optimize and maintain the environment. - Cost Optimization: - Monitoring resource usage and implementing cost-control measures. Qualifications required for this role include expertise in the following technical areas: - Cloud platform expertise (AWS, Azure, GCP) with familiarity across major cloud providers. - Databricks-specific admin experience including managing workspaces, clusters, jobs, and libraries. - Understanding of data security and governance, especially within Databricks, including security features and encryption. - Security and compliance management with knowledge of access control and monitoring for security auditing. - Experience with Apache Spark and data engineering, including familiarity with Delta Lake and data pipelines. - Automation and scripting skills in Python, Scala, and SQL for managing tasks and interacting with APIs. - Monitoring, troubleshooting, and performance optimization, including debugging Spark jobs and resolving common issues. - Collaboration and communication skills to effectively work with various teams and stakeholders. In addition to the above, problem-solving skills, adaptability to evolving technologies, and the ability to explain technical concepts to non-technical stakeholders are essential for success in this role. As a Cloud Platform Administrator, your primary role will involve managing and optimizing a cloud-based environment to ensure smooth operations. Your key responsibilities will include: - User & Access Management: - Creating users, setting roles, and managing access controls. - Cluster & Resource Management: - Provisioning clusters, monitoring resource usage, and optimizing performance. - Job Management: - Scheduling, managing, and optimizing jobs and workflows. - Monitoring & Troubleshooting: - Monitoring system performance and troubleshooting any issues that arise. - Platform Maintenance: - Managing updates, backups, integrations, and disaster recovery. - Collaboration: - Working closely with data teams and cloud administrators to optimize and maintain the environment. - Cost Optimization: - Monitoring resource usage and implementing cost-control measures. Qualifications required for this role include expertise in the following technical areas: - Cloud platform expertise (AWS, Azure, GCP) with familiarity across major cloud providers. - Databricks-specific admin experience including managing workspaces, clusters, jobs, and libraries. - Understanding of data security and governance, especially within Databricks, including security features and encryption. - Security and compliance management with knowledge of access control and monitoring for security auditing. - Experience with Apache Spark and data engineering, including familiarity with Delta Lake and data pipelines. - Automation and scripting skills in Python, Scala, and SQL for managing tasks and interacting with APIs. - Monitoring, troubleshooting, and performance optimization, including debugging Spark jobs and resolving common issues. - Collaboration and communication skills to effectively work with various teams and stakeholders. In addition to the above, problem-solving skills, adaptability to evolving technologies, and the ability to explain technical concepts to non-technical stakeholders are essential for success in this role.