Databricks Platform Architect

As a Platform Engineering Admin, your role involves managing the AWS infrastructure and Databricks platform to ensure stability, performance, and security in cloud and big data environments. Key Responsibilities: - Manage and maintain AWS cloud infrastructure for high availability, performance, and cost-efficiency - Administer and monitor Databricks environment including cluster management, user access, job scheduling, and performance optimization - Collaborate with data engineering and DevOps teams for supporting CI/CD pipelines, automation, and infrastructure as code - Implement and manage platform-level security, compliance, and governance best practices - Troubleshoot platform issues, perform root cause analysis, and implement preventative measures - Create and maintain documentation for platform configurations, processes, and best practices - Support onboarding of new users, access management, and training on platform usage - Monitor resource usage and optimize performance and cost through right-sizing and usage policies Qualification Required: - Strong hands-on experience with AWS services (EC2, S3, IAM, CloudWatch, VPC, etc.) - Familiarity with Databricks features and proven experience in Databricks administration - Proficiency in scripting languages (Python, Bash, etc.) for automation - Knowledge of Terraform, CloudFormation, or similar IaC tools - Understanding of networking, security, and DevOps practices - Ability to perform POCs and validate security aspects for usage - Strong problem-solving skills and ability to work independently - Excellent communication and documentation skills Additional Details: - Good to have AWS certification (Solutions Architect / SysOps Admin) - Experience with other data platforms like Snowflake, Azure Data Factory - Knowledge of monitoring and alerting tools such as Datadog, Prometheus,