Databricks Architect

As a Databricks Architect with 5-8 years of experience, you will be responsible for designing, implementing, and optimizing scalable data architectures leveraging Databricks on public cloud platforms. Your role will involve designing enterprise-grade solutions for batch and real-time data analytics, with hands-on expertise in Databricks, Spark, and cloud-based data services. Your key responsibilities will include designing and developing end-to-end data architectures and pipelines with Databricks, optimizing Databricks performance through efficient data processing, job tuning, and resource management, implementing data security, governance, and best practices, collaborating with stakeholders to deliver integrated data solutions, monitoring the health of the Databricks environment, documenting architectures, and staying current with Databricks and cloud technology best practices. In terms of technical skills, you should have advanced hands-on experience with Databricks deployment, configuration, and administration, expertise in Apache Spark, proficiency in Python and SQL, experience with cloud platforms such as Azure, AWS, or GCP, knowledge of data modeling, exposure to big data tools, familiarity with BI tools, and a strong understanding of data security in cloud environments. To qualify for this role, you should have a bachelor's or master's degree in computer science or a related field, 5-8 years of overall experience in data engineering or architecture, with at least 4+ years working with Databricks and Spark at scale, experience in optimizing and maintaining large data workflows in cloud environments, excellent analytical and communication skills, and preferably a Databricks certification. Desirable attributes for this role include demonstrated leadership abilities, experience in agile development environments, and consulting or customer-facing experience.,