Databricks Architect

Role Overview: As a highly skilled Databricks Architect, your role is crucial in designing and optimizing large-scale data platforms. Your expertise in Databricks features such as Delta Lake, Unity Catalog, and Databricks SQL, along with strong experience in Azure Data Factory, will be instrumental in ensuring governance, security compliance, and driving innovation in advanced analytics and machine learning workflows. Your problem-solving skills and hands-on experience in performance optimization will be key in managing large-scale data pipelines effectively. Key Responsibilities: - Design and implement scalable, secure data architectures using Databricks and Azure Data Factory - Develop frameworks for data ingestion, transformation, and analytics utilizing Delta Lake, Unity Catalog, and Databricks SQL - Optimize Spark jobs, SQL queries, and pipelines for enhanced performance and cost efficiency - Collaborate with data engineers, analysts, and business stakeholders to deliver robust solutions - Implement governance, security, and compliance standards, including RBAC and data lineage - Translate strategic business objectives into enterprise-wide data architecture solutions - Align data architecture with organizational priorities to support analytics, reporting, and advanced use cases - Guide cross-functional teams in adopting architectural patterns and best practices - Lead the selection of appropriate data platforms, tools, and frameworks - Champion the adoption of DataOps practices for faster, automated, and high-quality data delivery - Support presales and solution design activities, participate in client engagement, and develop high-level architecture overviews for client proposals Qualifications Required: - 8+ years of extensive knowledge of Databricks features: Delta Lake, Unity Catalog, Databricks SQL, MLflow - Strong experience with Azure Data Factory for orchestration and integration - Hands-on expertise in performance optimization and writing complex SQL queries - Solid understanding of cloud architecture, security, and governance best practices - Databricks Certified Data Engineer or Architect certification - Microsoft Azure certifications (e.g., Azure Data Engineer Associate) - Strong analytical and problem-solving abilities - Excellent communication and stakeholder management skills - Ability to lead and mentor technical teams (Note: The job description did not include any additional details about the company),