Databricks Architect

Job Title:

Experience:

Job Summary:

Databricks Architect

Key Responsibilities:

• Design and implement scalable data solutions on 

  Databricks

   for large-scale analytics and ETL pipelines.
• Collaborate with data engineers, data scientists, and business stakeholders to gather requirements and deliver high-quality solutions.
• Architect and optimize 

  Apache Spark

   workloads for performance, cost, and reliability.
• Ensure best practices in 

  data modeling, governance, security, and compliance

  .
• Provide technical leadership and mentorship to development teams.
• Evaluate and recommend tools, technologies, and frameworks for the organization’s big data ecosystem.
• Troubleshoot and resolve complex issues in production environments.
• Develop documentation, runbooks, and guidelines for Databricks implementation and usage.

Required Skills & Qualifications:

• Strong experience in 

  Databricks

  , 

  Apache Spark

  , 

  Delta Lake

  , and 

  Spark SQL

  .
• Hands-on expertise in 

  cloud platforms

   such as AWS, Azure, or GCP.
• Proficiency in 

  Python, Scala, or Java

   for Spark applications.
• Solid experience in 

  data warehousing, ETL processes, and big data architectures

  .
• Understanding of 

  CI/CD pipelines, DevOps practices, and version control

  .
• Strong problem-solving, analytical, and communication skills.
• Experience with 

  data governance, security, and compliance standards

  .

Preferred Qualifications:

• Knowledge of 

  streaming data processing

   (e.g., Structured Streaming, Kafka).
• Experience with 

  BI tools

   such as Tableau, Power BI, or Looker.
• Familiarity with 

  machine learning workflows

   on Databricks.

Soft Skills:

• Excellent communication and stakeholder management.
• Ability to work independently and collaboratively in a fast-paced environment.
• Strong mentoring and leadership capabilities.