Databricks Architect

JD Celebal Technologies Databricks

1. Lead various impactful technical projects for customers, including designing reference architectures, developing technical "how-to" guides, and productionalizing customer use cases.
2. Work with engagement managers to scope and define the professional services work based on customer input and business needs.
3. Guide strategic customers through transformational big data and AI projects, as well as migrations from 3rd party platforms, delivering full end-to-end design, build, and deployment.
4. Provide expert consulting on architecture and design; help bootstrap or implement projects, driving the customer's understanding, evaluation, and adoption of Databricks.
5. Deliver escalated support for operational issues faced by customers.
6. Collaborate with Databricks' Technical, Project Manager, Architect, and Customer teams to ensure technical components of projects meet client requirements.
7. Work closely with Engineering and Databricks Customer Support to provide feedback on product and resolve any product or support issues that arise during engagements.

Qualifications:

1. 6+ years of experience in data engineering, data platforms, and analytics.
2. Proficiency in programming languages such as Python or Scala.
3. Strong working knowledge of cloud ecosystems (AWS, Azure, GCP) with deep expertise.
4. Extensive experience with distributed computing using Apache Spark and a solid understanding of Spark runtime internals.
5. Familiarity with CI/CD practices for production deployments.
6. Working knowledge of MLOps methodologies.
7. Proven experience in designing and deploying performant, end-to-end data architectures.
8. Experience managing technical project delivery, including scope and timelines.
9. Excellent documentation, whiteboarding, and communication skills.
10. Proven ability to handle client engagements and resolve conflicts.
11. Experience developing technical skills to support the deployment and integration of Databricks-based solutions.
12. Bachelors degree in Computer Science, Information Systems, Engineering, or equivalent work experience.