Databricks Engineer

Must have skills:

• Hands-on experience with Databricks platform, including Delta Lake/ Lakehouse architecture
• Person should be familiar with Python / Pyspark code (not needed a developer)
• Knowledge of data structures, data modeling, ETL/ELT, and data warehousing.
• SQL basic in data querying and troubleshooting / manipulation.

Key asks for the role:

• We need a candidate who can drive high-level design and solutioning based on established patterns. The person will collaborate closely with Solution Architect team.
• At this level, the candidate will not be working as a full-time developer but should be familiar with Python code and able to perform code reviews, debugging, and mentoring of junior developers.
• Hands-on experience with Databricks and its implementation is required. The candidate should also have a strong understanding of Delta Lake/Lakehouse architecture, including underlying storage and related aspects.
• Databricks offers data, analytics, and AI/ML capabilities, but we are primarily looking for expertise in Databricks data engineering and related functionalities. ML experience will be considered an added advantage.
• SQL: The candidate should be able to write efficient SQL queries and troubleshoot issues effectively.

Good to have skills:

• Expertise in Azure (Data Factory, Data Lake Storage).
• Proficient in Git/Azure DevOps & CI/CD.
• Knowledge of data governance, quality & security.
• Experience in data warehousing, dimensional modelling & scalable solutions.