Databricks (DLT, Unity Catalog, Workflows, SQL Warehouse)

Detailed JD (Roles and Responsibilities)

1. Lead the design and implementation of advanced data solutions on Databricks.
2. Architect scalable, secure, and efficient data platforms using Spark, Python, and SQL.
3. Optimize ETL processes and data workflows for performance and reliability.
4. Collaborate with data engineers, data scientists, and business stakeholders to understand requirements and deliver robust solutions.
5. Set up and manage CI/CD pipelines and enforce data governance standards.
6. Monitor and troubleshoot data pipelines to ensure data quality and integrity.
7. Mentor junior team members and foster a culture of continuous learning.
8. Stay updated with emerging technologies and promote innovation in data practices.

Total Experience

8 years

Relevant Experience

5 years

Mandatory skills

Deep expertise in Databricks (DLT, Unity Catalog, Workflows, SQL Warehouse).

Strong programming skills in Python, PySpark, and SQL.

Experience with cloud platforms (AWS, Azure, GCP).

Familiarity with data governance, security policies (RBAC), and performance tuning.

Excellent problem-solving, communication, and leadership skills.

Domain (Industry)

MFG