Databricks Architect

JOB DESCRIPTION:

Key Skills:

SQL, ETL Tools, Reporting Tools

Key Requirements:

The day-to-day development activities will need knowledge of the below concepts.

 Expert-level knowledge in RDBMS (SQL Server) with clear understanding of

SQL query writing, object creation and management and performance and

optimisation of DB/DWH operations.

 Good understanding of Transactional and Dimensional Data Modelling, Star

Schema, Facts/Dimensions, Relationships

 Good understanding of ETL concepts and exposure to tools such as Azure

Data Factory, Azure Databricks, Airflow.

 In-depth expertise in Azure Data Factory and Databricks, including building

scalable data pipelines, orchestrating complex workflows, implementing

dynamic and parameterized pipelines, and optimizing Spark-based data

transformations for large-scale integrations.

 Hands-on experience with Databricks Unity Catalog for centralized data

governance, fine-grained access control, auditing, and managing data assets

securely across multiple workspaces.

 Should have worked on at least 1 development lifecycle of one of the below:

 End-to-end ETL project (Involving above mentioned ETL tools)

 Ability to write and review test cases, test code and validate code.

 Good understanding of SDLC practices like source control, version

management, usage of Azure Devops and CI/CD practices.

Project context:

 Should have the skill to fully understand the context and use-case of a project

and have a personal vision for it – Play the role of interfacing with customer

directly on a daily basis.

 Should be able to converse with functional users and convert requirements

into tangible processes/models and documentation in available templates.

 Should be able to provide consultative options to customer on best way to

execute projects

 Should have a good understanding of project dynamics – scoping, setting

estimates, setting timelines, working around timelines in case of exceptions,

etc.

Preferred skills:

 Knowledge of Python is a bonus

 Knowledge of SSIS is a bonus

 Knowledge of Azure Devops, Source Control/Repos is good to have.

Job Types: Contractual / Temporary, Freelance
Contract length: 3 months

Work Location: In person