Databricks Engineer

Role:

Notice Period:

Location:

Work Mode:

Position Overview:

Qualifications:

• 3-5 years of experience as a Data Engineer with a strong focus on Databricks & Azure Data Factory.
• Proven experience with data warehousing concepts and best practices.
• Strong SQL skills, ability to perform effective querying involving multiple tables and subqueries.
• Strong understanding of data modeling and data quality principles.
• Strong communication & collaboration skills, should be able to work closely with customer driving technical conversations.
• Experience with Agile development methodologies.
• Ability to work independently and as part of a team.
• Ability to lead team and drive through technical challenges and solutions. Drive technical calls with customer
• Experience with any other ETL tool (Talend, Informatica)
• Hands-on experience with Databricks features such as delta lake, clusters, notebooks, jobs, and workspaces.
• Design, develop, and deploy data pipelines using Databricks, including data ingestion, transformation, and loading (ETL) processes.
• Develop and maintain high-quality, scalable, and maintainable Databricks notebooks using Python.
• Work with Delta Lake and other advanced features.
• Leverage Unity Catalog for data governance, access control, and data discovery.
• Experience working with Parquet files & Delta files for data storage and processing.
• Integrate with various data sources, including but not limited to databases and cloud storage (Azure Blob Storage, ADLS, Synapse), and APIs.
• Perform data quality checks and validation to ensure data accuracy and integrity.
• Strong working Knowledge and experience in Microsoft Azure, Azure Data Factory, Synapse Analytics, Azure SQL, Data Pipelining, Data Transformation, ETL, copy activity, custom Azure development.
• Develop and optimize data pipelines for performance and cost-effectiveness.
• Sound skills and hands on experience with Azure Data Lake, SQL Data Warehouse Azure Blob, Azure Storage Explorer
• Sound knowledge on Azure DevOps, CICD Processes, Release Processes.
• Sound Knowledge of Azure Data Catalog, Event Grid, Service Bus, SQL and Synapse
• Troubleshoot and resolve data pipeline issues effectively.

Interested candidates share your updated resume at "Shruti.Wanjari@bitwiseglobal.com"