Your future duties and responsibilities
Azure Databricks Engineer will be in charge of designing, building, deploying, and maintaining data-driven solutions that meet organizations business needs. Experience range 4 to 8 years
Expected Skills . Strong experience in Azure Functions, Azure Data Factory, Azure Sql, Azure Key Vault . Strong Experience in Azure Data Bricks, Notebooks, ADLS, Delta Lake . Experience in building data pipelines and analysis tools using Python, PySpark, Scala, SQL . Proficient in integrating, transforming, and consolidating data from various structured and unstructured data. . Knowledge on Autosys jobs, Batch scripts . Hands on experience in using Agile methodology, Azure DevOps(CI/CD Pipeline) . Knowledge on Streaming platforms (Kafka, Solace queue), Azure App Services, Azure Stream Analytics, Power BI . Knowledge on Ability to work independently as well as in a team Roles & Responsibilities . Design and implement storage solutions using Azure services such as Azure SQL and Azure Data Lake Storage. . Design and implement ETL using ADF data pipelines to move and transform data from various sources into cloud-based data warehouses . Implement business solution using Azure DataBricks. . Align with DevOps strategy to promote the code to Production. . Think out of the solution to create reusable Databricks components . Should have working experience in migration and modernization projects . Involve in due diligence phases to transform the requirements to implementation . Good communication skills
Required qualifications to be successful in this role
Skill ABD, ADL, Pyspark
Exp 4 to 8 Yrs
Skills
- Azure Data Factory
- Azure Data Lake
- Azure Functions
- Azure Key Vault
- Python