Azure Data Engineer (C2H)

A strong Azure Data Engineer with deep hands-on experience in Databricks, ADF, Spark, and Azure storage/DevOps, capable of designing and deploying large-scale data solutions in an Agile cloud environment, with bonus skills in Kafka and ETL tools.

Responsibilities:

• Spark (Scala/Python), Azure , Databricks, Kafka
• High proficiency and 6 to10 years of experience in designing/developing data analytics and data warehouse solutions with azure data factory (ADF) and azure data bricks.
• Experience in designing large data distribution, integration with service-oriented architecture and/or data warehouse solutions, data lake solution using azure data bricks with large and multi-format data.
• Ability to translate working solution into implementable working package using azure platform.
• Good understanding on azure storage Gen2
• Hands on experience with azure stack (minimum 5 years) and azure DevOps
• Proficient coding experience using spark (Scala/Python), T-SQL
• Understanding around the services related to azure analytics, azure SQL, azure function app, logic app
• Prior ETL development experience using industry tool e.g. informatica/SSIS/Talend etc
• Good to have knowledge in Kafka streaming azure infrastructure.
• Proven track record of work experience in cloud deployments (MS azure preferred) in an agile SDLC environment, leveraging modern programming languages, DevOps, SQL and NoSQL databases, and test-driven development.