Azure Data Engineer

Job Description

Hands-on programming experience using ADLS, ADF, Azure Functions, Azure SQL • Must have exp on implementing CI/CD for ADLS, ADF, Azure Functions • Azure storage options - Azure Data Lake Storage, Azure Blob Storage, Azure VM • Azure data factory - ADF Components & Basic Terminology, Azure Portal Basics & ADF Creation, Basic Pipelines, Triggers, Copy Activity, Data Transformation, Components and Mappings with DataFlows, Linked Services, Datasets, Parametrization, Integration with Different Sources, Security, Debugging and Troubleshooting • Azure Git Configurations • Must have exp on either python/pyscript • Ability to read architecture diagrams, data models, data flows • Database design and development SQL , Stored Procedures, Performance tuning, DB design & optimization • Good to have Snowflake experience. • Experience using Azure DevOps, GitHub, Visual Studio or equivalent • Emphasis on code quality, integration testing, performance testing and tuning • Hands on developing and system validation and testing of data pipelines, flows and services • Development of technical system and process documentation • Analyzing data to effectively coordinate the installation of new or the modification of existing data • Managing the data pipelines through software development lifecycle. • Monitoring data process performance post deployment until transitioned to operations • Communicating key project data to team members and building cohesion among teams. • Developing and executing project plans. 7+ years 15 days max hybrid-hyderabad