Senior Azure Data Engineer

Roles & Responsibilities:

• Design, develop, and maintain scalable ETL pipelines using Azure Data Factory (ADF).
• Architect and implement data integration solutions using Azure services such as Storage Accounts, Functions, Logic Apps, VMs, and Key Vault.
• Develop robust and optimized SQL queries and stored procedures for data transformation and reporting.
• Build and maintain Python-based data processing scripts for advanced ETL logic and automation.
• Implement CI/CD pipelines using Azure DevOps (ADO) and/or Git for automated deployment and version control.
• Design and develop shell scripts for automation and orchestration tasks.
• Handle large-scale data files and implement change data capture (CDC) and delta processing strategies.
• Schedule and monitor jobs using Azure-native or third-party scheduling tools.
• Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
• Must be a strong team player and promote team collaboration / activities in the team
• Be an active participant and a positive player in all initiatives or tasks.
• Collaborate with team(s) and with leadership on project status, updates, risks, gaps or feedback on all initiatives or tasks.

Required Skills:

• Combined minimum of 5 years' higher education and/or operational/business analytics experience
• 3+ years of experience working on Azure Data, SQL and ETL technologies
• ETL Design & Development: Strong experience in building and optimizing ETL pipelines.
• Azure Data Factory (ADF): Expert-level proficiency.
• Python: Strong development experience in scripting and automation.
• SQL: Expert-level skills in query design, performance tuning, and data modeling.
• CI/CD: Strong experience with Azure DevOps and Git-based deployment workflows.
• Shell Scripting: Good understanding and practical experience.
• Azure Services: Hands-on experience with Storage, Functions, Logic Apps, VMs, Key Vault.
• Data Processing: Experience with large files and delta/change data processing.
• Should have working experience and good understanding of Agile and SCRUM methodologies
• Should be able to document, present and share design / solution options., technical artifacts to the team
• Excellent communication and collaboration abilities.
• Strong analytical and problem-solving skills.
• Proactive, Results-driven and Detail-oriented.
• Ability to multitask for various components of moderately complex to complex projects.
• Excellent problem-solving skills to assist in issue resolution and general queries.