Azure Data Engineer

Hello Everyone,

Optum

We are seeking a highly skilled and experienced Software Engineering Lead to join our team for a Cloud Data Modernization project. The successful candidate will be responsible for managing and leading the migration of an on-premises Enterprise Data Warehouse (SQLServer) to a modern cloud-based data platform utilizing Azure Cloud data tools and Snowflake. This platform will enable offshore (non-US) resources to build and develop Reporting, Analytics, and Data Science solutions.

: Azure Data Engineering, Snowflake, Azure Data Factory, Azure Databricks, GitHub Actions, Python, DevOps, Azure Cloud, SQL

: 7+ yrs

: Bangalore

Primary Responsibilities:

• Manage and lead the migration of the on-premises SQLServer Enterprise Data Warehouse to Azure Cloud and Snowflake
• Design, develop, and implement data platform solutions using Azure Data Factory (ADF), Self-hosted Integration Runtime (SHIR), Logic Apps, Azure Data Lake Storage Gen2 (ADLS Gen2), Blob Storage, Databricks, and Snowflake
• Manage and guide the development of cloud-native ETLs and data pipelines using modern technologies on Azure Cloud, Databricks, and Snowflake
• Implement and oversee DevOps practices and CI/CD pipelines using GitActions
• Collaborate with cross-functional teams to ensure seamless integration and data flow
• Optimize and troubleshoot data pipelines and workflows
• Ensure data security and compliance with industry standards
• Provide technical leadership and mentorship to the engineering team

Required Qualifications:

• 8+ years of experience in a Cloud Data Engineering role, with 3+ years in a leadership or technical delivery role
• Hands-on experience with Azure Cloud data tools (ADF, SHIR, Logic Apps, ADLS Gen2, Blob Storage), Databricks, and Snowflake
• Experience with Python or other scripting languages for data processing
• Experience with Agile methodologies and project management tools
• Solid experience in developing cloud-native ETLs and data pipelines using modern technologies on Azure Cloud, Databricks, and Snowflake
• Proficiency in DevOps and CI/CD practices using GitActions
• Proven excellent problem-solving skills and ability to work independently
• Proven solid communication and collaboration skills. Solid analytical skills and attention to detail
• Proven track record of successful project delivery in a cloud environment

Preferred Qualifications:

• Certification in Azure or Snowflake
• Experience working with automated ETL conversion tools used during cloud migrations (SnowConvert, BladeBridge, etc.)
• Experience with data modeling and database design
• Knowledge of data governance and data quality best practices
• Familiarity with other cloud platforms (e.g., AWS, Google Cloud)

arshad_mohammad@optum.com

Thanks and Regards,

Arshad Ayub - Talent Scout

Deputy Manager

arshad_mohammad@optum.com

Optum