Sr Data Engineer

You are a skilled data engineering professional with over 5 years of experience in designing and implementing end-to-end ETL solutions using Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Databricks, and SSIS. Your strong proficiency in SQL, REST API integration, and automation through CI/CD pipelines using Azure DevOps and Git is essential. Additionally, you have a solid understanding of maintaining and optimizing data pipelines, warehouses, and reporting within the Microsoft SQL stack. As a Senior Data Engineer, your responsibilities include designing and implementing comprehensive data solutions using Microsoft Azure Data Factory (ADF) and Azure Data Lake Storage (ADLS), Azure Databricks, and SSIS. You will develop complex transformation logic using SQL Server, SSIS, and ADF, and create ETL Jobs/Pipelines to execute those mappings concurrently. Your role also involves maintaining and enhancing existing ETL Pipelines, Warehouses, and Reporting leveraging traditional MS SQL Stack. You must have a deep understanding of REST API principles and the ability to create ADF pipelines to handle HTTP requests for APIs. Proficiency in best practices for development and deployment of SSIS packages, SQL jobs, and ADF pipelines is crucial. Your responsibilities also include implementing and managing source control practices using GIT within Azure DevOps to ensure code integrity and facilitate collaboration. Furthermore, you will participate in the development and maintenance of CI/CD pipelines for automated testing and deployment of BI solutions. Preferred skills for this role include an understanding of the Azure environment and experience in developing Azure Logic Apps and Azure Function Apps. Knowledge of code deployment, GIT, CI/CD, and deployment of developed ETL code (SSIS, ADF) would be advantageous, but not mandatory. This position is based in Ahmedabad/Pune and requires a candidate with a BS/MS in Computer Science or other engineering/technical degree.,