ADF Engineer

You are an experienced Data Engineering expert with a focus on Azure Data Factory (ADF). In this role, you will be responsible for designing and implementing end-to-end data solutions using ADF. Your primary tasks will include collaborating with stakeholders to gather requirements and develop robust pipelines that support analytics and business insights. Your key responsibilities will involve designing and implementing complex data pipelines within Azure Data Factory. You will work on integrating data from various sources such as on-prem databases, APIs, and cloud storage. Additionally, you will develop ETL/ELT strategies to manage both structured and unstructured data effectively. Supporting data transformation, cleansing, and enrichment processes will also be a part of your role. Furthermore, you will be required to implement logging, alerting, and monitoring mechanisms for ADF pipelines. Collaboration with architects and business analysts to comprehend data requirements will be crucial. Writing and optimizing complex SQL queries for performance optimization will also be an essential aspect of your responsibilities. To excel in this role, you should possess strong hands-on experience with ADF, specifically in pipeline orchestration and data flows. Experience with Azure Data Lake, Azure Synapse Analytics, and Blob Storage will be beneficial. Proficiency in SQL and performance tuning is a must. Additionally, knowledge of Azure DevOps and CI/CD practices, along with a good understanding of DataOps and Agile environments, will be advantageous. If you meet these qualifications and are excited about this opportunity, please share your resume with us at karthicc@nallas.com. We look forward to potentially working with you in Coimbatore in this hybrid role that offers a stimulating environment for your Data Engineering expertise.,