Data Engineer

Roles and Responsibilities : Design, develop, test, deploy, and maintain large-scale data pipelines using Azure Data Factory (ADF) to integrate various data sources into a centralized platform. Collaborate with cross-functional teams to gather requirements for data integrations and ensure seamless delivery of high-quality solutions. Develop complex SQL queries to extract insights from large datasets stored in relational databases such as PostgreSQL or MySQL. Troubleshoot issues related to data pipeline failures, identify root causes, and implement fixes to prevent future occurrences. Job Requirements : 4-9 years of experience in designing and developing data integration solutions using ADF or similar tools like Informatica PowerCenter or Talend Open Studio. Strong understanding of Microsoft Azure services including storage options (e.g., Blob Storage), compute resources (e.g., Virtual Machines), networking concepts (e.g., VPN). Proficiency in writing complex SQL queries for querying large datasets stored in relational databases such as PostgreSQL or MySQL.