Senior Data Engineer - ETL/Azure Data Factory

We are seeking a highly skilled Senior Data Engineer to lead the migration, optimization, and governance of data pipelines in Azure Data Factory (ADF) and SQL. The ideal candidate will have extensive experience in Change Data Capture (CDC), performance tuning, data security, and compliance within a cloud-based architecture.
Key Responsibilities :
- Architect & optimize CDC pipelines in ADF, Data Sync Services and SQL, ensuring efficient data ingestion. - Implement performance tuning strategies such as parallel processing, indexing, partitioning, and data archiving. - Enforce security & compliance by implementing RBAC, data encryption, audit logging, and access control best practices. - Define and implement data governance models, including roles, metadata management, and compliance policies. - Develop robust error handling & monitoring with automated alerts, logging strategies, and retry mechanisms for CDC failures. - Provide technical documentation & best practices for CDC implementation, security, and performance optimization. Requirements :
Qualifications & Skills :
- 5+ years of experience in data engineering with expertise in Azure (ADF, Synapse), SQL, and CDC implementation. - Strong knowledge of performance tuning techniques, including parallel processing and indexing strategies. - Hands-on experience with data security, governance, and compliance best practices in a cloud environment. - Experience with error logging, monitoring, and notification setup for data pipelines. - Ability to troubleshoot performance bottlenecks and implement scalable solutions. - Excellent communication and documentation skills.