Senior Data Engineer - ETL/Azure Data Factory Rosemallow Technologies

5.0 - 10.0 years

10 - 14 Lacs

pune

Work from Office

We are seeking a highly skilled Senior Data Engineer to lead the migration, optimization, and governance of data pipelines in Azure Data Factory (ADF) and SQL. The ideal candidate will have extensive experience in Change Data Capture (CDC), performance tuning, data security, and compliance within a cloud-based architecture. Key Responsibilities : - Architect & optimize CDC pipelines in ADF, Data Sync Services and SQL, ensuring efficient data ingestion. - Implement performance tuning strategies such as parallel processing, indexing, partitioning, and data archiving. - Enforce security & compliance by implementing RBAC, data encryption, audit logging, and access control best practices. - Define and implement data governance models, including roles, metadata management, and compliance policies. - Develop robust error handling & monitoring with automated alerts, logging strategies, and retry mechanisms for CDC failures. - Provide technical documentation & best practices for CDC implementation, security, and performance optimization. Requirements : Qualifications & Skills : - 5+ years of experience in data engineering with expertise in Azure (ADF, Synapse), SQL, and CDC implementation. - Strong knowledge of performance tuning techniques, including parallel processing and indexing strategies. - Hands-on experience with data security, governance, and compliance best practices in a cloud environment. - Experience with error logging, monitoring, and notification setup for data pipelines. - Ability to troubleshoot performance bottlenecks and implement scalable solutions. - Excellent communication and documentation skills.

Posted Date not available

Apply

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.