Azure Data Engineer

Azure Data Engineer .

aarati.pardhi@emids.com

Azure Data Engineer

Emids is looking for Azure Data Engineer with 4-6 years of experience who takes responsibility for ownership in providing data engineering solutions and contributing to the overall success of the team.  

Responsibilities

• Hands-on architecture/development of ETL pipelines 
• Ability to handle large volume of data. 
• Strong hands-on experience in SSIS. 
• Strong hands-on experience in SQL Server (Azure Managed Instance (MI)). 
• Exposure to Azure Synapse and Azure Data Factory (ADF) 
• Experience in writing complex SQL queries and in performance tuning 
• Provide maintenance support/Troubleshooting any issues that may arise. 
• Experience working with SQL Server/Stored Procedures/API. 
• Consulting with data management teams to identify data storage needs and provide warehousing options based on the storage needs 
• Conduct preliminary testing of the warehousing environment prior to data extraction 
• Extract source data and transferring it into the new warehousing environment 
• Testing the new storage system once all the data has been transferred 
• Interpret data, analyze results using statistical techniques and provide ongoing reports 
• Develop and implement databases, data collection systems, data analytics and other strategies that optimize statistical efficiency and quality 
• Acquiring data from primary or secondary data sources and maintain databases/data systems 
• Identify, analyze, and interpret trends or patterns in complex data sets 
• Filter and clean data by reviewing reports and performance indicators to locate and correct problems 
• Work with management to prioritize business and information needs 
• Locate and define new process improvement opportunities 

Requirements:

• Technical expertise regarding data models, database design development, data mining and segmentation techniques 
• Good experience writing complex SQL and ETL processes 
• Experience working with large data volumes, including processing, transforming and transporting large-scale data 
• Experience in cloud-based data integration service for creating ETL and ELT pipelines like Azure Data Factory and Azure Synapse.
• Strong analytical skills with the ability to collect, organize, analyze, and disseminate significant amounts of information with attention to detail and accuracy 
• Good understanding & usage of algorithms and data structures 
• Good Experience building reusable frameworks/pipelines. 
• Experience working in an Agile Team environment. 
• Excellent communication skills both verbal and written Backend Development:
• Solid knowledge of SQL and relational database design
• Strong experience with one or more backend languages: Py spark, Python

Cloud & Infrastructure:

• Familiarity with container orchestration tools
• Experience with CI/CD pipelines and cloud platforms (Azure data factory, Azure Synapse)

Preferred Qualifications:

• Prior experience as an azure data engineer
• Track record of delivering complex data pipelines
• Ability to balance hands-on technical work with strategic leadership
• Excellent communication and stakeholder management skills
• Experience working in Agile/Scrum environments