Senior Azure Data Engineer - Full remote - contractor in USD

For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databricks.

We are looking for a motivated contractor. Candidates need tbe fluent in English.

Tasks and responsibilities:

• Build data integration feeds according to the requirement;
• Review the business requirements and design the Pipelines that loads data into Azure Data Lakes or Azure Data warehouses, Azure Synapse, Azure Databricks or Cloud services. etc;
• Developing pipelines between different data sources including XML, flat files, SAP and databases.
• Strong Experience in Data Modeling, Data/ Information Architecture, Metadata Management, Master Data management, Data Governance & Data Quality;
• Strong analytical abilities required to evaluate work and provide technical assistance;
• Perform Code optimization and strictly adhere IFC standards;
• Expertise in monitoring and improving performance of the Azure data feeds;
• Create Design, Functional/Technical specification documentations or any artifacts needed;

Profile:

• Bachelor or Master degree;
• +8 years of experience in Data Modeling, Data/ Information Architecture, Metadata Management, Master Data management, Data Governance & Data Quality.
• Expertise on Azure platforms including experience in Azure Databricks, ADLS, Synapse and its various components is mandatory;
• In-dept knowledge and hands-on experience in Microsoft Azure data stack i.e., Azure Data Factory, Azure Synapse, Azure SQL Database, Azure Functions, Logic apps, Spark and Python/PySpark programming etc;
• Strong experience with designing ETL/ELT Pipelines/Data flows using Azure Data Factory as Primary skill and SSIS/Informatica as additional skills;
• Must have strong development & design skills in leading RDBMS environments e.g. MS SQL Server and Oracle;
• Expertise experience in complex SQL queries is required;
• Experience of Big data approach, architectural concepts, data sourcing/ ingestion/ curation and storage mechanisms;
• Experience with real-time / near-real-time Data warehousing concepts and Design approaches;
• Should have executed end-to-end projects focusing on analytics, data warehousing, enterprise reporting;
• Leveraging components like Azure Automation, Azure Power Shell Scripting, Az Copy, Devops/ARM Templates;
• Should have thorough understanding of Data-lakes, raw/enriched/curated layer concepts and ETL within Azure framework;
• Highly skilled in end-to-end Data warehousing and BI (analytics) design / development;
• Create Design, Functional/Technical specification documentations or any artifacts needed;
• Fluent in English;