Azure Data Engineer

As a Senior Data Engineer (Azure) with 6+ years of experience, your role will involve working on various data processing tasks on Azure platform such as Azure Data Factory, Streaming Analytics, Event Hubs, Azure Databricks, Data Migration Service, and Data Pipeline. You will be responsible for provisioning, configuring, and developing Azure solutions like ADB, ADF, ADW, etc. Additionally, you will design and implement scalable data models and migration strategies, work on distributed big data batch or streaming pipelines using technologies like Kafka or similar, and develop data integration and transformation solutions for structured and unstructured data. Collaboration with cross-functional teams for performance tuning, optimization, monitoring data workflows, and ensuring compliance with data governance and quality standards will also be a part of your responsibilities. Moreover, you will contribute to continuous improvement through automation and DevOps practices. Key Responsibilities: - Data Processing on Azure using Azure Data Factory, Streaming Analytics, Event Hubs, Azure Databricks, Data Migration Service, Data Pipeline - Provisioning, configuring, and developing Azure solutions (ADB, ADF, ADW, etc.) - Design and implement scalable data models and migration strategies - Work on distributed big data batch or streaming pipelines (Kafka or similar) - Develop data integration and transformation solutions for structured and unstructured data - Collaborate with cross-functional teams for performance tuning and optimization - Monitor data workflows and ensure compliance with data governance and quality standards - Contribute to continuous improvement through automation and DevOps practices Qualifications Required: - 6-10 years of experience as a Data Engineer - Strong proficiency in Azure Databricks, PySpark, Python, SQL, and Azure Data Factory - Experience in Data Modelling, Data Migration, and Data Warehousing - Good understanding of database structure principles and schema design - Hands-on experience using MS SQL Server, Oracle, or similar RDBMS platforms - Experience in DevOps tools (Azure DevOps, Jenkins, Airflow, Azure Monitor) - good to have - Knowledge of distributed data processing and real-time streaming (Kafka/Event Hub) - Familiarity with visualization tools like Power BI or Tableau - Strong analytical, problem-solving, and debugging skills - Self-motivated, detail-oriented, and capable of managing priorities effectively Please note that the skills required for this role include data engineering, databricks, data structures, Python, and PySpark.,