Azure Data Engineer - SSE

Job Description

Company Profile: Job Title: Azure Data Engineer Position: Senior Systems Engineer Experience:7+Years Category: Azure Data Engineer Main location: Bangalore Position ID: J0425-0034 Employment Type: Full Time Job Description : Job Description: We are seeking a highly experienced Azure Data Engineer with expertise in Microsoft Azure data services and extensive experience in designing, implementing, and optimizing enterprise-grade data solutions. The ideal candidate will lead data architecture initiatives, ensure high performance, reliability, and security : Architect, develop, and optimize scalable, high-performance data solutions using Azure Data Services. Lead the design and implementation of Azure Synapse Analytics, Azure Data Factory, Azure Data Lake, Azure Databricks, Azure SQL Database, and Cosmos DB. Optimize and manage Azure databases including Cosmos DB, SQL Managed Instance, PostgreSQL, MySQL, ensuring security, availability, and scalability. Develop, manage, and optimize big data processing workflows using Apache Spark, Hadoop, Hive, Kafka, and other data frameworks. Establish and enforce data governance, security, and compliance using Microsoft Purview, Azure Policy, and Role-Based Access Control (RBAC). Design and implement streaming data solutions using Azure Event Hubs, Azure Stream Analytics, and Kafka. Drive performance tuning, query optimization, and cost efficiency across structured and unstructured datasets. Build and maintain CI/CD pipelines for data workloads using Azure DevOps, Terraform, and Bicep. Collaborate with cross-functional teams to drive data strategy and cloud migration initiatives. Mentor and guide junior engineers in best practices and cutting-edge data technologies. Required Skills & Qualifications: 7-10 years of experience and 4-5 years in Data engineering Expertise in Azure Data Services including Azure Synapse, Azure Data Factory, Azure Data Lake, Azure SQL Database, Cosmos DB. Strong programming skills in Python and SQL, with hands-on experience in data processing, ETL pipelines, and automation. Deep knowledge of relational databases (SQL Server, PostgreSQL, MySQL) and NoSQL databases (Cosmos DB, MongoDB, Cassandra). Proven experience with Big Data platforms such as Azure HDInsight, Databricks, and Spark. Strong understanding of Azure Data Governance using Microsoft Purview. Experience handling large-scale data migrations and implementing data lake architectures. Expertise in data modeling, data warehousing, and distributed data processing frameworks. Deep understanding of data formats such as Avro, ORC, Parquet. Microsoft Certified: Azure Data Engineer Associate or equivalent. Good to Have: Experience with Azure Machine Learning, Power BI, and DataBricks MLflow. Exposure to Hadoop, Spark, Kafka, and Event Hubs. Understanding of multi-cloud environments and cloud database migration strategies. Knowledge of Azure security policies, role-based access control, and compliance standards. Behavioural Competencies : Proven experience of delivering process efficiencies and improvements Clear and fluent English (both verbal and written) Ability to build and maintain efficient working relationships with remote teams Demonstrate ability to take ownership of and accountability for relevant products and services Ability to plan, prioritise and complete your own work, whilst remaining a team player Willingness to engage with and work in other technologies Note: This job description is a general outline of the responsibilities and qualifications typically associated with the Virtualization Specialist role. Actual duties and qualifications may vary based on the specific needs of the organization. Your future duties and responsibilities Required qualifications to be successful in this role Skills: Apache Kafka Apache Spark Data Migration Python Azure Data Factory Hadoop Ecosystem (HDFS)