Azure Data Engineer

Data Engineer:

Required Skills and Qualifications

• 5+ years of hands-on experience as a Data Engineer, with a strong portfolio of successful projects delivering robust, scalable, and reliable data solutions.
• Strong proficiency in Microsoft SQL Server and Structured Query Language (SQL), including query optimization and advanced data querying.
• Experience with scripting and programming languages, including PowerShell, Python, Scala, and working with Json, XML.
• Solid experience leveraging technologies such as Snowflake, Azure Data Factory (ADF), Azure Data Lake Storage Gen2, Microsoft Fabric, Logic Apps, Azure Functions, Databricks, Apache Spark (PySpark), and Azure Synapse for handling large-scale distributed data processing.
• Hands-on experience with data warehousing and data modeling concepts, including normalization, denormalization, and relational design for efficient and scalable database structures.
• Proven expertise in designing, building, and maintaining ETL/ELT pipelines, including extracting data from diverse sources, transforming, and loading into data warehouses using tools such as Azure Data Factory (ADF), Microsoft Fabric, and Apache Airflow.
• Experience structuring and maintaining enterprise-level integrations using platforms such as Snowflake, Azure Synapse, Azure SQL, and SQL Server.
• Experience with real-time data streaming and processing using Apache Kafka and Azure Event Hubs for handling high-volume data flows.
• Hands-on experience with data analytics and reporting solutions, specifically using Microsoft Power BI.
• Good understanding of DevOps practices, including unit testing, software change management, software release management, CI/CD pipelines, and Infrastructure as Code fundamentals.
• Strong analytical, problem-solving, and troubleshooting skills with the ability to communicate effectively across teams and resolve complex data or infrastructure issues.

Preferred Skills and Qualifications

• Experience architecting data pipelines with Azure Synapse Analytics, Azure Data Factory (ADF), and Microsoft Fabric for cloud-based data engineering.
• Advanced skills in Microsoft SQL Server technologies, including Master Data Services, SSIS, SSAS, and SSRS.
• Expertise in real-time data processing architectures using Apache Kafka and Azure Event Hubs for streaming analytics and event-driven systems.