Azure cloud data Engineer

Level:

Location:

LOS:

Competency:

Skill: Azure Data Engineering

Job Position Title:

Azure Cloud Data Engineer with Python Programming – Senior Consultant/Manager (6+ Years)

Responsibilities:

·        Design, develop, and manage scalable and secure data pipelines using Azure Databricks and Azure Data Factory.

Python

·        Architect and implement cloud-based data solutions, integrating structured and unstructured data sources.

·        Build and optimize ETL workflows and ensure seamless data integration across platforms.

·        Develop data models using normalization and denormalization techniques to support OLTP and OLAP systems.

·        Manage Azure-based storage solutions including Azure Data Lake and Blob Storage.

·        Troubleshoot performance bottlenecks in data flows and ETL processes.

·        Integrate advanced analytics and support BI use cases within the Azure ecosystem.

·        Lead code reviews and ensure adherence to version control practices (e.g., Git).

·        Contribute to the design and deployment of enterprise-level data warehousing solutions.

·        Stay current with Azure cloud technologies and Python ecosystem updates to adopt best practices and emerging tools.

Mandatory skill sets:

Strong Python programming skills (Must-Have)

Strong SQL skills (Must-Have)

Azure Databricks (Must-Have)

·        Azure Data Factory

·        Azure Blob Storage / Azure Data Lake Storage

·        Apache Spark (hands-on experience)

Data modeling (Normalization & Denormalization)

·        Data warehousing and BI tools integration

·        Git (Version Control)

·        Building scalable ETL pipelines

Preferred skill sets (Good to Have):

·        Understanding of OLTP and OLAP environments

·        Experience with Kafka and Hadoop

·        Azure Synapse Analytics

·        Azure DevOps for CI/CD integration

·        Agile delivery methodologies

Years of experience required:

·        6+ years of overall experience in cloud engineering or data engineering roles, with at least 2-3 years of hands-on experience with Azure cloud services.

·        Proven track record of strong Python development with at least 2-3 years of hands-on experience.

Education qualification:

BE/B.Tech/MBA/MCA