Data Engineer

Cloudangles

0 years

0 Lacs

hyderābād

Posted:17 hours ago| Platform: GlassDoor logo

Apply

Skills Required

data architecture azure design storage logic integration github model layers efficiency pipeline devops security analytics communication

Work Mode

On-site

Job Type

Part Time

Job Description

Job Summary:

We are seeking a highly skilled Data Engineer with expertise in leveraging Data Lake architecture and the Azure cloud platform to develop, deploy, and optimize data-driven solutions. You will play a pivotal role in transforming raw data into actionable insights, supporting strategic decision-making across the organization.

Key Responsibilities

Develop and optimize scalable data pipelines using Python and PySpark
Build and orchestrate data workflows with Azure Data Factory
Design and implement solutions using Azure Databricks and Synapse Analytics
Manage and maintain data storage solutions in Azure Data Lake Storage Gen2, leveraging cost-efficient architecture
Implement and manage CI/CD pipelines using Azure Logic Apps, with integration of tools such as Azure DevOps, GitHub Actions, or Jenkins
Model and maintain Medallion Architecture across Bronze, Silver, and gold layers based on business requirements
Collaborate with data scientists, analysts, and business stakeholders to ensure reliable data availability
Monitor and optimize performance and cost efficiency of data solutions across the ecosystem

Required Skills & Experience

Strong proficiency in Python and PySpark for data manipulation and transformation
Hands-on experience with Azure Data Factory, Azure Databricks, and Synapse Analytics
Familiarity with Azure Logic Apps for CI/CD pipeline management
Knowledge of CI/CD tools such as:
Azure DevOps Pipelines
GitHub Actions
Jenkins
Expertise in managing Azure Data Lake Storage Gen2 environments with emphasis on security and cost optimization
Deep understanding of Medallion Architecture principles:
Bronze Layer: Raw data ingestion
Silver Layer: Cleansed, enriched, and business-ready data
Gold Layer: Aggregated and analytics-ready data models
Strong problem-solving and communication skills
Experience on Cost optimization

More Jobs at Cloudangles

Software engineer I (Java)

Noida, Uttar Pradesh, India

2.0 - 2.0 yrs

Salary: Not disclosed

Data Engineer II

Noida, Uttar Pradesh, India

3.0 - 3.0 yrs

Salary: Not disclosed

Technical Lead

Noida, Uttar Pradesh, India

10.0 - 10.0 yrs

Salary: Not disclosed

Automation Tester

Hyderabad, Telangana, India

3.0 - 3.0 yrs

Salary: Not disclosed

Data Engineer

Hyderabad, Telangana, India

Experience: Not specified

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start DevOps Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.