Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Home

Jobs

Home
>
Jobs in Telangana
>
Prodapt
>
Data Engineer

Data Engineer

Prodapt

2 years

0 Lacs

Telangana

Posted:12 hours ago| Platform: GlassDoor logo

Apply

Skills Required

data azure engineering etl design apache architecture support analytics reporting power storage security compliance governance orchestration spark sql processing python pipeline olap devops kafka encryption learning mlflow visualization terraform code nosql

Work Mode

On-site

Job Type

Part Time

Job Description

Overview:

We are hiring a Junior Data Engineer (2 to 4 years) with expertise in Azure Data Bricks, Azure Data Lake, and Azure Synapse Analytics to join our high-performing team. technical proficiency in cloud-based data engineering. This role requires a strategic thinker who can bridge the gap between raw data and actionable insights, enabling data-driven decision-making for large-scale enterprise initiatives. A strong foundation in distributed computing, ETL frameworks, and advanced data modeling is crucial. The individual will work closely with data architects, analysts, and business teams to deliver scalable and efficient data solutions.

Work Location: Hyderabad, Bangalore and Chennai

Work Mode: Work from Office (5 days)

Notice Period: Immediate to 15 days

Responsibilities:

Key Responsibilities:

- Design, develop, and maintain high-performance data pipelines for structured and unstructured data using Azure Data Bricks and Apache Spark.
- Build and manage scalable data ingestion frameworks for batch and real-time data processing.
- Implement and optimize data lake architecture in Azure Data Lake to support analytics and reporting workloads.
- Develop and optimize data models and queries in Azure Synapse Analytics to power BI and analytics use cases.
Cloud-Based Data Solutions:
- Architect and implement modern data lakehouses combining the best of data lakes and data warehouses.
- Leverage Azure services like Data Factory, Event Hub, and Blob Storage for end-to-end data workflows.
- Ensure security, compliance, and governance of data through Azure Role-Based Access Control (RBAC) and Data Lake ACLs.
ETL/ELT Development:
- Develop robust ETL/ELT pipelines using Azure Data Factory, Data Bricks notebooks, and PySpark.
- Perform data transformations, cleansing, and validation to prepare datasets for analysis.
- Manage and monitor job orchestration, ensuring pipelines run efficiently and reliably.
Performance Optimization:
- Optimize Spark jobs and SQL queries for large-scale data processing.

Requirements:

Required Qualifications:

Experience:
- 2+ years of experience in data engineering, big data, or cloud-based data solutions.
- expertise with Azure Data Bricks, Azure Data Lake, and Azure Synapse Analytics.
Technical Skills:
- Strong hands-on experience with Apache Spark and distributed data processing frameworks.
- Advanced proficiency in Python and SQL for data manipulation and pipeline development.
- Deep understanding of data modeling for OLAP, OLTP, and dimensional data models.
- Experience with ETL/ELT tools like Azure Data Factory or Informatica.
- Familiarity with Azure DevOps for CI/CD pipelines and version control.
Big Data Ecosystem:
- Familiarity with Delta Lake for managing big data in Azure.
- Experience with streaming data frameworks like Kafka, Event Hub, or Spark Streaming.
Cloud Expertise:
- Strong understanding of Azure cloud architecture, including storage, compute, and networking.
- Knowledge of Azure security best practices, such as encryption and key management.

Preferred Skills (Nice to Have):

Experience with machine learning pipelines and frameworks like MLFlow or Azure Machine Learning.
Knowledge of data visualization tools such as Power BI for creating dashboards and reports.
Familiarity with Terraform or ARM templates for infrastructure as code (IaC).
Exposure to NoSQL databases like Cosmos DB or MongoDB.
Experience with data governance tools like Azure Purview.

More Jobs at Prodapt

Job Template - AD ASM Manager

Chennai, Tamil Nadu, India

7 - 12 yrs

Salary: Not disclosed

MySQL DBA

Greater Chennai Area

Experience: Not specified

Salary: Not disclosed

Delivery Lead

Chennai, Tamil Nadu, India

20.0 - 20.0 yrs

Salary: Not disclosed

Data Engineer

Greater Chennai Area

3.0 - 7.0 yrs

Salary: Not disclosed

Backend Engineer (Full Stack)

Greater Chennai Area

5.0 - 8.0 yrs

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

Prodapt

97 Jobs

Login to

Please Verify Your Phone or Email

Confirm Action

Search

Profile

Upskill and Grow with AI

Data Engineer