Data Engineer

Altaa Vistaa Business Solutions

3 - 7 years

4 - 9 Lacs

pune

Posted:3 weeks ago| Platform:

Apply

Skills Required

data engineer azure cosmosdb azure data factory python azure blob storage azure ai search sql

Work Mode

Work from Office

Job Type

Full Time

Job Description

Role & responsibilities

Azure Cosmos DB (Mongo API):
hands-on experience with schema design, query optimization, and partitioning strategies.
Azure Blob Storage:
efficient data storage, retrieval, and integration with pipelines.
Azure Data Factory (ADF)
or equivalent orchestration tools (e.g.,
Apache Airflow
) for ETL/ELT workflows.
Azure AI Search:
data indexing, hybrid search queries, and semantic query tuning.
Python:
data manipulation, ETL scripting, and integration with Azure SDKs.
SQL & NoSQL data modeling:
relational and document-based schema design.
Query tuning & performance optimization:
profiling queries, caching, and cost optimization in Azure.
ETL/ELT pipeline design & automation:
end-to-end data ingestion, transformation, and load processes.
Parallel data retrieval & bulk data handling:
scalable data ingestion for large datasets.
JSON & document-based data formats:
schema validation and transformation.
Monitoring & observability:
use of
Azure Monitor
,
Log Analytics
, or Application Insights for tracking data pipeline health and performance.
Version control & CI/CD:
Git-based workflow, integration with Azure DevOps or GitHub Actions for data pipelines.

Preferred candidate profile

Migration experience
from
Elasticsearch
or
MongoDB
to Azure-native data services.
Understanding of distributed data systems
and concurrency scaling patterns.
Knowledge of Azure networking fundamentals:
Private Endpoints, Managed Identity, and secure data access configurations.

Mock Interview

Practice Video Interview with JobPe AI

Start Data Engineer Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.