Posted:5 hours ago|
Platform:
On-site
Full Time
Responsible for designing and maintaining scalable data pipelines on Microsoft Fabric and Azure. Focus includes ingesting structured, semi-structured, and unstructured data, managing OneLake/Delta Lake, and implementing CI/CD-driven deployments for analytics and AI workloads.
- Design and build end-to-end pipelines across Bronze, Silver, and Gold layers in Microsoft Fabric.
- Ingest and transform structured (SQL), semi-structured (JSON, Parquet, CSV), and unstructured data (PDFs, logs, images).
- Develop Fabric Dataflows Gen2, Spark notebooks, and Data Pipelines for batch or near-real-time ingestion.
- Manage OneLake and Delta Lake tables (partitioning, schema evolution, performance tuning).
- Implement data quality checks, metadata tagging, lineage, and logging processes.
- Integrate curated data with Power BI semantic models and downstream AI workloads.
- Apply governance using Microsoft Purview, including sensitivity labels and lineage tracking.
- Configure secure data access using RLS, ACLs, and Azure Key Vault integration.
- Implement CI/CD pipelines for Fabric, ADF, Synapse, or Databricks workloads using Azure DevOps or GitHub Actions.
- Manage version control, branching strategies, automated testing, and deployment workflows.
- Monitor data pipelines using Monitoring Hub, Azure Monitor, and Log Analytics.
- Bachelor’s Degree in Computer Science, Data Engineering, Information Systems, or related field.
SystemBender
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Instantly access job listings, apply easily, and track applications.
9.0 - 13.0 Lacs P.A.
7.0 - 11.0 Lacs P.A.
15.0 - 25.0 Lacs P.A.
hyderabad, pune, bengaluru
12.0 - 22.0 Lacs P.A.
bengaluru
10.0 - 20.0 Lacs P.A.
hyderabad
3.6 - 8.4 Lacs P.A.
mumbai, maharashtra, india
Salary: Not disclosed
Experience: Not specified
Salary: Not disclosed
hyderabad, telangana, india
2.5 - 7.5 Lacs P.A.
Salary: Not disclosed
