Posted:7 hours ago
Build and maintain data pipelines in Azure Databricks using PySpark and SQL.
• Ingest data from databases, files, APIs and streaming sources into Azure Data Lake Storage.• Organize data in Delta Lake using Bronze, Silver and Gold layers.• Schedule and monitor pipelines with Databricks Workflows or Azure Data Factory.• Check data quality and fix pipeline failures quickly.• Tune jobs and cluster settings for speed and cost.• Set up access and permissions with Unity Catalog and Azure security tools.• Document pipelines and work with analysts and business teams on their data needs.
Required skills:
Hands-on experience with Azure Databricks, including notebooks, clusters and jobs.
• Strong SQL and solid Python (PySpark) for transforming large data.• Working knowledge of Delta Lake and data warehousing concepts.• Experience with Azure services: Data Lake Storage, Data Factory and Key Vault.• Understanding of ETL and ELT design, including batch and incremental loads.• Version control with Git and basic CI/CD practice.• Clear communication with both technical and non-technical colleagues.
Free courses, interview questions and practice for each skill.
Work from Office
Full Time
EXL
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Practice Python coding challenges to boost your skills
Start Practicing Python Now
Gurugram
Salary: Not disclosed
Bengaluru
Salary: Not disclosed
Chennai
Experience: Not specified
3.0 - 4.0 Lacs P.A.
Gurugram
Salary: Not disclosed
Bengaluru
Salary: Not disclosed
Chennai
Experience: Not specified
3.0 - 4.0 Lacs P.A.
AI Job Matching Summary