351 Unity Catalog Jobs - Page 6

Skill: Azure Data Engineer Experience : 4-8 years Note: Looking for Immediate Joiners Only (0-15 days) Job Location: Hyderabad - Full Time Work Mode: In Office Interview Date and Time: 7th Nov'25 (Friday) & 10:00 AM IST to 4:00 PM IST Interview Mode: Face to Face Interview (In-Person) Job Description: Experience in Azure cloud platforms like Advanced Python Programming, Databricks, Azure SQL , Data factory (ADF), Data Lake, Data storage, SSIS. Create and deploy scalable ETL/ELT pipelines with Azure Databricks by utilizing PySpark and SQL. Create Delta Lake tables with ACID transactions and schema evolution to support real-time and batch processing. Experience in Unity Catalog for centralized...

Skill: Azure Data Engineer Experience : 4-8 years Note: Looking for Immediate Joiners Only (0-15 days) Job Location: Hyderabad - Full Time Work Mode: In Office Job Description: Experience in Azure cloud platforms like Advanced Python Programming, Databricks, Azure SQL , Data factory (ADF), Data Lake, Data storage, SSIS. Create and deploy scalable ETL/ELT pipelines with Azure Databricks by utilizing PySpark and SQL. Create Delta Lake tables with ACID transactions and schema evolution to support real-time and batch processing. Experience in Unity Catalog for centralized data governance, access control, and data lineage tracking. Mandatory Qualifications: 4-8 years of experience as a Data Engin...

Job Summary: We are seeking a skilled and experienced Technology Stack Administrator to manage and optimize our on-premises infrastructure comprising RedHat OpenShift, Apache Spark, Apache Airflow, Delta Lake, Apache Kafka, and Debezium. The ideal candidate will have hands-on experience in deploying, configuring, monitoring, and troubleshooting these platforms, ensuring high availability, performance, and security. Key Responsibilities: Platform Administration: Install, configure, and maintain RedHat OpenShift clusters in an on-premises environment. Build and orchestrate data pipelines using Apache Airflow. Implement and manage Delta Lake for ACID-compliant data lake architecture. Manage Apa...

Inviting applications for the role of Lead Consultant- Databricks Developer ! In this role, the Databricks Developer is responsible for solving the real world cutting edge problem to meet both functional and non-functional requirements. Responsibilities Design and develop scalable data pipelines using Databricks ( PySpark /SQL/Delta Live Tables). Implement ETL/ELT frameworks leveraging the Lakehouse (Bronze, Silver, Gold) architecture. Implement and manage data governance using Unity Catalog to ensure secure access, compliance, and centralized management of data, users, and permissions across the Databricks Lakehouse. Optimize data models, queries, and workflows for scalability, cost, and pe...

Role: Architect I - Data Location - Multiple Experience: 5 + years (with 3+ in Azure Data Services and Fabric or Unity Catalog) Key Responsibilities Architect and implement end-to-end data pipelines , data lakes , and data warehouses on Azure. Build and optimize data processing workflows using PySpark and Python . Design data governance and metadata management frameworks leveraging MS Fabric or Unity Catalog (mandatory) . Collaborate with BI developers and data engineers to deliver high-performance analytics solutions . Establish best practices for data quality, lineage, and access control across environments. Lead the adoption of modern BI tools and cloud-native architectures (Synapse, Powe...

As a Senior Databricks Data Engineer at an Australian Data and AI company expanding its Databricks Capability in India, your role will involve architecting, designing, and developing data pipelines and modeling layers to support analytical and AI-driven workloads. You will work on end-to-end Databricks projects, collaborating with consulting and client delivery teams across regions. Responsibilities: - Take end-to-end responsibility for project delivery, including planning, prioritization, and ensuring data solutions meet quality and performance expectations. - Engage with business and product teams to understand data needs, translate requirements, and align engineering solutions with strate...

As a Databricks Developer at PalTech, you will play a crucial role in designing, developing, and maintaining highly scalable and efficient data pipelines using Databricks, PySpark, and other related technologies. Your primary responsibility will involve processing large scale datasets and collaborating with cross-functional teams to design and implement data engineering and analytics solutions. Key Responsibilities: - Design, develop, and maintain highly scalable and efficient data pipelines using Databricks, PySpark, and related technologies - Collaborate with cross-functional teams to design and implement data engineering and analytics solutions - Optimize Databricks notebooks and implemen...

As a Quality Engineering Lead at hiReign Innoways, you will play a crucial role in ensuring the efficiency and accuracy of data testing activities within Azure-Databricks ecosystems. Your responsibilities will include: - Developing and implementing comprehensive test strategies for Azure-Databricks ecosystems - Leading and mentoring QA/testing teams, coaching best practices, and maintaining QE documentation - Acting as the primary point-of-contact for all data testing activities In this role, you will also be responsible for: - Planning, designing, and overseeing test cases across functional, UAT, E2E, and performance domains - Validating ETL pipelines via SQL, Python, PySpark, Scala; ensuri...

Company Description hiReign Innoways is a provider of IT Services, Consulting, and Business Solutions. We enable our clients to enhance the efficiency of their current operations, making them more cost-effective, which in turn allows investments in innovation and unleashes new potential across organizations. Our customer-focused approach offers specialized services and solutions tailored to specific domain and technology requirements. We believe in collaboration, working closely with clients to understand their business, analyze challenges, and guide them through transformation. Experience : Minimum 6 - 8 Years Shift : 5PM - 2 AM (US Shift) Mode of work : Work from Home Location : Hyderabad ...

Job Description We are seeking an experienced Data Architect specializing in Databricks to lead the architecture, design, and migration of enterprise data workloads from on-premises systems (e.g., Oracle, Exadata, Hadoop) to Databricks on Azure or AWS . The role involves designing scalable, secure, and high-performing data platforms based on the medallion architecture (bronze, silver, gold layers), supporting large-scale ingestion, transformation, and publishing of data. Responsibilities Key Responsibilities Define and design cloud-native data architectures on Databricks using Delta Lake, Unity Catalog, and related components. Develop and execute migration strategies for moving on-premises d...

Role & responsibilities Architect and implement end-to-end data pipelines, data lakes, and warehouses using modern cloud services and architectural patterns. Develop and build analytics tools that deliver actionable insights to the business. Integrate and manage large, complex data sets to meet strategic business requirements. Optimize data processing workflows using frameworks such as PySpark. Establish and enforce best practices for data quality, integrity, security, and performance across the entire data ecosystem. Collaborate with cross-functional teams to prioritize deliverables and design solutions. Develop compelling business cases and return on investment (ROI) analyses to support st...

Experience: 5+years Location: PAN India Role & responsibilities: Databricks Unity Catalog Engineer (6+ yrs) Hands-on experience with Databricks, including Unity Catalog, Delta Lake, and workspace management Experience in design and implementing Databricks Unity Catalog for centralized governance across workspaces and data domains Strong understanding of cloud platforms (Azure, AWS, or GCP) and their security models Experience with metadata management, data lineage, and cataloging Proficiency in SQL and scripting for automation and policy enforcement.

Job Title: Python Full Stack Developer (Generative AI Specialist) Experience Required: (4-7 Years) Location: [Bangalore] Employment Type: [Full-time] Skills Required: Proficiency in Databricks Workflows, Delta Live Tables (DLT), PySpark, and SQL for designing scalable ETL pipelines within the Medallion Architecture (BronzeSilverGold). Strong knowledge of Unity Catalog and Delta Lake. Hands-on experience with Databricks Genie, Vector Search, and MLflow for developing, fine-tuning, and deploying AI/LLM-based solutions. Expertise in Databricks SQL Endpoints, LangChain, and RAG (Retrieval-Augmented Generation) frameworks for conversational analytics and chatbot development. Familiarity with DevO...

Job Title : Data Engineer Location : Chennai , Trivandrum,Kochi Experience : 5+ Years Role Overview : We're looking for an experienced Data Engineer to develop and manage scalable data workflows using Azure services. You'll integrate data from systems like Teradata, SAP, and Salesforce to support analytics and real-time solutions. The role involves working closely with teams to build efficient, secure, and high-performance data solutions. Key Responsibilities : Develop and manage Azure Data Factory (ADF) pipelines for data ingestion into the Data Lake. Build and optimize Databricks notebooks for data curation and real-time event streaming. Optimize workflows for performance, cost-efficiency,...

Architect and implement scalable Azure Databricks solutions, including Data Lakehouse, Delta Lake, Structured Streaming, Unity Catalog, and Medallion Architecture. Design and manage advanced ETL/ELT pipelines utilizing PySpark, Databricks Workflows, Data Factory, and Azure Storage services. Lead ML engineering and MLOps implementation, leveraging MLflow for experiment tracking, model registry, versioning, deployment, and monitoring. Establish and enforce enterprise-grade data governance, security, lineage, and compliance using Unity Catalog, Azure AD, and cloud-native controls. Optimize Databricks clusters for performance, scalability, reliability, and cost-effectiveness in production enviro...

Job Title: Senior Azure Data Engineer Experience: 912 Years Location: Noida Job Description We are looking for a Senior Azure Data Engineer with extensive experience in building and optimizing large-scale data pipelines and architectures using the Microsoft Azure ecosystem . The ideal candidate should have deep hands-on expertise in Azure Data Factory (ADF) , Azure Databricks , and Unity Catalog , along with a strong understanding of data governance, security, and performance optimization . The role involves designing scalable, reliable, and secure data platforms that enable data-driven decision-making across the enterprise. Key Responsibilities Design and implement end-to-end data pipelines...

Company Profile: Quantum Integrators is an international strategy and business consulting group whose mission is to help clients create and sustain competitive advantage. As a truly client-focused firm, our highly trained and experienced consultants consider it their mandate to help client organizations achieve a quantum state. Position : AI and Databricks Engineer Location: Pune/Nagpur, Maharashtra (Onsite) Duration: Full time Shift: US/UK Shift Experience: 5-7 years mandatory Job Description: Strong experience developing industry grade LLM and Gen-AI applications using Open AI, Anthropic (Claude), or other major providers. Hands-on experience with Databricks (Spark, Delta Lake, MLflow, Dat...

Experience as a Data Engineer Experience in Databricks Experience in Unity Catalog (Data Governance) Experience in ETL/ELT pipelines using Databricks & PySpark Experience in Python Experience in Apache Spark / Spark Experience in SQL Experience in Azure & AWS Certification in Databricks (Good to have)

Position: AVP Databricks Architect Champion Location: Hyderabad | Work Mode: 5 Days from Office | Shift: UK Timings | Experience: 14+ yrs We are looking for an experienced Databricks Architect Champion to lead data platform modernization and large-scale Lakehouse transformation initiatives. The ideal candidate will bring strong hands-on expertise in Databricks, Unity Catalog, Delta Lake, PySpark, and Databricks SQL , along with a deep understanding of data governance, security, and scalable architecture design . Key Responsibilities: Architect and implement enterprise-grade Databricks Lakehouse solutions across multi-cloud environments (Azure/AWS). Drive Unity Catalog adoption for secure dat...

Roles and Responsibilities A Databricks Platform Administrator is a crucial role responsible for the effective design, implementation, maintenance, and optimization of the Databricks Lakehouse Platform within an organization. This individual ensures the platform is scalable, performant, secure, and aligned with business objectives, providing essential support to data engineers, data scientists, and analysts. Key Responsibilities: 1. Provision and configure Databricks workspaces, clusters, pools, and jobs across environments. 2. Create catalogs, schemas, access controls, and lineage configurations. 3. Implement identity and access management using account groups, workspace-level permissions, ...

Job Description: Python, SQL, ADF, Databricks ( PySpark, DLT, Unity Catalog, Performance Tuning, Cost Optimization ) along with leadership(self Databricks Associate or professional Certification.

About the Role The Databricks Data Architect will play a pivotal role in designing and scaling Lillyu2019s Data & AI platform on cloud environments such as AWS and Azure . This role focuses on leveraging Databricks Lakehouse to deliver secure, scalable, and high-performing data architectures that empower AI/ML, analytics, and data product development across global business functions. The ideal candidate will blend deep technical expertise , data platform design experience , and strategic vision to enable Lillyu2019s transformation into an AI-driven enterprise . Key Responsibilities 1. Platform & Architecture Leadership Design, implement, and optimize Lakehouse architectures using Databricks,...

Role : Data Engineer Experience : 10 to 20 Yrs Key Responsibilities: Serve as the point of contact and subject matter expert for all Databricks-related activities, including architecture, development, and operational best practices. Should work closely with Sales team, propose data roadmap to prospects intending to migrate to cloud, create proof of concepts to showcase our expertise. Design, develop, and manage ETL/ELT pipelines in Databricks using Python (PySpark), integrating various data sources to support business operations. Leverage Unity Catalog to ensure data lineage, security, and governance are properly managed across the Databricks environment. Implement and maintain CI/CD pipelin...

Strong hands-on experience with Databricks (Workflows, DLT Pipelines, Delta Lake, Unity Catalog, Jobs, Clusters) Unity Catalog, IAM Databricks Platform Unity Catalog background,

Role Overview: As a Senior Data Engineer, you will be responsible for designing, building, and optimizing scalable data pipelines for large-scale data processing. Your expertise in Python, Spark, Databricks, and Azure will be crucial in handling complex data engineering tasks. You will work with cloud platforms, specifically Azure, to process and analyze large datasets efficiently. Key Responsibilities: - Design, build, and optimize scalable data pipelines using Python and Apache Spark. - Utilize Azure Databricks and PySpark for big data processing and analysis. - Implement data integration and orchestration using Azure Data Factory. - Utilize Azure Data Lake Storage for big data analytics a...