348 Unity Catalog Jobs

Job Title: Senior Data Engineer Location: Bangalore Key Responsibilities Design, build, and maintain scalable, reliable data pipelines using Azure data services to support analytics, data science, and business reporting use cases. Develop and manage data ingestion, transformation, and integration workflows using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics . Implement and optimize Medallion architecture (BronzeSilver–Gold) to ensure structured, governed, and efficient data processing. Design and maintain data models and data warehouses that enable performant querying and downstream analytics consumption. Ensure data quality, consistency, security, and governance across p...

Databricks with strong data engineering skills and deep AWS cloud expertise . To lead the design, build, and deployment of data products on the Databricks Lakehouse platform, ensuring scalability, governance, security, and business value delivery. The role requires mastery in Databricks features, Delta Lake, AWS ecosystem integration, and modern Data Engineering best practices. Primary Responsibilities Design, build, and manage data products and event driven architecture using Databricks Lakehouse principles. Design end-to-end data pipelines using PySpark, Databricks SQL. Define Data Product blueprint including domain boundaries, ownership, SLAs, documentation, quality rules . Implement mode...

Role Overview: At Markovate, we are looking for a highly experienced and innovative Senior Data Engineer who can design, build, and optimize robust, scalable, and production-ready data pipelines across both AWS and Azure platforms. As a Senior Data Engineer, you will be responsible for developing hybrid ETL/ELT pipelines, processing files from AWS S3 and Azure Data Lake Gen2, implementing event-based orchestration, creating scalable ingestion workflows, integrating with metadata and lineage tools, and collaborating with cross-functional teams to align solutions with AI/ML use cases. Key Responsibilities: - Design and develop hybrid ETL/ELT pipelines using AWS Glue and Azure Data Factory (ADF...

JOB TITLE: Digital Commerce - AI Product Analyst LOCATION: Bangalore ABOUT UNILEVER: Be part of the world's most successful, purpose-led business. Work with brands that are well-loved around the world, that improve the lives of our consumers and the communities around us. We promote innovation, big and small, to make our business win and grow and we believe in business as a force for good. Unleash your curiosity, challenge ideas and disrupt processes use your energy to make this happen. Our brilliant business leaders and colleagues provide mentorship and inspiration, so you can be at your best. Every day, nine out of ten Indian households use our products to feel good, look good and get more...

Req ID: 350677 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Pod1 - SAP to join our team in Remote, Karn?taka (IN-KA), India (IN). The SAP-to-Databricks Migration Engineer will lead and execute the migration of SAP data (including SAP BW, ECC, and related modules) into the Databricks platform, ensuring seamless integration, optimized performance, and adherence to governance standards. This role requires deep expertise in SAP systems and Databricks architecture, with a strong focus on data engineering and transforma...

As a Senior Data Engineer at Mindcurv, you will play a crucial role in designing and implementing scalable data solutions for our clients. You will be part of our dynamic Data and Analytics team, collaborating with cross-functional teams to ensure the organization leverages data as a strategic asset. Your responsibilities will include: - Designing, building, and maintaining scalable data pipelines and ETL processes using Databricks and other modern tools. - Architecting, implementing, and managing cloud-based data warehousing solutions on Databricks (Lakehouse Architecture). - Developing and maintaining optimized data lake architectures to support advanced analytics and machine learning use ...

As a Solution Architect with 7+ years of experience, your role will involve designing, implementing, and optimizing enterprise-scale data platforms with a focus on Databricks. You will be expected to leverage your expertise in big data, cloud-native architectures, and advanced analytics to translate business requirements into scalable solutions while engaging stakeholders effectively. Key Responsibilities: - Architect and deliver end-to-end data solutions using Databricks features like Delta Lake, MLflow, and Unity Catalog. - Design and optimize data pipelines for both batch and real-time processing utilizing technologies such as Spark, Kafka, and Event Hubs. - Collaborate closely with busin...

As a skilled Technology Stack Administrator, your role will involve managing and optimizing the on-premises infrastructure which includes RedHat OpenShift, Apache Spark, Apache Airflow, Delta Lake, Apache Kafka, and Debezium. Your responsibilities will encompass a variety of tasks such as platform administration, monitoring & optimization, security & compliance, automation & CI/CD, troubleshooting & support. Key Responsibilities: - Platform Administration: - Install, configure, and maintain RedHat OpenShift clusters in an on-premises environment. - Build and orchestrate data pipelines using Apache Airflow. - Implement and manage Delta Lake for ACID-compliant data lake architecture. - Manage ...

We are seeking an experienced Databricks Solution Architect to lead technical solutioning, architecture design, Presales and customer engagements for data engineering, analytics, and AI workloads on the Databricks platform. The ideal candidate will work closely with sales, delivery, and customer teams to craft high-impact solutions, develop proposals, conduct workshops, and support end-to-end presales cycles. Key Responsibilities: Solution Architecture Architect end-to-end data solutions leveraging Databricks Lakehouse Platform for data engineering, streaming, analytics, ML, and governance. Define best practices for data ingestion, transformation, optimization, Delta Lake design, cluster con...

About the Role We are seeking a Architect I Azure Data Engineering with mandatory Unity Catalog hands-on experience. The ideal candidate should have proven exposure on client projects, strong Azure Data Engineering background, and the ability to design and deliver enterprise-scale data solutions. Key Responsibilities Build and maintain data pipelines to enable faster, better, data-informed decision-making through customer enterprise business analytics Collaborate with stakeholders to understand their strategic objectives and identify opportunities to leverage data and data quality Design, develop and maintain large-scale data solutions on Azure cloud platform Implement ETL pipelines using Az...

Job Description: Data Engineer with Databricks Expertise Job Summary We are seeking a highly skilled Data Engineer with Databricks certifications and extensive practical experience working with the Databricks Lakehouse platform and its supporting capabilities. The ideal candidate will possess a robust understanding of AWS services relevant to data engineering and demonstrate proficiency in data pipeline development, programming, data modeling, and governance. Key Responsibilities Design and implement data pipelines using AWS and Databricks. Manage and orchestrate data workflows, ensuring efficient data ingestion processes. Utilize Delta Lake for data storage and management, ensuring secure d...

Job title: Data Engineer Job Location: Kolkata, Pune, Bangalore, New Delhi Experience : 4-13 years Virtual Interview : 28th Nov (Friday) 1. 8+ years with strong Databricks, Spark and Data Migration experience 2. Should have experience of end-to-end migration from AWS Redshift or other RDS to Databricks Lakehouse Platform. Need to have knowledge in Cloud Data Engineering, ETL Modernization, Spark Optimization and SQL-to-PySpark migration. 3. Key Responsibilities: a) Migration Strategy and Execution: analyze the existing DWH/DB architecture, Design & Implement scalable data pipelines in Databricks, SQL Script conversion, etc. b) Development & Optimization: Build Delta Lake tables and Implement...

Job Description: Databricks with AI Key Responsibilities: Build AI driven internal applications using Databricks Python MLflow Unity Catalog Model Serving Design fine tune and deploy custom chatbots trained on private enterprise data vector search retrieval augmentation LLM orchestration Integrate Databricks models with internal web apps APIs and tools already used inside the bank Build pipelines that handle ingestion cleaning indexing and securing sensitive datasets Own the full lifecycle discovery architecture delivery monitoring Work closely with internal stakeholders BI Data Engineering Ops Risk Compliance to bring working AI solutions into production Operate with a solve it first explai...

Role**Databricks Senior Developer Required Technical Skill Set**Databricks, Spark and Data Migration experience Location: Kolkata Experience: 4 years to 10 Years Desired Competencies (Technical/Behavioral Competency) Must-Have** 1. 8+ years with strong Databricks, Spark and Data Migration experience 2. Should have experience of end-to-end migration from AWS Redshift or other RDS to Databricks Lakehouse Platform. Need to have knowledge in Cloud Data Engineering, ETL Modernization, Spark Optimization and SQL-to-PySpark migration. 3. Key Responsibilities: a) Migration Strategy and Execution: analyze the existing DWH/DB architecture, Design & Implement scalable data pipelines in Databricks, SQL ...

Job Title: Databricks Solution Architect Experience: 10+ years About Us At Codvo, we are committed to building scalable, future-ready data platforms that power business impact. We believe in a culture of innovation, collaboration, and growth, where engineers can experiment, learn, and thrive. Join us to be part of a team that solves complex data challenges with creativity and cutting-edge technology. About The Role Senior / Expert Databricks Solutions Architect Job Description We are seeking a highly experienced Solutions Architect to lead the design and delivery of end-to-end data and analytics solutions on the Databricks platform. You will translate complex business needs into scalable, se...

Req ID: 350045 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Databricks Architect to join our team in Bangalore, Karn?taka (IN-KA), India (IN). Job Duties: Role Summary As a Databricks Architect, you will lead the design and implementation of scalable, secure, and high-performance data solutions using the Databricks Lakehouse Platform. You will define architectural standards, guide engineering teams, and collaborate with stakeholders to align data strategies with business goals. Your role will focus on leveraging D...

Role - Azure Data Engineer Location - Bangalore Experience - 6-12 Years We are seeking a highly skilled Senior Azure Data Engineer to design, build, and optimize large-scale data solutions on Microsoft Azure. The ideal candidate will have deep expertise in Databricks , Azure Data Services , and advanced data engineering practices, with a proven ability to lead strategic initiatives and collaborate with cross-functional teams. Key Responsibilities Data Engineering & Architecture Design and implement scalable data pipelines using Databricks Delta Live Tables (DLT) , Structured Streaming , and PySpark . Develop and optimize real-time and batch data processing solutions for high-volume datasets....

Job description Job Summary: We are seeking a talented Data Engineer with strong expertise inAzure , Databricks, specifically in Unity Catalog, PySpark, and SQL, to join our data team. Youll play a key role in building secure, scalable data pipelines and implementing robust data governance strategies using Unity Catalog. Key Responsibilities: Design and implement ETL/ELT pipelines using Databricks and PySpark. Work with Unity Catalog to manage data governance, access controls, lineage, and auditing across data assets. Develop high-performance SQL queries and optimize Spark jobs. Collaborate with data scientists, analysts, and business stakeholders to understand data needs. Ensure data qualit...

As a highly skilled Azure Data Architect with over 12 years of professional experience in data engineering, your role involves end-to-end ownership of data engineering activities to deliver scalable and secure data solutions for advanced analytics and reporting. You will collaborate with business stakeholders, analysts, and architects to gather requirements and design technical solutions. Your responsibilities include: - Collaborating with business stakeholders to gather, analyze, and translate requirements into technical data engineering solutions. - Designing, developing, and maintaining data pipelines and ETL/ELT processes using Azure Data Factory, Databricks (PySpark, Delta Lake), and Sy...

As a Lead Data Analyst with 8+ years of experience located in Mumbai (onsite) and a notice period of 30 days, your role involves the following responsibilities: - Gather, analyze, and interpret large datasets to deliver actionable business insights. - Write efficient SQL and PySpark queries to extract, transform, and validate data. - Work with Unity Catalog in Databricks for secure data management and governance. - Develop, maintain, and optimize Power BI dashboards and reports for business stakeholders. - Collaborate with cross-functional teams to understand reporting requirements and translate them into analytical solutions. - Ensure accuracy, consistency, and security of reporting data ac...

Role Overview: You are expected to have at least 3+ years of professional experience in building and operating production-grade applications and services across the stack, including frontend, backend, and databases. Your strong programming skills in Python and/or Scala and SQL will enable you to write modular, testable, and well-documented code for batch and streaming workloads. You should be well-versed in modern data engineering stacks, including distributed processing tools like Apache Spark (preferably Databricks), PySpark/Scala, orchestration tools such as Azure Data Factory or Apache Airflow, and event-driven patterns with Azure Functions/Logic Apps. Your expertise should also cover st...

**Job Description:** As a Principal Engineer (Data Governance) at Syneos Health, your role is crucial in deploying and configuring Microsoft Purview to establish comprehensive data governance. Your responsibilities include defining and implementing metadata management frameworks aligned with HIPAA, GDPR, and internal data policies, integrating Purview with various systems, partnering with stakeholders to ensure trusted data access, supporting business metric definitions, and collaborating with Privacy, Legal, and Compliance teams for data classification and monitoring. Additionally, you will develop training processes, optimize data governance infrastructure, work on project delivery plans, ...

**Role Overview:** You are required for one of Uplers" client - an AI-first, API-powered Data Platform. They are currently seeking Data Engineers who are passionate about building high-performance data pipelines, products, and analytical pipelines in the cloud to power real-time AI systems. **Key Responsibilities:** - Build scalable ETL/ELT and streaming data pipelines using GCP (BigQuery, Pub/Sub, PySpark, Dataflow, Cloud Storage, Functions) - Orchestrate data workflows with Airflow, Cloud Functions, or Databricks Workflows - Work across batch + real-time architectures that feed LLMs and AI/ML systems - Own feature engineering pipelines that power production models and intelligent agents - ...

As a Data Engineer, you will play a crucial role in designing, developing, and deploying data pipelines using Databricks. Your responsibilities will include: - Designing, developing, and deploying data pipelines using Databricks, focusing on data ingestion, transformation, and loading (ETL) processes. - Maintaining high-quality, scalable, and maintainable Databricks notebooks using Python. - Working with Delta Lake and other advanced features to enhance data processes. - Leveraging Unity Catalog for data governance, access control, and data discovery. - Developing and optimizing data pipelines for improved performance and cost-effectiveness. - Integrating with various data sources such as da...

You will be responsible for the following tasks: - Designing Databricks workspaces and Unity Catalog for multi-tenant environments - Architecting Lakehouse solutions with Delta Lake - Demonstrating expertise in Spark core for real-time and batch pipeline designing - Implementing data modeling techniques - Ensuring security and governance using RBAC and ABAC - Managing data lineage and metadata - Orchestrating workflows using Databricks Workflows - Applying best practices for artifact organization and naming conventions in Databricks Qualifications required for this role: - Minimum of 8 years of experience in Azure DB architecture - Proficiency in designing and implementing Databricks workspa...