351 Unity Catalog Jobs - Page 5

Job Description Job Description: Senior Engineer AI/ML (Databricks Certified) We are seeking a highly skilled AI Engineer with proven experience in developing, deploying, and optimizing AI models using the Databricks AI platform. The ideal candidate will have a strong background in machine learning, distributed data processing, and will be a champion of Databricks platform. Responsibilities ? Generative AI: Experience of LLM-based solutions (LlamaIndex, LangChain, RAG pipelines, or similar frameworks). Ability to integrate GenAI and Agentic AI into business workflows. ? Design and implement end-to-end Generative AI solutions on Databricks, leveraging Unity Catalog, MLflow, Delta Lake, and Ve...

About Gap Inc. Our past is full of iconic moments but our future is going to spark many more. Our brands Gap, Banana Republic, Old Navy and Athleta have dressed people from all walks of life and all kinds of families, all over the world, for every occasion for more than 50 years. But we're more than the clothes that we make. We know that business can and should be a force for good, and it's why we work hard to make product that makes people feel good, inside and out. It's why we're committed to giving back to the communities where we live and work. If you're one of the super-talented who thrive on change, aren't afraid to take risks and love to make a difference, come grow with us. About The...

Role & responsibilities Preferred candidate profile

About BU: SaaSOps manages post-production support and the overall experience of Epsilon PeopleCloud products for our global clients. This function is responsible for product support, incident management, managed operations and the automation of processes. The team has successfully incubated and mainstreamed Site Reliability Engineering (SRE) as a practice, to ensure reliable product operations on a global scale. Plus, the team is actively pioneering the adoption of AI in operations (AIOps) and recently launched AI-driven self-service capabilities to enhance operational efficiency and improve client experiences. Senior Software Engineer is responsible for providing support to Epsilon's home g...

Assistant Vice President Lead Databricks Architect Shift Type: UK Shift Work Model: 5 Days Work From Office Lead the design and delivery of large-scale data engineering solutions on Azure and Databricks Lakehouse . This role focuses on scalable data pipelines, Unity Catalog governance, ML/LLM enablement, and driving engineering excellence. Key Responsibilities Architect, build, and optimize data pipelines using Databricks , ADF , PySpark , and Unity Catalog . Implement data quality, lineage, privacy, and security governance across data assets. Integrate data from multiple sources to support analytics, ML feature stores, and enterprise insights. Operationalize ML models using MLflow and enhan...

Job Description: Data Engineer with Databricks Expertise Job Summary We are seeking a highly skilled Data Engineer with Databricks certifications and extensive practical experience working with the Databricks Lakehouse platform and its supporting capabilities. The ideal candidate will possess a robust understanding of AWS services relevant to data engineering and demonstrate proficiency in data pipeline development, programming, data modeling, and governance. Key Responsibilities Design and implement data pipelines using AWS and Databricks. Manage and orchestrate data workflows, ensuring efficient data ingestion processes. Utilize Delta Lake for data storage and management, ensuring secure d...

Data Scientist Primary Skills Data Science skill - Machine Learning, NLP, and LLMs Databricks Experience- 5 to 8yrs Specialization Data Science Advanced: Generative AI & Databricks Job requirements Job Title: Senior AI Engineer Generative AI & Databricks Experience: 5-8+ Years About the Role We are seeking a Senior AI Engineer with strong expertise in Generative AI (GenAI), Databricks, and end-to-end ML/LLM systems. You will be responsible for designing, building, and deploying intelligent, scalable GenAI solutions integrated into enterprise-grade data and analytics platforms. The ideal candidate combines strong software engineering, MLOps, and LLM engineering experience with the ability to ...

Data Architecture & Analytics Architect and implement scalable ELT/ETL pipelines using Azure Data Factory (ADF). Develop and optimize data processing and analytics workflows in Azure Databricks using PySpark and Delta Lake. Implement Delta Live Tables, Unity Catalog, and Azure Purview for governance, data lineage, and access control. Design and deploy enterprise data models and analytical layers using Azure Synapse Analytics. Enable enterprise reporting and self-service analytics through Power BI integration. Manage both structured and unstructured data using Azure Blob Storage and Azure Data Lake Storage Gen2. Collaborate with data scientists and business teams to enable machine learning an...

Job Description Job Title: Manager - Data Platform Architect About us : With over 200 brands sold in nearly 180 countries, we're the world's leading premium drinks company. Bring your passion and use your curiosity as you explore, collaborate, and innovate to build brands consumers love. Together with passionate people from all over the world, you'll test new ideas, learn and grow, and unlock a brighter, more exciting future. Join us to create a career worth celebrating. About The Function Our Digital and Technology (D&T) team are innovators, delivering ground-breaking solutions that will help shape the future of our iconic brands. Technology touches every part of our business, from the sour...

Job Summary: Our client is building an AI Center of Excellence to standardize and scale AI/ML adoption across the enterprise. The Technical Capability Owner will define AI/ML architectures, tools, guardrails and persona-approved toolsets across AWS and Databricks to ship reliable ML and GenAI solutions. This role bridges AI, enterprise architecture, data science, security, and business teams - driving consistency, governance, and developer enablement. The successful candidate will shape the technical roadmap, establish reusable frameworks, guide platform adoption, and communicate effectively to audiences from engineering guilds to executives. Experience: 812+ years in data/ML platform engine...

Immediate Joiners Only Position: Sr. Azure Data Engineer Technical Skills: 6-9 years of relevant work experience. Fully conversant with big-data processing approaches and schema-on-read methodologies are a must and knowledge of Azure Data Factory / Azure Databricks (PySpark) / Azure Data Lake Storage (ADLS Gen 2) / Azure Synapse and Microsoft Fabric is a must. Good to have an excellent development skills & extensive hand-on development & coding experience in a variety of languages, e.g., Python (compulsory PySpark), SQL, Power BI DAX (good to have), etc. Experience in designing solutions for Cloud Data Warehouse and working with Architect for generic implementation design of ETL / ELT Pipeli...

This vacancy has expired This doesn't mean the journey ends here. Click below to continue your new career path. Job description Purpose The Senior Data Engineer plays a pivotal role in driving the design, development, and optimization of robust, scalable, and high-performance data products and pipelines on Databricks (Spark/Delta Lake/Unity Catalog). This role is critical in enabling a domain-oriented data mesh architecture, ensuring exceptional data quality, governance, reliability, and cost efficiency. As a Senior Data Engineer, you will not only build and maintain complex data solutions but also provide technical provide technical guidance and support to junior engineers and contribute to...

Role Overview: As a Manager - Data Platform Architect at our company, you will play a strategic role in designing, securing, and scaling our global data ecosystem, the Diageo Data Hub (DDH). Your deep expertise in cloud architecture, data frameworks, and security design will be crucial in building a trusted, high-quality, and compliant data platform that powers analytics, AI, and decision-making across markets. Key Responsibilities: - Design and evolve the global data platform architecture (Azure + Databricks + Unity Catalog + Power BI), ensuring scalability, performance, and cost efficiency. - Define cloud architecture standards across compute, storage, and networking layers, leveraging Azu...

Role Overview: As a skilled and experienced Technology Stack Administrator, your primary responsibility will be to manage and optimize the on-premises infrastructure of the company. This includes deploying, configuring, monitoring, and troubleshooting various platforms such as RedHat OpenShift, Apache Spark, Apache Airflow, Delta Lake, Apache Kafka, and Debezium. Your expertise will ensure high availability, performance, and security of these platforms. Key Responsibilities: - Install, configure, and maintain RedHat OpenShift clusters in an on-premises environment. - Build and orchestrate data pipelines using Apache Airflow. - Implement and manage Delta Lake for ACID-compliant data lake arch...

Role Overview: You will be responsible for utilizing Azure cloud based data platforms, specifically leveraging Databricks and Delta Live Tables for data engineering tasks. You will design, build, and maintain robust and scalable automated data pipelines for batch and streaming data ingestion and processing. Additionally, you will design and implement data models and architectures that align with business requirements and support efficient data processing, analysis, and reporting. You will also be utilizing workflow orchestration tools, integrating monitoring and alerting mechanisms, and following Agile principles throughout the project lifecycle. Key Responsibilities: - Proficient in Python,...

You are looking for a Lead Databricks Engineer to take charge of designing, developing, and optimizing modern data engineering and analytics solutions on the Databricks Lakehouse platform. Your expertise in data architecture, ETL/ELT pipeline development, and performance optimization using Databricks (SQL, PySpark, Delta Lake, MLflow) will be crucial. Additionally, your leadership skills in guiding teams through solution design, implementation, and delivery will play a key role. **Key Responsibilities:** - **Databricks Project Leadership** - Lead end-to-end Databricks implementation projects, from requirement gathering to deployment. - Act as the primary technical point of contact for stakeh...

At EY, you'll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we're counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. EY GDS Data and Analytics (D&A) AWS Data Engineer with Databricks As part of our EY-GDS D&A (Data and Analytics) team, we help our clients solve complex business challenges with the help of data and technology. We dive deep into data to extract the greatest value and discover opportunities in key business and functions like Banking, Insurance...

Job Description Summary: Seeking a Data Engineer with expertise in Azure Databricks, Apache Spark (Python), and Unity Catalog to design, develop, and optimize data pipelines, ensuring secure and scalable data governance. Job Description Responsibilities: Develop & Optimize Data Pipelines Build, test, and maintain ETL/ELT data pipelines using Azure Databricks & Apache Spark (PySpark) . Optimize performance and cost-efficiency of Spark jobs. Ensure data quality through validation, monitoring, and alerting mechanisms. Understand cluster types, configuration, and use-case for serverless Implement Unity Catalog for Data Governance Design and enforce access control policies using Unity Catalog. Ma...

Databricks Architect: Lead architecture, design, and implementation of data lakehouse solutions using Databricks, Delta Lake, Unity Catalog, and Apache Spark. Define and enforce architectural best practices for data ingestion, ETL/ELT processing, transformation, governance, and analytics. Oversee the deployment, scaling, configuration, and cost optimization of Databricks environments (across Azure, AWS, or GCP). Design high-availability, resilient pipelines for both streaming and batch data processing at enterprise scale. Implement and manage data governance, privacy, and lineage (Unity Catalog, fine-grained access controls, encryption, audit logging). Guide teams in implementing CI/CD, vers...

Company Description hiReign Innoways is an IT Services, Consulting, and Business Solutions provider dedicated to helping clients build agile and innovative organizations. We specialize in optimizing current operations to enhance efficiency and cost-effectiveness, enabling clients to unlock new potential for growth and transformation. Our customer-focused methodologies and tailored approaches ensure solutions aligned with your domain and technological needs. Collaboration is at the core of our philosophy, as we work closely with clients to analyze challenges, channel expertise, and achieve successful transformation. Role Description This is a full-time hybrid role for a Senior ETL Test Engine...

Experience : 4.00 + years Salary : Confidential (based on experience) Expected Notice Period : 30 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: Beige Bananas) (*Note: This is a requirement for one of Uplers client - Beige Bananas) What do you need for this opportunity Must have skills required: Databrick, Vector, LLM, rag, NLP, Python Beige Bananas is Looking for: Job Title : Senior Data Scientist Company name : Beige Bananas Job location: India (Remote), Mumbai , Bangalore Job Description Company Description Beige Bananas is a rapidly growing pure play AI consulting firm that speci...

Experience : 4.00 + years Salary : Confidential (based on experience) Expected Notice Period : 30 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: Beige Bananas) (*Note: This is a requirement for one of Uplers client - Beige Bananas) What do you need for this opportunity Must have skills required: Databrick, Vector, LLM, rag, NLP, Python Beige Bananas is Looking for: Job Title : Senior Data Scientist Company name : Beige Bananas Job location: India (Remote), Mumbai , Bangalore Job Description Company Description Beige Bananas is a rapidly growing pure play AI consulting firm that speci...

Experience : 4.00 + years Salary : Confidential (based on experience) Expected Notice Period : 30 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: Beige Bananas) (*Note: This is a requirement for one of Uplers client - Beige Bananas) What do you need for this opportunity Must have skills required: Databrick, Vector, LLM, rag, NLP, Python Beige Bananas is Looking for: Job Title : Senior Data Scientist Company name : Beige Bananas Job location: India (Remote), Mumbai , Bangalore Job Description Company Description Beige Bananas is a rapidly growing pure play AI consulting firm that speci...

Experience : 4.00 + years Salary : Confidential (based on experience) Expected Notice Period : 30 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: Beige Bananas) (*Note: This is a requirement for one of Uplers client - Beige Bananas) What do you need for this opportunity Must have skills required: Databrick, Vector, LLM, rag, NLP, Python Beige Bananas is Looking for: Job Title : Senior Data Scientist Company name : Beige Bananas Job location: India (Remote), Mumbai , Bangalore Job Description Company Description Beige Bananas is a rapidly growing pure play AI consulting firm that speci...

Experience : 4.00 + years Salary : Confidential (based on experience) Expected Notice Period : 30 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: Beige Bananas) (*Note: This is a requirement for one of Uplers client - Beige Bananas) What do you need for this opportunity Must have skills required: Databrick, Vector, LLM, rag, NLP, Python Beige Bananas is Looking for: Job Title : Senior Data Scientist Company name : Beige Bananas Job location: India (Remote), Mumbai , Bangalore Job Description Company Description Beige Bananas is a rapidly growing pure play AI consulting firm that speci...