351 Unity Catalog Jobs - Page 4

As an AI/ML Engineer, your role will involve translating business requirements into scalable and well-documented AI/ML pipelines using tools like Databricks, Azure AI, and Snowflake. You will design and deploy GenAI-powered applications with pretrained models for tasks such as text generation, summarization, code synthesis, and personalization. Building and orchestrating agentic AI workflows using frameworks like LangChain, OpenAI Agents SDK, and Databricks Genie will be part of your responsibilities, enabling autonomous task execution and multi-agent collaboration. Integrating GenAI models into enterprise applications with Human-in-the-Loop (HITL) validation and feedback loops for productio...

Job Description : YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation. At YASH, we're a cluster of the brightest stars working with cutting-edge technologies. Our purpose is anchored in a single truth - bringing real positive changes in an increasingly virtual world and it drives us beyond generational gaps and disruptions of the future. We are looking forward to hireAzure Databricks Professionals in the following areas : Job description: Senior Databricks Developer -(Pune/Bangalore) Key Responsibilities: Design, d...

Job Description: Senior Data Developer I Location: Gurugram, India Employment Type: Full-Time Experience Level: Mid to Senior-Level Department: Data & Analytics / IT Job Summary We are seeking an experienced Data Developer with expertise in Microsoft Fabric, Azure Synapse Analytics, Databricks, and strong SQL development skills. The ideal candidate will work on end-to-end data solutions supporting analytics initiatives across clinical, regulatory, and commercial domains in the Life Sciences industry. Familiarity with Azure DevOps, and relevant certifications such as DP-700 and Databricks Data Engineer Associate/Professional are preferred. Power BI knowledge is highly preferable to support in...

Job Title: Azure Databricks Architect Job Description We are hiring an experienced Databricks Architect to lead the end-to-end architecture, design, and implementation of scalable data lakehouse platforms. The ideal candidate will have strong experience in Databricks, Delta Lake, Unity Catalog, and large-scale data engineering frameworks. Key Responsibilities: Lead architecture, design, and delivery of Databricks-based data lakehouse solutions. Define & enforce best practices for ingestion, ETL/ELT, transformations, governance & analytics. Manage deployment, scaling, configuration & cost optimization across Azure/AWS/GCP. Architect streaming & batch pipelines for enterprise-scale processing....

Job Title: Senior Data Engineering & Power BI Consultant Experience: 5-7 years Location: Bengaluru Role Overview: We are looking for a highly skilled Senior Data Engineering & Power BI Consultant to design, build, and optimize scalable data solutions. The ideal candidate should have strong hands-on experience with Databricks Unity Catalog, Power BI, and modern data engineering practices, along with the ability to translate complex data into business-ready insights. Key Responsibilities: Design and implement robust data pipelines using Databricks (Delta Lake, PySpark, SQL). Manage and govern data assets through Unity Catalog (UC) defining lineage, access control, and data classification. Inte...

Responsibilities: Design, develop & maintain GCP data pipelines using Data Bricks, Unity Catalog, PySpark, SQL & Terraform. Collaborate with cross-functional teams on CI/CD processes for data solutions.

Role Overview: As a Databricks Architect at NTT DATA, you will lead the design and implementation of scalable, secure, and high-performance data solutions using the Databricks Lakehouse Platform. Your focus will be on leveraging Databricks unified analytics capabilities to build enterprise-grade data platforms that support advanced analytics, machine learning, and real-time data processing. Key Responsibilities: - Define and own the end-to-end architecture of data platforms built on Databricks, including ingestion, transformation, storage, and consumption layers. - Design and implement Lakehouse architectures using Delta Lake, Unity Catalog, and structured streaming. - Architect scalable ETL...

Responsibilities: Design, develop & maintain GCP data pipelines using Data Bricks, Unity Catalog, PySpark, SQL & Terraform. Collaborate with cross-functional teams on CI/CD processes for data solutions.

Why Join Iris Are you ready to do the best work of your career at one of India's Top 25 Best Workplaces in IT industry Do you want to grow in an award-winning culture that truly values your talent and ambitions Join Iris Software one of the fastest-growing IT services companies where you own and shape your success story . About Us At Iris Software, our vision is to be our client's most trusted technology partner, and the first choice for the industry's top professionals to realize their full potential. With over 4,300 associates across India, U.S.A, and Canada, we help our enterprise clients thrive with technology-enabled transformation across financial services, healthcare, transportation &...

We are seeking an experienced Databricks Full Stack Data Engineer with 3-6 years of industry experience. The ideal candidate will have a proven track record of working on live projects. He/she will play a key role in developing and maintaining scalable data solutions using Databricks and related technologies. Key Responsibilities: ? Develop, and deploy end-to-end data pipelines and solutions on Databricks, integrating with various data sources and systems. ? Collaborate with cross-functional teams to understand data, and deliver effective BI solutions. ? Implement data ingestion, transformation, and processing workflows using Spark (PySpark/Scala), SQL, and Databricks notebooks. ? Develop an...

Key Skills The ideal candidate would have the following technical, functional and soft skills: • Technical o Confident using SQL to explore, investigate & understand data in a structured database. Current technologies are: Databricks, DBSQL & Databricks Unity Catalog. o Nice but not essential: capable of reading and understanding SQL data transformation scripts. • Functional o Capable of taking business requirements and translating these into technical data requirements with respect to configuring the correct data access rules. o Some background of working with financial data would be beneficial to understand the finance terminology but you dont need to be an accountant! Responsibilities Bei...

Experience Required: 7+ Years Work Location: Bangalore / Chennai / Hyderabad Role Overview: We are seeking an experienced Databricks Administrator to manage, optimize, and maintain our Databricks platform across multiple environments. The ideal candidate will have a strong background in data engineering infrastructure, cluster management, security, governance, and automation within Databricks and related Azure/AWS ecosystems. Key Responsibilities: Databricks Platform Administration: Manage and maintain Databricks workspaces, clusters, jobs, pools, and libraries. Monitor performance and optimize resource utilization across environments (dev, test, prod). Implement autoscaling, cluster policie...

Data Engineering Lead Analyst Position Overview Evernorth Core Platform Engineering team is looking for a Data Engineer to design, develop, and implement robust data pipelines for Packaged Business Capabilities (PBCs). You'll work closely with data scientists, analysts, and other engineers to ensure high data quality, performance, and availability. The ideal candidate brings hands-on experience working with big data tools and platforms such as Apache Spark and Databricks, has a strong command of Python, and is comfortable managing ETL workflows, DAGs, and orchestration using tools like Jenkins or Airflow. Experience in cloud-native environmentsparticularly AWS and AWS Glue is essential. Abou...

Overview As a data engineering manager, you will be the key technical expert overseeing PepsiCo's data product build & operations and drive a strong vision for how data engineering can proactively create a positive impact on the business. You'll be empowered to create & lead a strong team of data engineers who build data pipelines into various source systems, rest data on the PepsiCo Data Lake, and enable exploration and access for analytics, visualization, machine learning, and product development efforts across the company. As a member of the data engineering team, you will help lead the development of very large and complex data applications into public cloud environments directly impacti...

Role Overview: We are looking for a highly skilled Senior Data Engineering & Power BI Consultant to design, build, and optimize scalable data solutions. The ideal candidate should have strong hands-on experience with Databricks Unity Catalog, Power BI, and modern data engineering practices, along with the ability to translate complex data into business-ready insights. Key Responsibilities: Design and implement robust data pipelines using Databricks (Delta Lake, PySpark, SQL). Manage and govern data assets through Unity Catalog (UC) defining lineage, access control, and data classification. Integrate data from multiple sources (Azure Data Factory, Event Hub, APIs, SQL/NoSQL databases) into th...

Role & responsibilities: Being an SME of the data available in SPOT. Working with the stakeholders to help them define the data they would require from SPOT. Aligning with the SPOT Finance Product Owners in principle, on the sharing of the data the external stakeholders are requesting. Setting up and maintaining the data access policies with the data access management tool. Act as an owner in the diagnosis and resolution of any data queries and issues raised by the external stakeholders for the SPOT data that they have access to.

Job Title: Data & Databricks Practice Lead Location: Remote About Us At Codvo, we are committed to building scalable, future-ready data platforms that power business impact. We believe in a culture of innovation, collaboration, and growth, where engineers can experiment, learn, and thrive. Join us to be part of a team that solves complex data challenges with creativity and cutting-edge technology. Role Summary We are looking for a dynamic and visionary Practice Lead to build and scale our Data & AI capabilities with a strong focus on Databricks, Apache Spark, Iceberg, Azure Data Fabric, Amazon EMR, and Redshift. This role is pivotal in driving Lakehouse architecture adoption, cloud-native mo...

Azure Data Architect (Microsoft Fabric) - JD Overall 10+ years of IT experience Understand the data requirements, source data land scape of the project and architect the solution. Ability to understand the data requirements and come up with the proposed solution components. Hands on experience in designing cost-efficient, fault tolerant and scalable distributed systems on Azure. Understand the data processing requirements like batch computing, stream computing needs and design the solution on Azure technical stack. Design Data Lake, Data Warehouse, experience with Data Modelling Estimate the sizing of the data solution components based on key volumetric statistics. Develop architecture bluep...

Role Overview: You will be responsible for designing and deploying predictive models, building ML pipelines, optimizing model performance, implementing Delta Lake, enabling CI/CD for ML pipelines, and troubleshooting issues in Spark Jobs and Databricks Environment. As a Senior Programmer Analyst in AI-ML Engineering, you are expected to have strong technical expertise and experience in Python, PySpark, MLflow, and predictive modeling techniques. Key Responsibilities: - Design and deploy predictive models (e.g., forecasting, churn analysis, fraud detection) using Python/SQL, Spark MLlib, and Databricks ML. - Build end-to-end ML pipelines (data ingestion, feature engineering, model training, d...

Role: Data Architect Location: Kolkata Experience: 12 Plus Years Required Technical Skill Set**Databricks, AWS ,RedshiftEDW DB to Databricks Lakehouse Platform on AWS Desired Experience Range**12+ years with 4-5+ years in Cloud Data Architecture, Databricks and AWS Must-Have: Architecture & Strategy: Define target architecture, conduct gap analysis, ingestion, storage, transformation, and consumption layers using Databricks best practices. Data Modeling & Design: Translate existing DWH/DB star/snowflake models to Databricks-optimized Delta Lake models; implement SCD, fact/dimension modeling, compliance, partitioning, etc. Governance, Security & Compliance: Implement data governance using Uni...

Role: Databricks Senior Developer Location: Kolkata Experience: 8 Plus Years Role**Databricks Senior Developer Required Technical Skill Set**Databricks, Spark and Data Migration experience Desired Competencies (Technical/Behavioral Competency) Must-Have** 1. 8+ years with strong Databricks, Spark and Data Migration experience 2. Should have experience of end-to-end migration from AWS Redshift or other RDS to Databricks Lakehouse Platform. Need to have knowledge in Cloud Data Engineering, ETL Modernization, Spark Optimization and SQL-to-PySpark migration. 3. Key Responsibilities: a) Migration Strategy and Execution: analyze the existing DWH/DB architecture, Design & Implement scalable data pi...

Responsibilities: * Design, develop & maintain Databricks solutions using PySpark within Unity Catalog framework. * Collaborate with cross-functional teams on data engineering projects.

JD for Unity Catalog and Databricks Engineer Role C2H Experience-6 to 9yrs overall, Also experience in Pyspark, Databricks Location-PAN INDIA(except Hyderabad and Chennai as preferred location) NP-Immediate/15 days Hybrid-2 or 3 days WFO Unity Catalog Adoption Data Engineer 3-6 Years, PySpark, Databricks, Unity Catalog JD Design, develop, and maintain efficient and scalable data pipelines using PySpark, Databricks. Utilize Databricks to orchestrate and automate data workflows. Implement and manage data storage solutions using Unity Catalog for effective data governance. Collaborate with data scientists, analysts, and business stakeholders to ensure smooth data flow and integration. Write opt...

As a Data Engineer, your role will involve designing and implementing streaming data pipelines that integrate Kafka with Databricks using Structured Streaming. You will be responsible for architecting and maintaining the Medallion Architecture with well-defined Bronze, Silver, and Gold layers. Your tasks will include implementing efficient ingestion using Databricks Autoloader for high-throughput data loads and working with large volumes of structured and unstructured data to ensure high availability and performance. Additionally, you will apply performance tuning techniques such as partitioning, caching, and cluster resource optimization. Collaboration with cross-functional teams including ...

Site Name: Bengaluru Luxor North Tower Posted Date: Nov 3 2025 Role Overview: The Senior Lead Data Engineer will operate within a matrixed product team design, holding responsibility for the technical solution design, implementation, and ongoing enhancement of products and systems developed by Medical Digital and Tech. In alignment with Agile Ways of Working, DevSecOps principles, and requirements for Compliance and Digital Certainty, this role will collaborate closely with a Product Manager, adhering to agile and DevOps methodologies. The Senior Lead Data Engineer will serve as a T-Shaped engineer, demonstrating both deep expertise and broad proficiency across essential engineering competen...