351 Unity Catalog Jobs - Page 2

**Role Overview:** You are required for one of Uplers" client - an AI-first, API-powered Data Platform. They are currently seeking Data Engineers who are passionate about building high-performance data pipelines, products, and analytical pipelines in the cloud to power real-time AI systems. **Key Responsibilities:** - Build scalable ETL/ELT and streaming data pipelines using GCP (BigQuery, Pub/Sub, PySpark, Dataflow, Cloud Storage, Functions) - Orchestrate data workflows with Airflow, Cloud Functions, or Databricks Workflows - Work across batch + real-time architectures that feed LLMs and AI/ML systems - Own feature engineering pipelines that power production models and intelligent agents - ...

As a Data Engineer, you will play a crucial role in designing, developing, and deploying data pipelines using Databricks. Your responsibilities will include: - Designing, developing, and deploying data pipelines using Databricks, focusing on data ingestion, transformation, and loading (ETL) processes. - Maintaining high-quality, scalable, and maintainable Databricks notebooks using Python. - Working with Delta Lake and other advanced features to enhance data processes. - Leveraging Unity Catalog for data governance, access control, and data discovery. - Developing and optimizing data pipelines for improved performance and cost-effectiveness. - Integrating with various data sources such as da...

You will be responsible for the following tasks: - Designing Databricks workspaces and Unity Catalog for multi-tenant environments - Architecting Lakehouse solutions with Delta Lake - Demonstrating expertise in Spark core for real-time and batch pipeline designing - Implementing data modeling techniques - Ensuring security and governance using RBAC and ABAC - Managing data lineage and metadata - Orchestrating workflows using Databricks Workflows - Applying best practices for artifact organization and naming conventions in Databricks Qualifications required for this role: - Minimum of 8 years of experience in Azure DB architecture - Proficiency in designing and implementing Databricks workspa...

Role Overview: As an Azure Data Architect at Hitachi Solutions, you will be responsible for designing and implementing end-to-end data solutions on Microsoft Azure. Your role will involve developing scalable and efficient data architectures to support large-scale data processing and analytics workloads. You will work closely with business and technical teams to understand data needs and translate them into robust, scalable data architecture solutions. Additionally, you will provide expertise and leadership to the development team implementing data engineering solutions and collaborate with stakeholders to ensure data architectures align with business goals. Key Responsibilities: - Design and...

As a Data Governance Specialist at Tiger Analytics, you will play a crucial role in ensuring the standardization of data and effective implementation of enterprise-wide data governance policies and procedures. Your responsibilities will include: - Over 4 years of experience in Data Governance or Data Management, with a solid understanding of data governance principles and processes. - Strong background in data management, including knowledge of data collection, ingestion, usage, quality, curation, and stewardship. - Proficiency in any data governance tool(s) such as Informatica, Collibra, Alation, Atlan, or similar. - Working knowledge of Unity Catalog, Purview, with intermediate to advanced...

TCS is hiring... Role: Azure Data Modeler and Architect EXP: 8 - 12 YEARS LOCATION: Kolkata Job Description We are seeking a highly experienced and visionary Azure Data Modeler and Architect for designing, implementing, and maintaining data models that support our business objectives and to design, implement, and manage robust, scalable, and secure data solutions on the Microsoft Azure platform. Lead the design and development of end-to-end data solutions on Microsoft Azure, including data ingestion, storage, processing, and consumption layers. Define and enforce data architecture principles, standards, and best practices across the organization. Develop and maintain the enterprise data road...

TCS invites application for Walkin interview @TCS Noida Date: 10 May 25 Mode: Physical Walkin drive (face to face) Registration time: 9:30 A.M. to 12:30 PM Venue: Tata Consultancy Services-Lucerna Tower, Plot A2B, IT/ITES building in Sector 125 Noida Greater Noida Expressway Noida, Uttar Pradesh 201303- HR Contact Pooja Talreja Joining Location :PAN india Role: Azure admin role Experience : 4+ years JD: Deployment through Terraform,Azure Administration, DataFactory, DataBricks, Active Directory, Identity,Unitycatalog, Terraform, Mechine leaning, AI and Access Management Technical/Functional Skills - 3+ years of prior product/technical support customer facing experience Must have good knowled...

Role Overview: As a Senior Data Engineer at Intuita, you will be a key member of a growing consultancy, leading technical engineering projects within talented teams. Your role will involve working on multiple projects in fast-paced environments, handling both on-prem and cloud-based architectures with a focus on data engineering, development, design, and prototyping. You are expected to mentor junior engineers, lead technical aspects of projects, and collaborate with clients to deliver sustainable and top-notch data solutions. Your ability to work independently and collaboratively, tackle complex technical challenges, and drive successful client engagements will be crucial. Key Responsibilit...

As an experienced professional in software development, you will be responsible for leading and contributing to the design and development of cloud-native solutions using technologies such as C#, .Net, Azure, AWS, Google Cloud Platform, Terraform, Pulumi, Ansible, Chef, Docker, Kubernetes, Databricks, Apache Airflow, and more. Your role will involve working on infrastructure as code, configuration management, containerization, orchestration, and data security while adhering to compliance standards such as HIPPA and SOC 2. Key Responsibilities: - Lead software development projects with progressively increasing responsibilities - Design and build cloud-native solutions using C#, .Net, Azure, A...

Overview Role Overview We are looking for a seasoned Data Architect with strong expertise in Databricks to lead the design, development, and optimization of scalable data platforms and analytics solutions. The role involves defining end-to-end data architecture, building cloud-native data pipelines, and enabling advanced analytics and AI workloads for enterprise environments. Key Responsibilities Define enterprise data architecture, including data ingestion, transformation, storage, governance, and consumption layers. Lead the design and implementation of Databricks Lakehouse architecture, Delta Lake, Unity Catalog, and optimized ETL/ELT pipelines. Develop scalable data models, metadata fram...

Job Title: Databricks Architect Experience: 10 to 15 Years Location: Chennai / Bangalore / Hyderabad Note :LinkedIn Profile: Mandatory Notice Period: Looking for candidates who can join on or before 15th December Drop your cv - 8668072276 Job Description We are seeking an experienced Databricks Architect with strong expertise in designing and implementing scalable data solutions. The ideal candidate should possess deep knowledge of Databricks architecture, the Medallion framework, Delta Lake, and Unity Catalog, along with hands-on experience in PySpark and SQL. Key Responsibilities Design and implement end-to-end data solutions using Databricks and the Medallion architecture . Build, optimiz...

Job Overview Primary Responsibilities Design, develop, and maintain data lakes and data pipelines on AWS using ETL frameworks and Databricks. Integrate and transform large-scale data from multiple heterogeneous sources into a centralized data lake environment. Implement and manage Delta Lake architecture using Databricks Delta or Apache Hudi. Develop end-to-end data workflows using PySpark, Databricks Notebooks, and Python scripts for ingestion, transformation, and enrichment. Design and develop data warehouses and data marts for analytical workloads using Snowflake, Redshift, or similar systems. Design and evaluate data models (Star, Snowflake, Flattened) for analytical and transactional sy...

Role & responsibilities Design scalable and secure Databricks platform architectures. - Define best practices for data ingestion, transformation, and ML workflows. - Lead architectural reviews and provide guidance on Delta Lake, Unity Catalog, etc. - Collaborate with customer IT and data teams to align Databricks architecture with Allianz standards and requirements. - Ensure integration with cloud-native services (e.g., Azure/AWS/GCP) and third-party tools. Preferred candidate profile Total 8+ years industry Experience and 4+ Year's experience In Databricks

NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Databricks Architect to join our team in Bangalore, Karntaka (IN-KA), India (IN). Job Duties: Role Summary As a Databricks Architect, you will lead the design and implementation of scalable, secure, and high-performance data solutions using the Databricks Lakehouse Platform. You will define architectural standards, guide engineering teams, and collaborate with stakeholders to align data strategies with business goals. Your role will focus on leveraging Databricks unifie...

As a Data Engineer at our company, you will be responsible for building and maintaining secure, scalable data pipelines using Databricks and Azure. Your role will involve handling ingestion from diverse sources such as files, APIs, and streaming data, performing data transformation, and ensuring quality validation. Additionally, you will collaborate closely with subsystem data science and product teams to ensure ML readiness. To excel in this role, you should possess the following skills and experience: - Technical proficiency in Notebooks (SQL, Python), Delta Lake, Unity Catalog, ADLS/S3, job orchestration, APIs, structured logging, and IaC (Terraform). - Delivery expertise in trunk-based d...

Overview With more than 45,000 employees and partners worldwide, the Customer Experience and Success (CE&S) organization is on a mission to empower customers to accelerate business value through differentiated customer experiences that leverage Microsoft's products and services, ignited by our people and culture. We drive cross-company alignment and execution, ensuring that we consistently exceed customers expectations in every interaction, whether in-product, digital, or human-centered. CE&S is responsible for all up services across the company, including consulting, customer success, and support across Microsoft's portfolio of solutions and products. Join CE&S and help us accelerate AI tra...

Experience: 6+ Years Location: Bangalore Notice Period: Immediate Joiners JD: Azure Data Engineer Unity Catalog ADF Data Governance ETL/ELT

You will be responsible for developing highly scalable applications in Core Python. Additionally, you will need to have experience working with any of the Python web frameworks such as Django, Flask, or Fast API. You should also be proficient in working with SQL for running data analytics tasks and queries. Exposure to JavaScript technologies, preferably React, is required. Familiarity with Azure Databricks environment components such as PySpark, notebooks, integrate repos, job workflows, delta lake, and Unity catalog is essential. Moreover, you should have exposure to various interconnected Azure components like Functions, App Service, and Containers. Knowledge of the Financial domain, part...

Job Title: Databricks Architect Location: Chennai/Hyderabad/Bangalore Experience: 1015 years of overall experience and 5+ years in Data Architecture Budget: Open to discuss Notice Period : Immediate joiner/ Serving notice with less than 60 days/Notice is less than 60 days About the Role We are seeking a seasoned Databricks Architect with 1015 years of overall experience and 5+ years in Data Architecture to lead the design and implementation of scalable, cloud-native data platforms. You will drive technical strategy, define Lakehouse architecture standards, and guide engineering teams in building high-performance data solutions. Key Responsibilities Architect and implement enterprise-scale da...

Experience:2-5 years Location: Bengaluru Job Description Data Engineer Role Overview: We are seeking a Data Engineer to support the design, development, and implementation of our Data Observability & Monitoring solution. The engineer will build data pipelines to capture metrics from Azure Monitor, Databricks, Purview, and other APIs, and integrate them into Delta Lake for reporting via Power BI/React dashboards. Responsibilities: Develop and maintain scalable data pipelines using Databricks (PySpark, Delta Lake). Integrate data from multiple APIs (Azure Monitor, Azure Cost Management, Log Analytics, Purview). Implement ETL/ELT processes for structured/unstructured data. Ensure data quality, ...

Role & responsibilities 9+ years of overall Experience as Tech Lead in design, build, and maintain the infrastructure for an organization's data, ensuring it is reliable, accessible, and optimized for use by data scientists and analysts. Create and maintain scalable data pipelines, databases, and data warehouses to handle large volumes of data from various sources. Implement data cleansing, validation, and quality checks to ensure the data is accurate and trustworthy. Monitor and tune performance of databases and data processing tasks to ensure efficiency and speed. Work with data scientists, analysts, and other teams to understand their data requirements and make data accessible for their u...

5+ Years of over all experience as Data engineer with required skills in Pyspark, Spark SQL, Databricks, Data Governance Unity Catalog,, Python Pandera Framework, Rest API Frameworks Design and build data infrastructure: Create and maintain scalable data pipelines, databases, and data warehouses to handle large volumes of data from various sources. Ensure data quality and reliability: Implement data cleansing, validation, and quality checks to ensure the data is accurate and trustworthy. Optimize data systems: Monitor and tune performance of databases and data processing tasks to ensure efficiency and speed. Collaborate with stakeholders: Work with data scientists, analysts, and other teams ...

As an experienced AI Platform Engineer at Standard Chartered Bank, your role will involve designing, developing, and maintaining a hybrid AI Platform across multi-cloud and on-premises environments. You will be responsible for building an AI platform that enables real-time machine learning and GenAI at scale, along with governance and security frameworks. Key Responsibilities: - Design and deliver hybrid AI Platform. - Develop and maintain scalable, efficient, and reliable data and AI pipelines. - Collaborate with data scientists, data engineers, and central data governance team to align with a standardized data strategy. - Design and implement MLOps and LLMOps framework. - Implement automat...

As a Data Engineer at RBHU, you will play a crucial role in developing data-driven solutions to empower decision-making. Working at the intersection of Data, AI, and Analytics, you will be responsible for maintaining and optimizing ETL/ELT pipelines using Databricks. Your key responsibilities will include: - Developing, maintaining, and optimizing ETL/ELT pipelines using Databricks. - Integrating data from multiple sources into scalable and reliable data solutions. - Implementing data transformations, cleansing, and enrichment processes. - Collaborating closely with data analysts, data scientists, and business teams to deliver analytics-ready datasets. - Ensuring data quality, performance, a...

Qorvo (Nasdaq: QRVO) supplies innovative semiconductor solutions that make a better world possible. We combine product and technology leadership, systems-level expertise and global manufacturing scale to quickly solve our customers most complex technical challenges. Qorvo serves multiple high-growth segments of large global markets, including consumer electronics, smart home/IoT, automotive, EVs, battery-powered appliances, network infrastructure, healthcare and aerospace/defense. Visit www.qorvo.com to learn how our innovative team is helping connect, protect and power our planet. As a Systems Data Engineer, you will be part of the EBS Reporting Team under Qorvo's IT Enterprise Business App...