205 Unity Catalog Jobs - Page 4

As a Data Engineer, you will be responsible for the following: - Designing, developing, and deploying data pipelines using Databricks, which includes data ingestion, transformation, and loading (ETL) processes. - Developing and maintaining high-quality, scalable, and maintainable Databricks notebooks using Python. - Working with Delta Lake and other advanced features to ensure efficient data processing. - Leveraging Unity Catalog for data governance, access control, and data discovery. - Developing and optimizing data pipelines for improved performance and cost-effectiveness. - Integrating with various data sources such as databases, cloud storage (Azure Blob Storage, ADLS, Synapse), and API...

Inviting applications for the role of Lead Consultant- Databricks Developer ! In this role, the Databricks Developer is responsible for solving the real world cutting edge problem to meet both functional and non-functional requirements. Responsibilities Design and develop scalable data pipelines using Databricks ( PySpark /SQL/Delta Live Tables). Implement ETL/ELT frameworks leveraging the Lakehouse (Bronze, Silver, Gold) architecture. Implement and manage data governance using Unity Catalog to ensure secure access, compliance, and centralized management of data, users, and permissions across the Databricks Lakehouse. Optimize data models, queries, and workflows for scalability, cost, and pe...

Inviting applications for the role of Lead Consultant- Databricks Developer ! In this role, the Databricks Developer is responsible for solving the real world cutting edge problem to meet both functional and non-functional requirements. Responsibilities Design and develop scalable data pipelines using Databricks ( PySpark /SQL/Delta Live Tables). Implement ETL/ELT frameworks leveraging the Lakehouse (Bronze, Silver, Gold) architecture. Implement and manage data governance using Unity Catalog to ensure secure access, compliance, and centralized management of data, users, and permissions across the Databricks Lakehouse. Optimize data models, queries, and workflows for scalability, cost, and pe...

As a Software Engineer III at JPMorgan Chase within the Corporate Data Services, you will be a crucial part of an agile team that designs and delivers trusted market-leading technology products. Your role involves executing software solutions, design, development, and technical troubleshooting with the ability to think innovatively. You will be accountable for creating secure and high-quality production code, maintaining algorithms, and producing architecture and design artifacts for complex applications. Additionally, you will gather, analyze, and synthesize data sets to drive continuous improvement and contribute to software engineering communities of practice. Key Responsibilities: - Exec...

Role Overview: Radius Intelligent Automation and Intuita are establishing an Offshore Delivery Centre (ODC) in Bangalore, India, in partnership to lead technical engineering projects and deliver sustainable data solutions. As a Senior Data Engineer, you will play a key role in designing and leading scalable data solutions using cloud-native technologies, mentoring junior engineers, and collaborating with clients to deliver best-in-class data solutions. Your ability to work independently and collaboratively, combined with deep technical skills in data engineering, will drive the success of engagements and build trusted relationships with clients. Key Responsibilities: - Design and lead delive...

Role: Data Architect Experience: 8-15 years Location: Bangalore, Chennai, Gurgaon, Pune, and Kolkata Work Mode: Hybrid Mandatory Skills: Python, Pyspark, SQL, ETL, Pipelines, Azure Databricks, Azure Data Factory, & Architect Designing. Primary Roles and Responsibilities: Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack Ability to provide solutions that are forward-thinking in data engineering and analytics space Collaborate with DW/BI leads to understand new ETL pipeline development requirements. Triage issues to find gaps in existing pipelines and fix the issues Work with business to understand the need in reporting layer and develop data model to fulfill rep...

Role: Data Architect Experience: 8-15 years Location: Bangalore, Chennai, Gurgaon, Pune, and Kolkata Work Mode: Hybrid Mandatory Skills: Python, Pyspark, SQL, ETL, Pipelines, Azure Databricks, Azure Data Factory, & Architect Designing. Primary Roles and Responsibilities: Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack Ability to provide solutions that are forward-thinking in data engineering and analytics space Collaborate with DW/BI leads to understand new ETL pipeline development requirements. Triage issues to find gaps in existing pipelines and fix the issues Work with business to understand the need in reporting layer and develop data model to fulfill rep...

Role: Data Architect Experience: 8-15 years Location: Bangalore, Chennai, Gurgaon, Pune, and Kolkata Work Mode: Hybrid Mandatory Skills: Python, Pyspark, SQL, ETL, Pipelines, Azure Databricks, Azure Data Factory, & Architect Designing. Primary Roles and Responsibilities: Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack Ability to provide solutions that are forward-thinking in data engineering and analytics space Collaborate with DW/BI leads to understand new ETL pipeline development requirements. Triage issues to find gaps in existing pipelines and fix the issues Work with business to understand the need in reporting layer and develop data model to fulfill rep...

Overview As a data engineering manager, you will be the key technical expert overseeing PepsiCo's data product build & operations and drive a strong vision for how data engineering can proactively create a positive impact on the business. You'll be empowered to create & lead a strong team of data engineers who build data pipelines into various source systems, rest data on the PepsiCo Data Lake, and enable exploration and access for analytics, visualization, machine learning, and product development efforts across the company. As a member of the data engineering team, you will help lead the development of very large and complex data applications into public cloud environments directly impacti...

As an Azure DB Architect with 8+ years of experience, your role will involve: - Designing Databricks workspaces and Unity Catalog for multi-tenant environments - Architecting Lakehouse solutions with Delta Lake - Demonstrating expertise in Spark core for real-time and batch pipeline designing - Implementing data modelling, security & governance using RBAC and ABAC - Ensuring data lineage and metadata management - Orchestrating workflows using Databricks Workflows - Applying best practices for artifact organization and naming conventions in Databricks Qualifications required for this role include: - Minimum of 10 years of experience in the field - Deep understanding of AWS services such as Re...

Role Overview: As an Azure Data Architect at Hitachi Solutions, you will be responsible for designing and implementing end-to-end data solutions on Microsoft Azure. Your role will involve developing scalable and efficient data architectures to support large-scale data processing and analytics workloads. You will work closely with business and technical teams to understand data needs and translate them into robust data architecture solutions. Additionally, you will optimize cloud-based data infrastructure for performance, cost-effectiveness, and scalability. Key Responsibilities: - Design and implement end-to-end data solutions on Microsoft Azure, including data lakes, data warehouses, and ET...

As an experienced professional with 3+ years of experience in building and operating production-grade applications and services across the stack, you will be responsible for the following key responsibilities: - Demonstrating strong programming skills in Python and/or Scala and SQL to write modular, testable, and well-documented code for batch and streaming workloads. - Hands-on experience with modern data engineering stacks including: - Distributed processing using Apache Spark (Databricks preferred), PySpark/Scala. - Orchestration with Azure Data Factory or Apache Airflow; implementing event-driven patterns with Azure Functions/Logic Apps. - Working with storage & formats such as Delta Lak...

As a Principal Engineer (Data Governance) at Syneos Health, you will play a crucial role in deploying and configuring Microsoft Purview to establish end-to-end data governance for structured and unstructured clinical and healthcare datasets. Your responsibilities will include: - Defining and implementing metadata management frameworks and data stewardship models aligned with HIPAA, GDPR, and internal data privacy policies. - Integrating Purview with Azure Synapse, Databricks, Azure Data Factory, and various production systems for metadata harvesting, lineage tracking, and compliance auditing. - Collaborating with clinical researchers, data scientists, and business analysts to ensure governed...

Role Overview: You should have over 4 years of experience in Data Governance or Data Management, with a solid understanding of data governance principles and processes. Your background in data management should include knowledge of data collection, ingestion, usage, quality, curation, and stewardship. You should be skilled at collaborating with both business and technical teams to ensure the standardization of data of any type and the effective implementation of enterprise-wide data governance policies and procedures. Your ability to articulate a problem, analyze it, and present the findings is crucial for this role. Key Responsibilities: - Proficiency in any data governance tool(s) such as ...

Face to Face Drive - Azure Data Engineer - 25th August Location - Bangalore Role: Azure Data Engineer Openings: 5 Level: Senior Consultant (67 years experience) Skills Required: ADF, ADB, Python Availability: Ready to join immediately Work from Office Job Description: We are looking for a skilled and proactive Data Platform Engineer to join our data platform team. The ideal candidate should have hands-on experience with Databricks administration, Unity Catalog, and Azure platform fundamentals. Experience with Infrastructure-as-Code (IaC) using Terraform is a plus, but a willingness to learn and adopt IaC practices is essential.

Immediate Openings for Sr Data Engineer for MNC JD: Job Location : Hyderabad Exp: 10 to 15yrs Must have (all levels): Proficiency in programming languages such as Python, SQL, and experience with big data technologies like Hadoop, Spark, and Kafka. Experience with cloud platforms (e.g., AWS, Azure, GCP) and data storage solutions (e.g., Databricks, BigQuery, Snowflake). Experience with CI/CD processes and tools, including Azure DevOps, Jenkins, and Git, to ensure smooth and efficient deployment of data solutions. Familiarity with APIs to push and Pull data from data systems and Platforms. Familiarity with understanding software architecture High level Design document and translating them to ...

Role : GCP Architect Job Description Role & responsibilities : We have an urgent requirement for a GCP Architect, as per below JD. We are open for either contract or permanent position with us: Overall 8-10 years of experience in data engineering and AI stack 4-6 years of experience in architecting modern data warehousing solutions on Google Hands-on proficiency : Google BQ, Google Looker, Google GCS, Cloud run, Vertex Working knowledge of Databricks and Databricks Unity Catalog (GCP experience preferred) Experience in design and build solution on Vertex AI RAG, Evaluation, Agent builder for LLM apps ML flow ops with vertex AI pipelines, Model registry, CI/CD overview Experience in working w...

Job Title: Big Data Architect / Databricks Architect Company Overview: At Codvo, software and people transformations go hand-in-hand. We are a global empathy-led technology services company. Product innovation and mature software engineering are part of our core DNA. Respect, Fairness, Growth, Agility, and Inclusiveness are the core values that we aspire to live by each day. We continue to expand our digital strategy, design, architecture, and product management capabilities to offer expertise, outside-the-box thinking, and measurable results. The Role We are seeking an experienced Big Data Architect with a specialization in Databricks to design the sophisticated data solutions that drive bu...

Role Overview: As a Data Engineer at our company, you will be responsible for building and maintaining secure, scalable data pipelines using Databricks and Azure. Your role will involve handling ingestion from diverse sources such as files, APIs, and streaming data, performing data transformation, and ensuring quality validation. Additionally, you will collaborate closely with subsystem data science and product teams to ensure ML readiness. Key Responsibilities: - Technical proficiency in Notebooks (SQL, Python), Delta Lake, Unity Catalog, ADLS/S3, job orchestration, APIs, structured logging, and IaC (Terraform). - Delivery expertise in trunk-based development, TDD, Git, and CI/CD for notebo...

As a Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines and ETL workflows for processing large-scale structured/unstructured data. Your expertise in AWS Data Services (S3, Workflows, Databricks, SQL), big data processing, real-time analytics, and cloud data integration is crucial for this role. Additionally, your experience in Team Leading will be valuable. Key Responsibilities: - Redesign optimized and scalable ETL using Spark, Python, SQL, UDF - Implement ETL/ELT Databricks workflows for structured data processing - Create Data quality checks using Unity Catalog - Drive daily status calls, sprint planning meetings - Ensure security, quality, an...

Inviting applications for the role of Lead Consultant- Databricks Developer ! In this role, the Databricks Developer is responsible for solving the real world cutting edge problem to meet both functional and non-functional requirements. Responsibilities Design and develop scalable data pipelines using Databricks ( PySpark /SQL/Delta Live Tables). Implement ETL/ELT frameworks leveraging the Lakehouse (Bronze, Silver, Gold) architecture. Implement and manage data governance using Unity Catalog to ensure secure access, compliance, and centralized management of data, users, and permissions across the Databricks Lakehouse. Optimize data models, queries, and workflows for scalability, cost, and pe...

As a Databricks Architect at NTT DATA, your role involves leading the design and implementation of scalable, secure, and high-performance data solutions using the Databricks Lakehouse Platform. You will define architectural standards, guide engineering teams, and collaborate with stakeholders to align data strategies with business goals. Your main focus will be leveraging Databricks unified analytics capabilities to build enterprise-grade data platforms supporting advanced analytics, machine learning, and real-time data processing. Key Responsibilities: - Define and own the end-to-end architecture of data platforms on Databricks, covering ingestion, transformation, storage, and consumption l...

Job Title: Data/ML Platform Engineer Location: Gurgaon, Pune, Bangalore, Chennai, Bhopal, Jaipur, Hyderabad (Work from office) Notice Period: ImmediateiSource Services is hiring for one of their client for the position of Data/ML Platform Engineer. As a Data Engineer you will be relied on to independently develop and deliver high-quality features for our new ML Platform, refactor and translate our data products and finish various tasks to a high standard. Youll be part of the Data Foundation Team, which focuses on creating and maintaining the Data Platform for Marktplaats. 5 years of hands-on experience in using Python, Spark,Sql. Experienced in AWS Cloud usage and management. Experience wit...

As a Senior Data Engineer (Azure MS Fabric) at Srijan Technologies PVT LTD, located in Gurugram, Haryana, India, you will be responsible for designing and developing scalable data pipelines using Microsoft Fabric. Your primary focus will be on developing and optimizing data pipelines, including Fabric Notebooks, Dataflows Gen2, and Lakehouse architecture for both batch and real-time ingestion and transformation. You will collaborate with data architects and engineers to implement governed Lakehouse models in Microsoft Fabric, ensuring data solutions are performant, reusable, and aligned with business needs and compliance standards. Key Responsibilities: - Designing and developing scalable da...

Req ID: 341055 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Databricks Architect to join our team in Bangalore, Karn?taka (IN-KA), India (IN). Databricks Data Platform - Architect Job Description Role Summary As a Databricks Architect , you will lead the design and implementation of scalable, secure, and high-performance data solutions using the Databricks Lakehouse Platform. You will define architectural standards, guide engineering teams, and collaborate with stakeholders to align data strategies with business g...