21 Schema Evolution Jobs

We are a stealth-mode firm working on market and transaction-level systems. The work is not consumer-facing, and most of it is not public. We operate with a high bar for correctness, discretion, and long-horizon thinking. Role Description You will work on the design, evaluation, and operation of database systems that support transaction-level analysis, system state tracking, and historical reconstruction under strict correctness constraints. The role focuses on how data is represented, persisted, queried, and evolved over time in systems where accuracy, temporal consistency, and auditability matter more than convenience. Rather than building analytics pipelines or application schemas, the wo...

Role Overview: As a candidate for this role, you would be responsible for the following: Key Responsibilities: - Understanding of Spark core concepts like RDDs, DataFrames, DataSets, SparkSQL, and Spark Streaming. - Experience with Spark optimization techniques. - Deep knowledge of Delta Lake features like time travel, schema evolution, data partitioning. - Ability to design and implement data pipelines using Spark and Delta Lake as the data storage layer. - Proficiency in Python/Scala/Java for Spark development and integrate with ETL process. - Knowledge of data ingestion techniques from various sources (flat files, CSV, API, database). - Understanding of data quality best practices and dat...

Req ID: 350715 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Databricks Eng to join our team in Remote, Mah?r?shtra (IN-MH), India (IN). Implement Delta Lake tables and patterns (bronze/silver/gold, ACID, time travel, schema evolution) for migrated data. Optimize Databricks clusters, jobs, and queries for performance and cost. Implement incremental loads, CDC patterns, and batch schedules for large datasets. Follow coding standards, version control, and CI/CD practices using Git/Azure DevOps. Provide defect fixes a...

Proven expertise with Lakehouse Architecture with Delta Tables – Delta tables, Schema Evolution.Strong expertise in fundamental areas like Spark ecosystems, Data frame API & Spark SQL Python,SQL,Workflows,Unity Catalog, Lakeflow,Lakehouse Federation

Proven expertise with Lakehouse Architecture with Delta Tables – Delta tables, Schema Evolution.Strong expertise in fundamental areas like Spark ecosystems, Data frame API & Spark SQL Python,SQL,Workflows,Unity Catalog, Lakeflow,Lakehouse Federation

As a Data Architect specializing in OLTP & OLAP Systems, you will play a crucial role in designing, optimizing, and governing data models for both OLTP and OLAP environments. Your responsibilities will include architecting end-to-end data models across different layers, defining conceptual, logical, and physical data models, and collaborating closely with stakeholders to capture functional and performance requirements. You will need to optimize database structures for real-time and analytical workloads, enforce data governance, security, and compliance best practices, and enable schema versioning, lineage tracking, and change control. Additionally, you will review query plans and indexing st...

Job Title: Senior SQL Developer Experience: 8+Years Location: Hyderabad Notice Period: Immediate Joiners Only Cab Facility: Available Position Summary We are seeking an experienced SQL Developer with 8+ years of expertise in designing, developing, and optimizing enterprise-level databases. The ideal candidate will have deep knowledge of T-SQL , legacy modernization , and database optimization practices. This role involves collaborating with cross-functional teams to deliver scalable, high-performance, and maintainable data solutions supporting mission-critical business applications. Key Responsibilities Develop, optimize, and maintain complex SQL queries, stored procedures, views, functions,...

As a Senior Data Engineer specializing in Ontology & Knowledge Graph Systems, your primary focus will be on designing and implementing a semantic data layer that harmonizes complex data assets across various domains. You will be responsible for building Palantir-style ontology and knowledge graph systems utilizing open-source technologies to facilitate interpretability, analytics, and AI-driven workflows. Key Responsibilities: - Design and implement scalable ontology or knowledge graph models representing business and technical domains. - Construct and manage data pipelines (batch and streaming) to ingest, transform, and map heterogeneous data into semantic structures. - Develop and optimize...

Role Overview: As a Senior Data Engineer specializing in Ontology & Knowledge Graph Systems, you will be responsible for designing and implementing a semantic data layer that integrates complex data assets from various domains. Your primary focus will be on developing Palantir-style ontology and knowledge graph systems using open-source technologies to facilitate interpretability, analytics, and AI-driven workflows. Key Responsibilities: - Design and implement scalable ontology or knowledge graph models that represent both business and technical domains effectively. - Develop and maintain data pipelines for ingesting, transforming, and mapping heterogeneous data into semantic structures, enc...

**Role Overview:** As a Platform Engineer (Ontology / Data) at Uplers" client, you will be responsible for building the nervous system for the Post-AGI era of engineering. Your main focus will be on designing the ontology and data infrastructure that connects intelligent agents, humans, and organizations. This is a founding R&D team position located onsite in Bengaluru. **Key Responsibilities:** - Design and evolve the ontology core for distributed agent ecosystems. - Build dynamic, scalable, and ethical data pipelines. - Architect context persistence and retrieval mechanisms for agent networks. - Collaborate with AI and system engineers to define data-driven intelligence. **Qualifications R...

Introduction A career in IBM Software means you'll be part of a team that transforms our customer's challenges into industry-leading solutions. We are an infinitely curious team, always seeking new possibilities, and dedicated to creating the world's leading AI-powered, cloud-native software solutions. Our renowned legacy creates endless global opportunities for our network of IBMers. We are a team of deep product experts, ensuring exceptional client experiences, with a focus on delivery, excellence, and obsession over customer outcomes. This position involves contributing to HashiCorp's offerings, now part of IBM, which empower organizations to automate and secure multi-cloud and hybrid env...

Senior Data Engineer (Ontology & Knowledge Graph Systems) We are seeking a Senior Data Engineer to design and implement a semantic data layer that unifies complex data assets across domains. This role focuses on building Palantir-style ontology and knowledge graph systems using open-source technologies to enable interpretability, analytics, and AI-driven workflows. Key Responsibilities Design and implement scalable ontology or knowledge graph models representing business and technical domains. Build and maintain data pipelines (batch and streaming) for ingesting, transforming, and mapping heterogeneous data into semantic structures. Develop and optimize storage and query layers using graph d...

hackajob is collaborating with J.P. Morgan to connect them with exceptional tech professionals for this role. We know that people want great value combined with an excellent experience from a bank they can trust, so we launched our digital bank, Chase, to revolutionise mobile banking with seamless journeys that our customers love. We're already trusted by millions in the US and we're quickly catching up in the United Kingdom - but how we do things here is a little different. We're building the bank of the future from scratch, where you'll have the opportunity to make a real impact. As a Sr Principal Software Engineer in the Back-End Engineer chapter at JPMorgan Chase within the International...

Experience: 6-9 years Location: Chennai, Bengaluru Notice Period: Immediate to 30 Days Job Description Technical Skills: Strong hands-on experience with Apache Spark, PySpark, and Scala. Proficiency in SQL and data manipulation techniques. Experience with Hadoop ecosystem tools (HDFS, Hive, YARN, etc.). Knowledge of cloud platforms (AWS, Azure, or GCP) and managed Spark services (e.g., Databricks, EMR, Glue). Familiarity with data lakehouse concepts, Delta Lake, or Iceberg is a plus. Experience with CI/CD, Git, and workflow orchestration tools (Airflow, Oozie, etc.). Understanding of data modeling, partitioning, and schema evolution strategies. Exposure to containerization (Docker, Kubernete...

As an experienced Data Engineer with 6+ years of experience, your role will involve: - Designing and implementing modern data lakehouse architectures (Delta Lake, or equivalent) on cloud platforms like AWS, Azure, or GCP. - Defining data modeling, schema evolution, partitioning, and governance strategies for high-performance and secure data access. - Owning the technical roadmap for scalable data platform solutions, aligned with enterprise needs and future growth. - Providing architectural guidance and conducting code/design reviews across data engineering teams. - Building and maintaining reliable, high-throughput data pipelines for ingestion, transformation, and integration of structured, ...

JD Data Architect (Microsoft Azure, Microsoft Fabric) Job Title: Data Architect Location: Remote Experience Level: 5+ Years Job type: 6 Months Contract ( with extension) Availability: Immediate (Start Date -November 23 ) Job Profile: The Data Architect (Azure Data Architect or Data Platform Architect) designs and leads the build- out of scalable, AI-ready data solutions using Microsoft Fabric and the Azure data ecosystem. This role connects business goals to data architecture, ensuring platforms are secure, performant, and optimized for analytics and AI use cases. You will define how data flows from raw ingestion (bronze) through transformation (silver) to curated, analytics-ready models (go...

As a Data Engineer specializing in Spark & Delta Lake, your role will involve understanding key Spark concepts such as RDDs, DataFrames, DataSets, SparkSQL, and Spark Streaming. You will also be expected to have experience in optimizing Spark performance and a deep understanding of Delta Lake features like time travel, schema evolution, and data partitioning. Your responsibilities will include designing and implementing data pipelines using Spark and Delta Lake as the data storage layer. Proficiency in Python, Scala, or Java for Spark development and integration with ETL processes is essential. Additionally, you should possess knowledge of data ingestion techniques from various sources such ...

As a Data Architect specializing in OLTP & OLAP Systems, you will play a crucial role in designing, optimizing, and governing data models for both OLTP and OLAP environments. Your responsibilities will include architecting end-to-end data models across different layers, defining conceptual, logical, and physical data models, and collaborating closely with stakeholders to capture functional and performance requirements. Key Responsibilities: - Design, optimize, and govern data models for OLTP and OLAP systems - Architect end-to-end data models across various layers - Define conceptual, logical, and physical data models - Collaborate with stakeholders to capture functional and performance requ...

As a Data Architect with over 6 years of experience, you will be responsible for designing and implementing modern data lakehouse architectures on cloud platforms such as AWS, Azure, or GCP. Your primary focus will be on defining data modeling, schema evolution, partitioning, and governance strategies to ensure high-performance and secure data access. In this role, you will own the technical roadmap for scalable data platform solutions, ensuring they are aligned with enterprise needs and future growth. You will also provide architectural guidance and conduct code/design reviews across data engineering teams to maintain high standards of quality. Your responsibilities will include building an...

Job Description We know that people want great value combined with an excellent experience from a bank they can trust, so we launched our digital bank, Chase, to revolutionise mobile banking with seamless journeys that our customers love. We&aposre already trusted by millions in the US and we&aposre quickly catching up in the United Kingdom but how we do things here is a little different. We&aposre building the bank of the future from scratch, where you&aposll have the opportunity to make a real impact. As a Sr Principal Software Engineer in the Back-End Engineer chapter at JPMorgan Chase within the International Consumer Bank, you will be tasked with the creation and delivery of innovative,...

As a Data Architect specializing in OLTP & OLAP Systems, you will play a crucial role in designing, optimizing, and governing data models for both OLTP and OLAP environments. Your responsibilities will include architecting end-to-end data models across different layers, defining conceptual, logical, and physical data models, and collaborating closely with stakeholders to capture functional and performance requirements. You will need to optimize database structures for real-time and analytical workloads, enforce data governance, security, and compliance best practices, and enable schema versioning, lineage tracking, and change control. Additionally, you will review query plans and indexing st...