48 Delta Tables Jobs

Proven expertise with Lakehouse Architecture with Delta Tables – Delta tables, Schema Evolution.Strong expertise in fundamental areas like Spark ecosystems, Data frame API & Spark SQL Python,SQL,Workflows,Unity Catalog, Lakeflow,Lakehouse Federation

Azure Data Factory, Azure Databricks, Microsoft Fabric, PySpark, Spark, SQL, Delta Tables, JSON, API, Medallion Architecture, Large-Scale Performance Optimization, Multidimensional Modeling, Azure Analysis Services (AAS), OLAP (Online Analytical Processing) Cubes, DevOps Collaboration Description GSPANN is hiring a Senior Data Engineer to design, develop, and optimize scalable data solutions. The role requires expertise in Azure Data Factory, Azure Databricks, PySpark, Delta Tables, and advanced data modeling, along with skills in performance optimization, API integrations, DevOps, and data governance. Location: Gurugram / Hyderabad Role Type: Full Time Published On: 12 August 2025 Experienc...

Job Title AWS Data Senior Total IT Experience (in Yrs.) 7 to 11 ; Location - Pune Key words to search in resume AWS, glue, S3 , ETL Developer, Pyspark Developer Technical/Functional Skills -MUST HAVE SKILLS Knowledge of broad AWS Services, Experience in Backend development/maintenance preferably using PySpark/Python, Awareness of aws cost calculations. Troubleshooting abilities. Secondary Skills Data Management solutions with capabilities such as Metadata and Catalog, Performance and capacity Optimization, Data Security, Data Modeling, Data Wrangling, DevOps and basic agile awareness. Responsibilities Write aws glue/lambda jobs for sourcing data from multiple source systems to DataLake. Unit...

Role Overview: At PwC, our managed services team specializes in providing outsourced solutions to clients across various functions. As a Data Engineer Offshore, you will be responsible for designing, implementing, and maintaining scalable ETL pipelines and systems using technologies such as Teradata, DataStage, AWS, Databricks, SQL, Spark, Kafka, and more. Your role will involve collaborating with cross-functional teams to deliver data solutions that meet business requirements and ensure data quality, integrity, and security. Key Responsibilities: - Design, develop, and maintain scalable ETL pipelines using DataStage and other ETL tools. - Utilize AWS cloud services for data storage, process...

Role Overview: As a Data Engineer Offshore at PwC, you will be part of the managed services team focusing on various outsourced solutions to support clients across different functions. Your role involves helping organizations streamline operations, reduce costs, and enhance efficiency by managing key processes and functions on their behalf. You will utilize your skills in project management, technology, and process optimization to deliver high-quality services to clients. Your primary focus will be on transitioning and running services, managing delivery teams, programmes, commercials, performance, and delivery risk. Your work will revolve around continuous improvement and optimizing managed...

Job Description: You have extensive experience in analytics and large-scale data processing across diverse data platforms and tools. Your responsibilities will include: - Managing data storage and transformation across AWS S3, DynamoDB, Postgres, and Delta Tables with efficient schema design and partitioning. - Developing scalable analytics solutions using Athena and automating workflows with proper monitoring and error handling. - Ensuring data quality, access control, and compliance through robust validation, logging, and governance practices. - Designing and maintaining data pipelines using Python, Spark, Delta Lake framework, AWS Step functions, Event Bridge, AppFlow, and OAUTH. Qualific...

Role: Databricks consultant Location: PAN India (Cognizant Office) Exp: 10 to 12 years Senior Data Engineer: Years for Exp : 10-12 yrs. Must Have: Python, Databricks, DBT (Data Build Tool), SQL, DAB, Spark, Delta tables, Nice to have: Collibra DQ, Collibra, Jenkins Job Description: Build and maintain robust data pipelines using Python, Databricks, Spark, DBT, and Delta Lake to transform and deliver high quality analytics-ready datasets. Design and implement efficient data models (star, snowflake, and dimensional schemas), choosing normalized or denormalized structures based on performance and use cases. Write performant SQL and Databricks notebooks, manage versioning and orchestration, and e...

As a Big Data Engineer, you will play a crucial role in developing and managing the Big Data solutions for our company. Your responsibilities will include designing and implementing Big Data tools and frameworks, implementing ELT processes, collaborating with development teams, building cloud platforms, and maintaining the production system. Key Responsibilities: - Meet with managers to determine the companys Big Data needs. - Develop Big Data solutions on AWS using tools such as Apache Spark, Databricks, Delta Tables, EMR, Athena, Glue, and Hadoop. - Load disparate data sets and conduct pre-processing services using Athena, Glue, Spark, etc. - Collaborate with software research and developm...

Role Overview: You will be responsible for designing and implementing data solutions using technologies such as PySpark, Spark SQL, and Power BI. As a Lead Python Data Engineer, you will play a key role in building and optimizing scalable data pipelines while ensuring data governance, security, and compliance in cloud environments. Key Responsibilities: - Utilize PySpark to build and optimize scalable data pipelines, including Spark SQL, DataFrames, and Datasets. - Work with Azure Databricks (Unity Catalog) to manage Delta tables, workflows, and script in Python. - Design and model data for Data Warehousing and Visualization projects through Semantic Layers. - Write complex SQL queries and b...

Job Description Data Engineering & Pipeline Development Design implement and maintain ETL processes using ADF and ADB. Create and manage views in ADB and SQL for efficient data access. Optimize SQL queries for large datasets and high performance. Conduct end-to-end testing and impact analysis on data pipelines. Optimization & Performance Tuning Identify and resolve bottlenecks in data processing. Optimize SQL queries and Delta Tables for fast data processing. Data Sharing & Integration Implement Delta Share, SQL Endpoints, and other data sharing methods. Use Delta Tables for efficient data sharing and processing. API Integration & Development Integrate external systems through Databricks Not...

Shift: 2:00 PM 11:00 PM IST Experience: 8+ years of hands-on Data Engineering experience About The Role We are looking for experienced Data Engineers who can design, build, and optimize large-scale data pipelines. This role is for individual contributors who love coding, problem-solving, and working with cutting-edge big data technologies. Key Responsibilities Design, develop, and maintain scalable data pipelines for ETL processes using Spark (PySpark/Scala). Optimize data flow and automate existing processes for improved performance. Collaborate with cross-functional teams Data Science, Analytics, and Product to support data infrastructure needs. Work on data quality, reliability, and perfo...

Job Location : Hyderabad / Bangalore / Chennai / Kolkata / Noida/ Gurgaon / Pune / Indore / Mumbai At least 5+ years of relevant hands on development experience as Azure Data Engineering role Proficient inAzure technologieslike ADB, ADF, SQL(capability of writing complex SQL queries), ADB, PySpark, Python, Synapse, Delta Tables, Unity Catalog Hands on in Python, PySpark or Spark SQL Hands on in Azure Analytics and DevOps Taking part in Proof of Concepts (POCs) and pilot solutions preparation Ability to conduct data profiling, cataloguing, and mapping for technical design and construction of technical data flows Experience in business processing mapping of data and analytics solutions At DXC ...

Job Description: As a Databricks Consultant with 4-6 years of professional experience in data engineering, your role will primarily focus on Databricks. You will be responsible for programming expertise in python, SQL, and Spark. Your key responsibilities will include: - Handling data pipelines, medallion architecture, Lakehouse, delta tables, time travel, unity catalog, and processing large volumes in Databricks. - Demonstrating good knowledge of data modelling, data warehousing, and Slowly Changing Dimension (SCD) approaches. - Utilizing your communication skills effectively to collaborate with team members and stakeholders. Qualification Required: - 4-6 years of professional experience in...

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards. WHY JOIN US If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE As a Lead Data Engineer (Python) , you'll drive the development and optimization of data workflows, ensuring scalable, efficient, and high-quality solutions across Python and Spark environments. You'll take end-to-end ownership of features, collaborate with global s...

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards. WHY JOIN US If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE As a Lead Python Developer , you'll drive the development and optimization of data workflows, ensuring scalable, efficient, and high-quality solutions across Python and Spark environments. You'll take end-to-end ownership of features, collaborate with global stakeho...

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards. WHY JOIN US If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE As a Lead Python Developer , you'll drive the development and optimization of data workflows, ensuring scalable, efficient, and high-quality solutions across Python and Spark environments. You'll take end-to-end ownership of features, collaborate with global stakeho...

As a Data Engineer Offshore at PwC, you will be part of the managed services team focusing on outsourced solutions and supporting clients across various functions. Your role will involve streamlining operations, reducing costs, and improving efficiency for organizations by managing key processes and functions on their behalf. Utilizing your skills in project management, technology, and process optimization, you will deliver high-quality services to clients. Your main responsibilities will include transitioning and running services, managing delivery teams, programs, commercials, performance, and delivery risk. Continuous improvement and optimization of managed services processes, tools, and ...

As a member of the Managed Services team at PwC, you will focus on providing outsourced solutions and supporting clients across various functions. Your role will involve streamlining operations, reducing costs, and enhancing efficiency by managing key processes and functions on behalf of organizations. You will leverage your skills in project management, technology, and process optimization to deliver high-quality services to clients. Specifically, in managed service management and strategy, your responsibilities will include transitioning and running services, managing delivery teams, programmes, commercials, performance, and delivery risk. Your work will revolve around continuous improveme...

Role Overview: At PwC, your focus in managed services will involve providing outsourced solutions and supporting clients across various functions. You will assist organisations in streamlining operations, reducing costs, and enhancing efficiency by managing key processes and functions on their behalf. Your expertise in project management, technology, and process optimization will enable you to deliver high-quality services to clients. As part of the managed service management and strategy team at PwC, you will be responsible for transitioning and running services, managing delivery teams, programmes, commercials, performance, and delivery risk. Your role will revolve around continuous improv...

Job Description Alimentation Couche-Tard Inc., (ACT) is a global Fortune 200 company. A leader in the convenience store and fuel space with over 17,000 stores in 31 countries, serving more than 6 million customers each day It is an exciting time to be a part of the growing Data Engineering team at Circle K. We are driving a well-supported cloud-first strategy to unlock the power of data across the company and help teams to discover, value and act on insights from data across the globe. With our strong data pipeline, this position will play a key role partnering with our Technical Development stakeholders to enable analytics for long term success. About The Role We are looking for a Data Engi...

Assistant Scientist -Data Engineering Bangalore, Karnataka India & Gurgaon, Haryana-India AXA XL recognizes data and information as critical business assets, both in terms of managing risk and enabling new business opportunities. This data should not only be high quality, but also actionable - enabling AXA XL's executive leadership team to maximize benefits and facilitate sustained dynamic advantage. Our Chief Data Office also known as our Innovation, Data Intelligence & Analytics team (IDA) is focused on driving innovation by optimizing how we leverage data to drive strategy and create a new business model - disrupting the insurance market. As we develop an enterprise-wide data and digital ...

Role Overview: At PwC, as a Data Engineer in the offshore managed services team, you will be responsible for designing, implementing, and maintaining scalable data pipelines and systems that support data-driven initiatives. Your role will involve working with a variety of data technologies such as Teradata, DataStage, AWS, Databricks, SQL, and more to streamline operations, reduce costs, and improve efficiency for clients. Key Responsibilities: - Design, develop, and maintain scalable ETL pipelines using DataStage and other ETL tools. - Leverage AWS cloud services for data storage, processing, and analytics. - Utilize Databricks to analyze, process, and transform data, ensuring high performa...

Role Overview: You have extensive experience in analytics and large-scale data processing across diverse data platforms and tools. Your responsibilities will include managing data storage and transformation across AWS S3, DynamoDB, Postgres, and Delta Tables with efficient schema design and partitioning. You will develop scalable analytics solutions using Athena and automate workflows with proper monitoring and error handling. Ensuring data quality, access control, and compliance through robust validation, logging, and governance practices will be a crucial part of your role. Additionally, you will design and maintain data pipelines using Python, Spark, Delta Lake framework, AWS Step functio...

As a Big Data Engineer, you will play a crucial role in developing and managing our company's Big Data solutions. Your responsibilities will include: - Meeting with managers to determine the company's Big Data needs. - Developing Big Data solutions on AWS, utilizing tools such as Apache Spark, Databricks, Delta Tables, EMR, Athena, Glue, and Hadoop. - Loading disparate data sets and performing pre-processing services using Athena, Glue, and Spark. - Collaborating with software research and development teams. - Building cloud platforms for company application development. - Maintaining production systems. To excel in this role, you are required to meet the following qualifications: - 5+ years...

Looking For a Better Opportunity? Join Us!! About DMI DMI, the worlds first end-to-end mobility company, combines all the skills and services necessary to deliver mobile enterprise solutions. Built to reinvent business through mobility, DMI has expertise in mobile strategy, UX, web, and app development, omni-channel commerce, brand and marketing, big data management and analytics, and secure device and app management. The companys unique, integrated approach to mobility has resulted in dramatic growth as well as an expanding client base, which includes hundreds of Fortune 1000 commercial clients and all fifteen U.S. Federal Departments. DMI is headquartered in Washington DC area, with satell...