38 Delta Tables Jobs

Shift: 2:00 PM 11:00 PM IST Experience: 8+ years of hands-on Data Engineering experience About The Role We are looking for experienced Data Engineers who can design, build, and optimize large-scale data pipelines. This role is for individual contributors who love coding, problem-solving, and working with cutting-edge big data technologies. Key Responsibilities Design, develop, and maintain scalable data pipelines for ETL processes using Spark (PySpark/Scala). Optimize data flow and automate existing processes for improved performance. Collaborate with cross-functional teams Data Science, Analytics, and Product to support data infrastructure needs. Work on data quality, reliability, and perfo...

Job Location : Hyderabad / Bangalore / Chennai / Kolkata / Noida/ Gurgaon / Pune / Indore / Mumbai At least 5+ years of relevant hands on development experience as Azure Data Engineering role Proficient inAzure technologieslike ADB, ADF, SQL(capability of writing complex SQL queries), ADB, PySpark, Python, Synapse, Delta Tables, Unity Catalog Hands on in Python, PySpark or Spark SQL Hands on in Azure Analytics and DevOps Taking part in Proof of Concepts (POCs) and pilot solutions preparation Ability to conduct data profiling, cataloguing, and mapping for technical design and construction of technical data flows Experience in business processing mapping of data and analytics solutions At DXC ...

Job Description: As a Databricks Consultant with 4-6 years of professional experience in data engineering, your role will primarily focus on Databricks. You will be responsible for programming expertise in python, SQL, and Spark. Your key responsibilities will include: - Handling data pipelines, medallion architecture, Lakehouse, delta tables, time travel, unity catalog, and processing large volumes in Databricks. - Demonstrating good knowledge of data modelling, data warehousing, and Slowly Changing Dimension (SCD) approaches. - Utilizing your communication skills effectively to collaborate with team members and stakeholders. Qualification Required: - 4-6 years of professional experience in...

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards. WHY JOIN US If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE As a Lead Data Engineer (Python) , you'll drive the development and optimization of data workflows, ensuring scalable, efficient, and high-quality solutions across Python and Spark environments. You'll take end-to-end ownership of features, collaborate with global s...

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards. WHY JOIN US If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE As a Lead Python Developer , you'll drive the development and optimization of data workflows, ensuring scalable, efficient, and high-quality solutions across Python and Spark environments. You'll take end-to-end ownership of features, collaborate with global stakeho...

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards. WHY JOIN US If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE As a Lead Python Developer , you'll drive the development and optimization of data workflows, ensuring scalable, efficient, and high-quality solutions across Python and Spark environments. You'll take end-to-end ownership of features, collaborate with global stakeho...

As a Data Engineer Offshore at PwC, you will be part of the managed services team focusing on outsourced solutions and supporting clients across various functions. Your role will involve streamlining operations, reducing costs, and improving efficiency for organizations by managing key processes and functions on their behalf. Utilizing your skills in project management, technology, and process optimization, you will deliver high-quality services to clients. Your main responsibilities will include transitioning and running services, managing delivery teams, programs, commercials, performance, and delivery risk. Continuous improvement and optimization of managed services processes, tools, and ...

As a member of the Managed Services team at PwC, you will focus on providing outsourced solutions and supporting clients across various functions. Your role will involve streamlining operations, reducing costs, and enhancing efficiency by managing key processes and functions on behalf of organizations. You will leverage your skills in project management, technology, and process optimization to deliver high-quality services to clients. Specifically, in managed service management and strategy, your responsibilities will include transitioning and running services, managing delivery teams, programmes, commercials, performance, and delivery risk. Your work will revolve around continuous improveme...

Role Overview: At PwC, your focus in managed services will involve providing outsourced solutions and supporting clients across various functions. You will assist organisations in streamlining operations, reducing costs, and enhancing efficiency by managing key processes and functions on their behalf. Your expertise in project management, technology, and process optimization will enable you to deliver high-quality services to clients. As part of the managed service management and strategy team at PwC, you will be responsible for transitioning and running services, managing delivery teams, programmes, commercials, performance, and delivery risk. Your role will revolve around continuous improv...

Job Description Alimentation Couche-Tard Inc., (ACT) is a global Fortune 200 company. A leader in the convenience store and fuel space with over 17,000 stores in 31 countries, serving more than 6 million customers each day It is an exciting time to be a part of the growing Data Engineering team at Circle K. We are driving a well-supported cloud-first strategy to unlock the power of data across the company and help teams to discover, value and act on insights from data across the globe. With our strong data pipeline, this position will play a key role partnering with our Technical Development stakeholders to enable analytics for long term success. About The Role We are looking for a Data Engi...

Assistant Scientist -Data Engineering Bangalore, Karnataka India & Gurgaon, Haryana-India AXA XL recognizes data and information as critical business assets, both in terms of managing risk and enabling new business opportunities. This data should not only be high quality, but also actionable - enabling AXA XL's executive leadership team to maximize benefits and facilitate sustained dynamic advantage. Our Chief Data Office also known as our Innovation, Data Intelligence & Analytics team (IDA) is focused on driving innovation by optimizing how we leverage data to drive strategy and create a new business model - disrupting the insurance market. As we develop an enterprise-wide data and digital ...

Role Overview: At PwC, as a Data Engineer in the offshore managed services team, you will be responsible for designing, implementing, and maintaining scalable data pipelines and systems that support data-driven initiatives. Your role will involve working with a variety of data technologies such as Teradata, DataStage, AWS, Databricks, SQL, and more to streamline operations, reduce costs, and improve efficiency for clients. Key Responsibilities: - Design, develop, and maintain scalable ETL pipelines using DataStage and other ETL tools. - Leverage AWS cloud services for data storage, processing, and analytics. - Utilize Databricks to analyze, process, and transform data, ensuring high performa...

Role Overview: You have extensive experience in analytics and large-scale data processing across diverse data platforms and tools. Your responsibilities will include managing data storage and transformation across AWS S3, DynamoDB, Postgres, and Delta Tables with efficient schema design and partitioning. You will develop scalable analytics solutions using Athena and automate workflows with proper monitoring and error handling. Ensuring data quality, access control, and compliance through robust validation, logging, and governance practices will be a crucial part of your role. Additionally, you will design and maintain data pipelines using Python, Spark, Delta Lake framework, AWS Step functio...

As a Big Data Engineer, you will play a crucial role in developing and managing our company's Big Data solutions. Your responsibilities will include: - Meeting with managers to determine the company's Big Data needs. - Developing Big Data solutions on AWS, utilizing tools such as Apache Spark, Databricks, Delta Tables, EMR, Athena, Glue, and Hadoop. - Loading disparate data sets and performing pre-processing services using Athena, Glue, and Spark. - Collaborating with software research and development teams. - Building cloud platforms for company application development. - Maintaining production systems. To excel in this role, you are required to meet the following qualifications: - 5+ years...

Looking For a Better Opportunity? Join Us!! About DMI DMI, the worlds first end-to-end mobility company, combines all the skills and services necessary to deliver mobile enterprise solutions. Built to reinvent business through mobility, DMI has expertise in mobile strategy, UX, web, and app development, omni-channel commerce, brand and marketing, big data management and analytics, and secure device and app management. The companys unique, integrated approach to mobility has resulted in dramatic growth as well as an expanding client base, which includes hundreds of Fortune 1000 commercial clients and all fifteen U.S. Federal Departments. DMI is headquartered in Washington DC area, with satell...

Role Overview: You will be responsible for designing, implementing, and maintaining ETL processes using ADF and ADB. Your role will involve creating and managing views in ADB and SQL to ensure efficient data access. Additionally, you will optimize SQL queries for large datasets and high performance. Conducting end-to-end testing and impact analysis on data pipelines will also be a part of your responsibilities. Key Responsibilities: - Identify and resolve bottlenecks in data processing to ensure smooth operation of data pipelines. - Optimize SQL queries and Delta Tables to achieve fast data processing. - Implement data sharing methods such as Delta Share, SQL Endpoints, and utilize Delta Tab...

As a Data Engineering Senior Associate at Microsoft, Fabric, Azure (Databricks & ADF), PySpark, your role will involve: - Requirement gathering and analysis - Designing and implementing data pipelines using Microsoft Fabric & Databricks - Extracting, transforming, and loading (ETL) data from various sources into Azure Data Lake Storage - Implementing data security and governance measures - Monitoring and optimizing data pipelines for performance and efficiency - Troubleshooting and resolving data engineering issues - Providing optimized solutions for any problem related to data engineering - Working with a variety of sources like Relational DB, API, File System, Realtime streams, CDC, etc. -...

Role Overview: At PwC, you will be part of the managed services team focusing on outsourced solutions and providing support to clients across various functions. Your role will involve helping organizations streamline operations, reduce costs, and enhance efficiency by managing key processes and functions. You will leverage your skills in project management, technology, and process optimization to deliver high-quality services to clients. Specifically, as a Data Engineer Offshore, you will play a crucial role in designing, implementing, and maintaining scalable data pipelines and systems to support data-driven initiatives. Key Responsibilities: - Design, develop, and maintain scalable ETL pip...

At PwC, the focus of individuals in managed services is on a variety of outsourced solutions and supporting clients across various functions. They play a crucial role in helping organizations streamline operations, reduce costs, and enhance efficiency by managing key processes and functions on behalf of clients. Skilled in project management, technology, and process optimization, they are adept at delivering high-quality services to clients. Those in managed service management and strategy at PwC concentrate on transitioning and running services, managing delivery teams, programs, commercials, performance, and delivery risk. The role involves continuous improvement processes and optimizing m...

As a Data Engineering Senior Associate at Microsoft Fabric, Azure (Databricks & ADF), PySpark, you will be responsible for designing and implementing scalable data solutions within the Microsoft Azure ecosystem. With 4-10 years of experience in the field, you will leverage your expertise in Microsoft Fabric, Azure Databricks, PySpark, Python, and SQL to build end-to-end data pipelines, ensuring efficient data processing and extraction. Your primary responsibilities will include gathering requirements, designing and implementing data pipelines using Microsoft Fabric & Databricks, performing ETL operations to extract data into Azure Data Lake Storage, implementing data security measures, monit...

As a Data Engineering Senior Specialist (Databricks) at Nasdaq Bangalore, you will have the opportunity to be part of a team that is at the forefront of revolutionizing markets and developing innovative solutions. Your role will involve working closely with defined business requirements to provide analytical, modelling, dimensional modeling, and testing to design optimal solutions. You will play a key role in translating business information needs into adaptable and sustainable data structures. Your primary responsibilities will include designing, building, and maintaining data pipelines within the Databricks Lakehouse Platform. Your expertise in tasks such as utilizing the Databricks Lakeho...

Flexera saves customers billions of dollars in wasted technology spend. A pioneer in Hybrid ITAM and FinOps, Flexera provides award-winning, data-oriented SaaS solutions for technology value optimization (TVO), enabling IT, finance, procurement and cloud teams to gain deep insights into cost optimization, compliance and risks for each business service. Flexera One solutions are built on a set of definitive customer, supplier and industry data, powered by our Technology Intelligence Platform, that enables organizations to visualize their Enterprise Technology Blueprint in hybrid environments-from on-premises to SaaS to containers to cloud. We're transforming the software industry. We're Flexe...

At PwC, individuals in managed services focus on providing outsourced solutions and supporting clients across various functions. By managing key processes and functions on behalf of organisations, they help streamline operations, reduce costs, and enhance efficiency. Skilled in project management, technology, and process optimization, they deliver high-quality services to clients. Those specializing in managed service management and strategy at PwC concentrate on transitioning and running services, managing delivery teams, programmes, commercials, performance, and delivery risk. The role involves continuous improvement, optimizing managed services processes, tools, and services. Your focus l...

The role of Senior Data Engineer at GSPANN involves designing, developing, and optimizing scalable data solutions, utilizing expertise in Azure Data Factory, Azure Databricks, PySpark, Delta Tables, and advanced data modeling. The position also demands proficiency in performance optimization, API integrations, DevOps practices, and data governance. You will be responsible for designing, developing, and orchestrating scalable data pipelines using Azure Data Factory (ADF). Additionally, you will build and manage Apache Spark clusters, create notebooks, and execute jobs in Azure Databricks. Ingesting, organizing, and transforming data within the Microsoft Fabric ecosystem using OneLake will als...

As a Data Engineering Senior Specialist (Databricks) at Nasdaq Bangalore, you will be joining the Bangalore technology center in India, where innovation and effectiveness are the driving forces. Nasdaq is at the forefront of revolutionizing markets and constantly evolving by adopting new technologies to create innovative solutions, aiming to shape the future. In this role, your primary responsibility will be to analyze defined business requirements, providing analytical insights, modeling, dimensional modeling, and testing to design solutions that meet customer needs effectively. You will focus on understanding business data needs and translating them into adaptable, extensible, and sustaina...