121 Apache Iceberg Jobs

Role - Senior Data Engineer Experience - 5-7 Years Location - Remote (India) About 1DigitalStack.ai 1DigitalStack.ai combines AI and deep eCommerce data to help global brands grow faster on online marketplaces. Our platforms deliver advanced analytics, actionable intelligence, and media automation enabling brands to optimize visibility, efficiency, and sales performance at scale. We partner with India's top consumer companies Unilever, Marico, Coca-Cola, Tata Consumer, Dabur, and Unicharm across 125+ marketplaces globally. Backed by leading venture investors and powered by a 220+ member team, we're in our $510M growth journey, scaling rapidly across categories and geographies to redefine how...

Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential. Title And Summary Senior Data Engineer ? Job Overview ? The Senior Software Engineer will do the design, development, and delivery of advanced big data solutions within the Hadoop ecosystem. ?...

Job Description Become a substential part of the Data Platform team, which provides engineering services across the Media Measurement department. Design, develop, test and deploy big data applications and pipelines. Ensure that your and the teams work follow best practices for ensuring validity, efficiency and maintainability. Collaborate in a distributed, cross-functional agile team of Data Scientists and Cloud Engineers to reached shared goals. Take ownership of technical implementations and architecture together with your team and in alignment with communities of practices. Communicate with data producers & consumers to align on data exchange formats and interfaces. Provide suggestions to...

Kindly suggets the skill cluster for the below JD Sr. Data Eng Bill Rate 32 USD/hr, Location India , Start Date 30th September 2025 JD Senior Data Engineer Responsibilities Design and Develop Scalable Data Pipelines: Build and maintain robust data pipelines using Python to process, transform, and integrate large-scale data from diverse sources. Orchestration and Automation: Implement and manage workflows using orchestration tools such as Apache Airflow to ensure reliable and efficient data operations. Data Warehouse Management: Work extensively with Snowflake to design and optimize data models, schemas, and queries for analytics and reporting. Queueing Systems: Leverage message queues like K...

About Tekion: Positively disrupting an industry that has not seen any innovation in over 50 years, Tekion has challenged the paradigm with the first and fastest cloud-native automotive platform that includes the revolutionary Automotive Retail Cloud (ARC) for retailers, Automotive Enterprise Cloud (AEC) for manufacturers and other large automotive enterprises and Automotive Partner Cloud (APC) for technology and industry partners. Tekion connects the entire spectrum of the automotive retail ecosystem through one seamless platform. The transformative platform uses cutting-edge technology, big data, machine learning, and AI to seamlessly bring together OEMs, retailers/dealers and consumers. Wi...

As a Senior Lead Engineer specializing in Python and Spark in AWS, your role will involve designing, building, and maintaining robust, scalable, and efficient ETL pipelines. You will primarily focus on ensuring alignment with data lakehouse architecture on AWS and optimizing workflows using services such as Glue, Lambda, and S3. Collaborating with cross-functional teams, you will gather requirements, provide technical insights, and deliver high-quality data solutions. Your responsibilities will include: - Driving the migration of existing data processing workflows to the lakehouse architecture - Leveraging Iceberg capabilities and enforcing best practices for coding standards and system arch...

As a AWS Data Architect specializing in AWS Integration, your role will involve the following key responsibilities: - Design, implement, and maintain a data lake on AWS using Iceberg tables on S3, ensuring data consistency, high availability, and easy querying. - Work with AWS Glue for ETL processes, creating Glue jobs to process, transform, and load data from SQL Server and other sources into Iceberg tables. - Implement and optimize Spark-based data transformations in AWS Glue, ensuring efficient and scalable data workflows. - Lead the migration of on-premises SQL Server data to AWS S3 using AWS Glue, DMS, and other relevant tools. - Design and implement CDC (Change Data Capture) pipelines ...

As an Applications Development Senior Programmer Analyst at our company, you will play a crucial role in establishing and implementing new or revised application systems and programs in coordination with the Technology team. Your main responsibilities will involve conducting feasibility studies, providing IT planning, developing new applications, and offering user support. You will need to leverage your specialty knowledge to analyze complex problems, recommend security measures, and consult with users on advanced programming solutions. Additionally, you will be responsible for ensuring operating standards are followed and acting as an advisor to junior analysts. **Key Responsibilities:** - ...

The objectives of a Data Engineer typically revolve around designing, implementing, and managing robust data architectures and infrastructures. The Data Engineer will play a key role in driving the organization's data strategy, ensuring the efficient flow and storage of data, and supporting data-driven decision-making processes. Duties & Responsibilities Data Model Design: Develop and maintain a scalable and efficient data models and schemas that support the storage, processing, and retrieval of data. Data Integration: Implement robust ELT (Extract, Load, Transform) processes to integrate data from various sources into a unified and consistent format. Ensure seamless data flow between differ...

Minimum qualifications: Bachelor's degree or equivalent practical experience. 8 years of experience with one or more general purpose programming languages, including Java, C/C++ or Python. 3 years of experience with software design and architecture. 3 years of experience with open source or developer technologies. Experience in software development and engineering, incorporating design methodologies, leveraging open source technologies, and working with distributed computing systems, including Apache Spark, Apache Hadoop, and Apache Hive, with performance. Preferred qualifications: Master's degree or PhD in Engineering, Computer Science, or a related technical field. 8 years of experience wi...

Your work days are brighter here. We're obsessed with making hard work pay off, for our people, our customers, and the world around us. As a Fortune 500 company and a leading AI platform for managing people, money, and agents, we're shaping the future of work so teams can reach their potential and focus on what matters most. The minute you join, you'll feel it. Not just in the products we build, but in how we show up for each other. Our culture is rooted in integrity, empathy, and shared enthusiasm. We're in this together, tackling big challenges with bold ideas and genuine care. We look for curious minds and courageous collaborators who bring sun-drenched optimism and drive. Whether you're ...

Your work days are brighter here. We're obsessed with making hard work pay off, for our people, our customers, and the world around us. As a Fortune 500 company and a leading AI platform for managing people, money, and agents, we're shaping the future of work so teams can reach their potential and focus on what matters most. The minute you join, you'll feel it. Not just in the products we build, but in how we show up for each other. Our culture is rooted in integrity, empathy, and shared enthusiasm. We're in this together, tackling big challenges with bold ideas and genuine care. We look for curious minds and courageous collaborators who bring sun-drenched optimism and drive. Whether you're ...

Your work days are brighter here. We're obsessed with making hard work pay off, for our people, our customers, and the world around us. As a Fortune 500 company and a leading AI platform for managing people, money, and agents, we're shaping the future of work so teams can reach their potential and focus on what matters most. The minute you join, you'll feel it. Not just in the products we build, but in how we show up for each other. Our culture is rooted in integrity, empathy, and shared enthusiasm. We're in this together, tackling big challenges with bold ideas and genuine care. We look for curious minds and courageous collaborators who bring sun-drenched optimism and drive. Whether you're ...

Job Description Become a substential part of the Data Platform team, which provides engineering services across the Media Measurement department. Design, develop, test and deploy big data applications and pipelines. Ensure that your and the teams work follow best practices for ensuring validity, efficiency and maintainability. Collaborate in a distributed, cross-functional agile team of Data Scientists and Cloud Engineers to reached shared goals. Take ownership of technical implementations and architecture together with your team and in alignment with communities of practices. Communicate with data producers & consumers to align on data exchange formats and interfaces. Provide suggestions to...

At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide. When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success. Principal Apache Iceberg Engineer at BairesDev We are seeking a Principal Apache Iceberg Engineer to drive the architecture and development of d...

Role Overview: In this role, you will be working on solving problems and designing solutions that facilitate data migrations on a large scale, from petabytes to exabytes per day. Your main focus will be to accelerate customers" journey towards Business Intelligence (BI) and Artificial Intelligence (AI) by delivering multiple products to external Google Cloud Platform (GCP) customers. Your work will involve simplifying data processing needs and delivering enterprise-grade solutions using cutting-edge technology and tools. Key Responsibilities: - Design and develop software for Data Warehouse migration, with a focus on cloud-native and distributed systems. - Collaborate with Product and Engine...

As a Senior Data Warehouse Administrator at our company, you will play a crucial role in architecting, managing, and optimizing large-scale data warehousing environments. Your expertise in modern data lake architectures, particularly with Apache Iceberg, and practical experience in building and maintaining data ingestion pipelines will be essential. You will be responsible for driving the efficiency and reliability of our data platform through deep SQL performance tuning and ensuring timely data flow using Change Data Capture (CDC) tools. **Role Overview:** - Design, implement, and maintain scalable and secure data warehouse environments. - Optimize data warehouse performance by fine-tuning ...

815 years of experience in data analysis, business analysis, or a related field. Strong experience with data visualization tools (e.g., Power BI, Tableau, QuickSight). Hands-on experience with AWS data services (e.g., S3, Athena, Glue, Redshift) will be a distinct advantage Familiarity with Apache Iceberg, dbt, and Apache Flink. Experience working with both batch and streaming data pipelines. Strong analytical thinking, problem-solving, and communication skills. Ability to work independently and guide junior analysts or developers. Preferred Skills Exposure to AI/ML workflows and understanding of how data supports model training and evaluation. Experience with data governance, data quality f...

The objectives of a Data Engineer typically revolve around designing, implementing, and managing robust data architectures and infrastructures. The Data Engineer will play a key role in driving the organization's data strategy, ensuring the efficient flow and storage of data, and supporting data-driven decision-making processes. Duties & Responsibilities Data Model Design: Develop and maintain a scalable and efficient data models and schemas that support the storage, processing, and retrieval of data. Data Integration: Implement robust ELT (Extract, Load, Transform) processes to integrate data from various sources into a unified and consistent format. Ensure seamless data flow between differ...

Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential. Title And Summary Technical Manager, Data Engineering Background Mastercard is on a journey to modernize and advance our Finance Technology landscape, covering Billing, Financial Planning, Acc...

Expedia Group brands power global travel for everyone, everywhere. We design cutting-edge tech to make travel smoother and more memorable, and we create groundbreaking solutions for our partners. Our diverse, vibrant, and welcoming community is essential in driving our success. Why Join Us To shape the future of travel, people must come first. Guided by our Values and Leadership Agreements, we foster an open culture where everyone belongs, differences are celebrated and know that when one of us wins, we all win. We provide a full benefits package, including exciting travel perks, generous time-off, parental leave, a flexible work model (with some pretty cool offices), and career development ...

As a Data Engineer at Tanla, you will be responsible for developing, deploying, monitoring, and maintaining ETL Jobs and all data engineering and pipeline activities. Your expertise in SQL queries and DB solutions will be crucial for designing and constructing enterprise procedure constructs. Here is a breakdown of your key responsibilities: - Design and construct enterprise procedure constructs using any ETL tool, preferably PentahoDI - Provide accurate work estimates and manage efforts across multiple lines of work - Design and develop exception handling and data cleansing/standardization procedures - Gather requirements from various stakeholders related to ETL automation - Design and crea...

Job Summary We are seeking an experienced Data Lake Expert to design, implement, and optimize enterprise-grade data lake and data warehouse systems using modern open-source technologies such as Apache Iceberg, Apache Hudi, Delta Lake, and Apache Spark . The ideal candidate will have deep expertise in data ingestion, transformation, storage optimization, and governance across structured and unstructured data sources. This role involves architecting and managing scalable data platforms that enable real-time analytics, AI/ML pipelines, and regulatory compliance . Key Responsibilities 1. Data Lake Architecture & Design Architect and implement scalable data lakehouse solutions using Apache Iceber...

At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide. When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success. Apache Impala Developer at BairesDev We are seeking an Apache Impala Developer with expertise in SQL query engines, columnar storage optimizatio...

We are looking for a skilled Data Engineer with a strong background in PostgreSQL, SQL, and Python to join our dynamic team in Kochi. The ideal candidate will be responsible for building and optimising data pipelines, ensuring seamless data flow across systems, and supporting our analytics and product teams with reliable data solutions. Job Title: Data Engineer Company: Pumex Infotech Pvt. Ltd. Experience: 5 to 10 Years Educational qualification: B Tech/ M Tech/ BCA/MCA (Computer Science) or related field. Location : InfoPark, Kochi Notice Period: Immediate Joiners Responsibilities: Design, develop, and maintain robust ETL/ELT data pipelines using tools such as Airflow or dbt . Optimize Post...