134 Iceberg Jobs - Page 3

As a Senior Data Engineer at Milestone Technologies, you will play a crucial role in leading data ingestion, transformation, and optimization initiatives using the modern Apache and Azure data stack. Your responsibilities will include: - Building and managing high-volume data pipelines using Spark/Databricks. - Implementing ELT frameworks using Azure Data Factory/Synapse Pipelines. - Optimizing large-scale datasets in Delta/Iceberg formats. - Implementing robust data quality, monitoring, and governance layers. - Collaborating with Data Scientists, Analysts, and Business stakeholders. Your technical stack will involve: - Big Data: Apache Spark, Kafka, Hive, Airflow, Hudi/Iceberg. - Cloud: Azu...

About ISSQUARED: An emerging value provider across an array of digital transformation solutions to address on-demand security and governance needs. Founded in 2010, the footprints of ISSQUARED span across the pillars of Cybersecurity, Cloud Infrastructure, and Managed Services to companies of all sizes, including Fortune 500. The core competencies of IT Security and Infrastructure Solutions complement each other to form ISSQUARED. Job Category: Fulltime Job Title: Data Architect Job Overview: A Data Architect is responsible for designing, creating, deploying, and managing an organizations data architecture. They ensure that data is stored, integrated, and accessed efficiently across systems,...

Description Introduction : We are on a mission to rid the world of bad customer service by mobilizing the way help is delivered. Today's consumers want an always-available customer service experience that leaves them feeling valued and respected. Helpshift helps B2B brands deliver this modern customer service experience through a mobile-first approach. We have changed how conversations take place, moving the conversation away from slow, outdated email and desktop experience to an in-app chat experience that allows users to interact with brands in their time. Through our market leading chatbots and automations, we help brands deliver instant and rapid resolutions. Because agents play a key ro...

Looking for - Hive, SQL, Python, Spark, Hadoop and kafka with Iceberg experience Bachelor's or Master's degree in Computer Science, Information Systems, or a related field. Design, develop, and maintain data pipelines and ETL processes using Python, Hive, Spark, and other relevant technologies. Good Hands on Exp with java Minimum of 6+ years of experience as a Data Engineer, with proven expertise in Python, Hive, and Spark. Advance SQL experience and working experience with Big data Hadoop . Strong understanding of data engineering concepts, including data modelling, data integration, and data warehousing. Hands-on experience with tools such as Apache Airflow. Experience with Docker and cont...

Role & responsibilities BIG DATA ENGINEER 3 Roles Look for - Hive, SQL, Python, Spark, Hadoop and kafka Bachelor's or Master's degree in Computer Science, Information Systems, or a related field. Design, develop, and maintain data pipelines and ETL processes using Python, Hive, Spark, and other relevant technologies. Good Hands on Exp with java Minimum of 6+ years of experience as a Data Engineer, with proven expertise in Python, Hive, and Spark. Advance SQL experience and working experience with Big data Hadoop . Strong understanding of data engineering concepts, including data modelling, data integration, and data warehousing. Hands-on experience with tools such as Apache Airflow. Experien...

About TripleLift We're TripleLift, an advertising platform on a mission to elevate digital advertising through beautiful creative, quality publishers, actionable data and smart targeting. Through over 1 trillion monthly ad transactions, we help publishers and platforms monetize their businesses. Our technology is where the world's leading brands find audiences across online video, connected television, display and native ads. Brand and enterprise customers choose us because of our innovative solutions, premium formats, and supportive experts dedicated to maximizing their performance. As part of the Vista Equity Partners portfolio, we are NMSDC certified, qualify for diverse spending goals an...

You're ready to gain the skills and experience needed to grow within your role and advance your career - and we have the perfect software engineering opportunity for you. As a Software Engineer III at JPMorgan Chase within the Consumer & Community Banking Team, you are part of an agile team that works to enhance, design, and deliver the software components of the firm's state-of-the-art technology products in a secure, stable, and scalable way. As an emerging member of a software engineering team, you execute software solutions through the design, development, and technical troubleshooting of multiple components within a technical product, application, or system, while gaining the skills and...

As an AWS Developer at Barclays, you will play a crucial role in supporting the successful delivery of Location Strategy projects. Your responsibilities will include ensuring that projects are completed within the planned budget, meeting quality standards, and adhering to governance protocols. You will be at the forefront of transforming our digital landscape, driving innovation, and striving for excellence to enhance our digital offerings and provide customers with exceptional experiences. **Key Experience:** - Proficiency in AWS cloud services like S3, Glue, Athena, Lake Formation, and CloudFormation. - Advanced skills in Python for data engineering and automation. - Familiarity with ETL f...

Role Overview: You will play a crucial role as a Data Platform Engineer Lead at Barclays, focusing on building and maintaining systems for data collection, storage, processing, and analysis. This includes managing data pipelines, data warehouses, and data lakes to ensure the accuracy, accessibility, and security of all data within the organization. Key Responsibilities: - Utilize hands-on coding experience in Java or Python and a strong understanding of AWS development to implement various services like Lambda, Glue, Step Functions, and IAM roles. - Proficiently build efficient data pipelines using Apache Spark and other AWS services to streamline data processing and analysis. - Demonstrate ...

Job Category Software Engineering Job Details About Salesforce Salesforce is the #1 AI CRM, where humans with agents drive customer success together. Here, ambition meets action. Tech meets trust. And innovation isn't a buzzword - it's a way of life. The world of work as we know it is changing and we're looking for Trailblazers who are passionate about bettering business and the world through AI, driving innovation, and keeping Salesforce's core values at the heart of it all. Ready to level-up your career at the company leading workforce transformation in the agentic era You're in the right place! Agentforce is the future of AI, and you are the future of Salesforce. Our Security Software Eng...

Be an integral part of an agile team that's constantly pushing the envelope to enhance, build, and deliver top-notch technology products. As a Senior Lead Software Engineer at JPMorgan Chase within the Consumer and Community Banking - Connected Commerce, you are an integral part of an agile team dedicated to enhancing, building, and delivering trusted, market-leading technology products in a secure, stable, and scalable manner. Your role involves promoting significant business impact through your capabilities and contributions, utilizing deep technical expertise and problem-solving methodologies to address a diverse array of challenges across multiple technologies and applications. Job respo...

Job Requisition ID # 25WD91419 Position Overview We are seeking a highly experienced Principal Engineer to lead the design, development, and evolution of our Batch Processing platform , which powers Autodesk's Analytics Data Platform (ADP). This role requires deep technical expertise in distributed data systems, large-scale pipeline orchestration, and hands-on leadership in shaping next-generation data platform capabilities. You will partner closely with Engineering Managers, Architects, Product teams, and Partner Engineering to modernize our data lakehouse architecture, deliver highly reliable data pipelines, and establish technical excellence across ingestion, processing, and governance. R...

You're ready to gain the skills and experience needed to grow within your role and advance your career - and we have the perfect software engineering opportunity for you. As a Software Engineer III at JPMorgan Chase within the consumer & Community Banking Team, you are part of an agile team that works to enhance, design, and deliver the software components of the firm's state-of-the-art technology products in a secure, stable, and scalable way. As an emerging member of a software engineering team, you execute software solutions through the design, development, and technical troubleshooting of multiple components within a technical product, application, or system, while gaining the skills and...

Company Overview Milestone Technologies is a global IT managed services firm that partners with organizations to scale their technology, infrastructure and services to drive specific business outcomes such as digital transformation, innovation, and operational agility. Milestone is focused on building an employee-first, performance-based culture and for over 25 years, we have a demonstrated history of supporting category-defining enterprise clients that are growing ahead of the market. The company specializes in providing solutions across Application Services and Consulting, Digital Product Engineering, Digital Workplace Services, Private Cloud Services, AI/Automation, and ServiceNow. Milest...

Role Overview: You will work in the Information management team of Services Technologies, focusing on projects related to Big Data and public cloud adoption. This intermediate level position involves participating in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. Your primary objective will be to contribute to applications systems analysis and programming activities. Key Responsibilities: - Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs ...

As the Vice President of Engineering at Teradata, you will lead the India-based software development organization for the AI Platform Group. Your primary responsibility will be to execute the product roadmap for key technologies such as Vector Store, Agent platform, Apps, user experience, and AI/ML-driven use-cases at scale. Success in this role will involve building a world-class engineering culture, attracting and retaining top technical talent, accelerating product delivery, and driving innovation to bring measurable value to customers. Key Responsibilities: - Lead a team of 150+ engineers to help customers achieve outcomes with Data and AI - Partner closely with Product Management, Produ...

As a candidate for the role in the Unified Intelligence Platform (UIP) team, you will be part of a mission to enable Salesforce teams to deeply understand and optimize their services and operations through data. The UIP is a modern, cloud-based data platform built with cutting-edge technologies like Spark, Trino, Airflow, DBT, Jupyter Notebooks, and more. Here are the details of the job responsibilities and qualifications we are looking for: **Role Overview:** You will be responsible for leading the architecture, design, development, and support of mission-critical data and platform services. Your role will involve driving self-service data pipelines, collaborating with product management te...

Job Category Software Engineering Job Details About Salesforce Salesforce is the #1 AI CRM, where humans with agents drive customer success together. Here, ambition meets action. Tech meets trust. And innovation isn't a buzzword - it's a way of life. The world of work as we know it is changing and we're looking for Trailblazers who are passionate about bettering business and the world through AI, driving innovation, and keeping Salesforce's core values at the heart of it all. Ready to level-up your career at the company leading workforce transformation in the agentic era You're in the right place! Agentforce is the future of AI, and you are the future of Salesforce. About the Role The missio...

Key Skills - Hadoop, PySpark, Python, SQL, Apache Iceberg (niche) , Hive Requirements Solid knowledge of Hadoop ecosystem such as Hive, Iceberg, Spark SQL and Proficiency in Python, Unix ,SQL Experience with Apache Kafka, Apache Flink, and other relevant streaming technologies. Strong hands-on experience with Hive and SQL for querying and data transformation Proficiency in Python for data manipulation and automation Expertise in Apache Spark (batch and streaming) Deep understanding of Hadoop ecosystem (HDFS, YARN, MapReduce) Experience working with Kafka for streaming data pipelines Experience with workflow orchestration tools (Airflow, Oozie, etc.) Knowledge of cloud-based big data platform...

As a Principal Data Engineer at FTSE Russell, you will play a crucial role in leading the development of foundational components for a lakehouse architecture on AWS. Your primary responsibility will involve driving the migration of existing data processing workflows to the new lakehouse solution. Collaboration across the Data Engineering organization is essential as you design and implement scalable data infrastructure and processes using cutting-edge technologies such as Python, PySpark, EMR Serverless, Iceberg, Glue, and Glue Data Catalog. Success in this role hinges on your deep technical expertise, exceptional problem-solving skills, and your ability to lead and mentor within an agile te...

About this role: Wells Fargo is seeking a Software engineer (Data engineer). The Finance Technology Team within Enterprise Functions Technology (EFT) is seeking a Data Engineer to join our CALM (Corporate Asset and Liability Management) team at Wells Fargo Corporate Treasury. As a Software Engineer in the CALM Data Engineering team, candidate will play a pivotal role supporting the design, development, and maintenance of our metadata-driven data engineering frameworks. Candidate will work independently to deliver critical project tasks, focusing on building, enhancing, and troubleshooting robust data pipelines, APIs and wrapper capabilities for the CALM project. This role is essential for en...

Skills Required: Familiarity with data processing engines such as Apache Spark, Flink, or other big data tools. Design, develop, and implement robust data lake architectures on cloud platforms (AWS/Azure). Implement streaming and batch data pipelines using Apache Hudi, Apache Hive, and cloud-native services like AWS Glue, Azure Data Lake, etc. Architect and optimize ingestion, compaction, partitioning, and indexing strategies in Apache Hudi. Develop scalable data transformation and ETL frameworks using Python, Spark, and Flink. Work closely with DataOps/DevOps to build CI/CD pipelines and monitoring tools for data lake platforms. Ensure data governance, schema evolution handling, lineage tra...

Location : Bangalore Experience : 12-18 years No of position : 1 Contract duration : 6 months – 1 year C2H

Unlock your potential with Dassault Systmes, a global leader in Scientific Software Engineering as a Big Data Engineer in Pune, Maharashtra! Role Description & Responsibilities: - Data Pipeline Development: Design, develop, and maintain robust ETL pipelines for batch and real-time data ingestion, processing, and transformation using Spark, Kafka, and Python. - Data Architecture: Build and optimize scalable data architectures, including data lakes, data marts, and data warehouses, to support business intelligence, reporting, and machine learning. - Data Governance: Ensure data reliability, integrity, and governance by enabling accurate, consistent, and trustworthy data for decision-making. - ...

You will be responsible for leading the development of foundational components for a lakehouse architecture on AWS and overseeing the migration of existing data processing workflows to the new lakehouse solution. Your role will involve collaborating with the Data Engineering team to design and implement scalable data infrastructure and processes using technologies such as Python, PySpark, EMR Serverless, Iceberg, Glue, and Glue Data Catalog. The primary objective of this position is to ensure a successful migration and establish robust data quality governance across the new platform to enable reliable and efficient data processing. To excel in this position, you will need to demonstrate deep...