134 Iceberg Jobs - Page 4

Join us as a Data Engineer responsible for supporting the successful delivery of Location Strategy projects to plan, budget, agreed quality, and governance standards. You'll spearhead the evolution of our digital landscape, driving innovation and excellence. You will harness cutting-edge technology to revolutionize our digital offerings, ensuring unparalleled customer experiences. To be successful as a Data Engineer, you should have experience with: - Hands-on experience in PySpark and strong knowledge of Dataframes, RDD, and SparkSQL. - Hands-on experience in developing, testing, and maintaining applications on AWS Cloud. - Strong hold on AWS Data Analytics Technology Stack (Glue, S3, Lambd...

Senior Data Warehouse Engineer Pando (www.pando.ai) is pioneering the future of autonomous logistics with innovative AI capabilities. Trusted by Fortune 500 enterprises with global customers across North America, Europe, and Asia Pacific regions, we are leading the global disruption of supply chain software, with our AI-powered, no-code, & unified platform empowering Autonomous Supply Chain. We have been recognized by Gartner for our transportation management capabilities, by the World Economic Forum (WEF) as a Technology Pioneer, by G2 as a Market Leader in Freight Management, and named one of the fastest-growing technology companies by Deloitte. Why Pando? We are one of the fastest growing...

As a Lead Software Engineer III at JPMorgan Chase within the AI/ML & Data Platforms team, you play a vital role in an agile team dedicated to enhancing, building, and delivering cutting-edge technology products with trust and reliability. Your responsibilities encompass executing innovative software solutions, designing and developing high-quality code, and troubleshooting technical issues with a forward-thinking mindset. Your expertise contributes to improving operational stability and automating remediation processes, ensuring the scalability and security of software applications. You will lead evaluation sessions with external vendors and internal teams, fostering discussions on architect...

You are a highly skilled Data Modeler with expertise in Iceberg and Snowflake, responsible for designing and optimizing data models for scalable and efficient data architectures. Working closely with cross-functional teams, you ensure data integrity, consistency, and performance across platforms. Your key responsibilities include designing and implementing robust data models tailored to meet business and technical requirements. Leveraging Starburst, Iceberg, and Snowflake, you build scalable and high-performance data architectures. You optimize query performance and ensure efficient data storage strategies. Collaboration with data engineering and BI teams is essential to define data requirem...

We have an exciting and rewarding opportunity for you to take your software engineering career to the next level. As a Software Engineer III at JPMorgan Chase within the Commercial & Investment Bank, you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure, stable, and scalable way. You are responsible for carrying out critical technology solutions across multiple technical areas within various business functions in support of the firm's business objectives. You will execute software solutions, design, development, and technical troubleshooting with the ability to think beyond routine or conventional approaches to build solu...

As a Senior AWS Data Engineer Vice President at Barclays, you will play a pivotal role in shaping the future by spearheading the evolution of the Reference Data Services function. You will work collaboratively with a team of engineers to oversee the engineering process from strategy and design to build, documentation, and testing of software components. Your responsibilities will extend to working closely with colleagues in the cloud and middleware organization to bring products to life in a modern developer-focused environment. Effective stakeholder management, leadership, and decision-making skills are essential to support business strategy and risk management. To excel in this role, you s...

Role: Data Engineer II A growing AdTech organization is seeking a Data Engineer II to join a small, highly influential Data Engineering team. In this role, you will be responsible for evolving and optimizing high-volume, low-latency data pipeline architecture, as well as improving data flow and collection processes across multiple teams. The ideal candidate is an experienced data pipeline builder and data wrangler who thrives on optimizing systems and building scalable solutions from the ground up. You will support software engineers, product managers, business intelligence analysts, and data scientists on data initiatives while ensuring consistent application of best practices for data deli...

As an Advisory Consultant at Dell Technologies, you will play a crucial role in delivering consultative business and technical services for complex customer-facing consulting engagements related to digital transformation. Your responsibilities will involve collaborating with Global Pre-Sales, Account Management, and Solutioning Teams to deploy, administer, and configure digital transformation software stacks. Being one of the senior technical members in the Digital Transformation Practice, you will earn customer trust through competence, technical acumen, consulting expertise, and partnership. You will guide and oversee other team members, providing technical grooming activities for their sk...

Company Overview: ? FTSE Russell, part of the London Stock Exchange Group, is an essential index partner for a changing world, providing category-defining indices across asset classes and investment objectives to create new possibilities for the global investment community. FTSE Russells expertise and products are used extensively by institutional and retail investors globally. Job Summary: ?In this key leadership role, you will lead the development of foundational components for a lakehouse architecture on AWS and drive the migration of existing data processing workflows to the new lakehouse solution. You will work across the Data Engineering organisation to design and implement scalable da...

As a global leader in cybersecurity, CrowdStrike protects the people, processes and technologies that drive modern organizations. Since 2011, our mission hasn't changed - we're here to stop breaches, and we've redefined modern security with the world's most advanced AI-native platform. We work on large scale distributed systems, processing almost 3 trillion events per day and this traffic is growing daily . Our customers span all industries, and they count on CrowdStrike to keep their businesses running, their communities safe and their lives moving forward. We're also a mission-driven company. We cultivate a culture that gives every CrowdStriker both the flexibility and autonomy to own thei...

Druva is the leading provider of data security solutions, empowering customers to secure and recover their data from all threats. The Druva Data Security Cloud is a fully managed SaaS solution offering air-gapped and immutable data protection across cloud, on-premises, and edge environments. By centralizing data protection, Druva enhances traditional security measures and enables faster incident response, effective cyber remediation, and robust data governance. Trusted by nearly 7,500 customers, including 75 of the Fortune 500, Druva safeguards business data in an increasingly interconnected world. Visit and follow us on , and . As a Senior Staff Software Engineer, you will be providing tech...

Role Overview: We are seeking an experienced and visionary AI & Distributed Systems Architect to lead the design and implementation of large-scale, AI-driven distributed systems. The successful candidate will pioneer transformative AI solutions, including leveraging Generative AI, Machine Learning (ML), sophisticated agentic workflows, and context-aware data platforms. You will play a crucial role in defining architecture strategies, driving innovation, and leading technical teams to deliver cutting-edge capabilities at scale. Key Responsibilities: Lead the architecture design, development, and deployment of AI-powered distributed systems. Develop scalable, reliable, and high-performance sol...

We are seeking an experienced PySpark Developer / Data Engineer to design, develop, and optimize big data processing pipelines using Apache Spark and Python (PySpark). The ideal candidate should have expertise in distributed computing, ETL workflows, data lake architectures, and cloud-based big data solutions. Key Responsibilities: Develop and optimize ETL/ELT data pipelines using PySpark on distributed computing platforms (Hadoop, Databricks, EMR, HDInsight). Work with structured and unstructured data to perform data transformation, cleansing, and aggregation. Implement data lake and data warehouse solutions on AWS (S3, Glue, Redshift), Azure (ADLS, Synapse), or GCP (BigQuery, Dataflow). Op...

Join us as a Solution Architect at Barclays, where you will play a crucial role in supporting the successful delivery of location strategy projects. Your responsibilities will include ensuring projects are completed within planned budgets, meeting quality standards, and adhering to governance procedures. You will lead the evolution of our digital landscape, driving innovation and excellence to enhance our digital offerings and provide exceptional customer experiences. To excel in this role, you should possess expertise in the following areas: - Advanced Ab>Initio and ETL Experience - AWS Architecture, Glue, S3, Iceberg - ETL and Warehouse Architecture - SQL and RDBMS Knowledge - Unix, Linux,...

Required Skills & Experience: Primary Technologies: Python, JavaScript, Apache Iceberg, Apache Spark Benchmarking : TPC-H, TPC-DS benchmark implementation and analysis Performance Tools : Trino, PyIceberg, Data Fusion, Performance optimization Testing Frameworks : Performance testing tools, Load testing, Bottleneck analysis Infrastructure : Kubernetes, distributed systems performance Experience : 4+yrs in Performance engineering, Bigdata, Query optimization

Hiring Scala Data Engineer (7+ yrs, Bangalore Hybrid) – Must have Scala, Spark, SQL, DS & Algo, Cloud (Azure). Preferred: Kafka, Hadoop, CI/CD, Airflow, Iceberg, NoSQL, Data Governance. Required Candidate profile Scala Data Engineer (7+ yrs) with expertise in Scala, Spark, SQL, DS & Algo, Azure. Skilled in Kafka, Hadoop, CI/CD, Airflow, NoSQL, Data Governance, building scalable & reliable pipelines.

The Applications Development Sr Programmer Analyst will work in the Information Management team of Services Technologies, focusing on Big Data and public cloud adoption projects. This intermediate-level position involves participating in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The primary objective is to contribute to applications systems analysis and programming activities. Responsibilities: - Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems an...

As a Data Engineer - Pyspark at Barclays, you will play a pivotal role in advancing our infrastructure and deployment pipelines, fostering innovation and operational excellence. Your responsibility will include leveraging state-of-the-art technology to develop and manage robust, scalable, and secure infrastructure, ensuring the seamless delivery of our digital solutions. To excel in this role, you should possess expertise in PySpark and Python, along with a strong foundation in SQL. You must exhibit proficiency in writing and debugging code, coupled with being a quick learner with exceptional analytical and problem-solving skills. Effective written and verbal communication skills are essenti...

At Citi, we are not just building technology, we are building the future of banking. Our teams encompass a broad range of specialties, roles, and cultures, creating innovations used across the globe. Citi is constantly growing and progressing through our technology, with a laser focus on evolving the ways of doing things. As one of the world's most global banks, we are changing how the world does business. Shape your career with Citi. We are currently looking for a high-caliber professional to join our team as an Officer, Python Developer-C11- Hybrid based in Pune, India. Being part of our team means that we will provide you with the resources to meet your unique needs, empower you to make h...

The Applications Development Sr Programmer Analyst will work in Information management team of Services Technologies, on projects focusing Big Data and public cloud adoption. It is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities. Responsibilities: Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised appli...

Join us as a Data Engineer responsible for supporting the successful delivery of Location Strategy projects to plan, budget, agreed quality and governance standards. You'll spearhead the evolution of our digital landscape, driving innovation and excellence. You will harness cutting-edge technology to revolutionise our digital offerings, ensuring unparalleled customer experiences. To be successful as a Data Engineer, you should have experience with hands-on experience in pyspark and strong knowledge of Dataframes, RDD, and SparkSQL. Additionally, experience in developing, testing, and maintaining applications on AWS Cloud is crucial. A strong hold on the AWS Data Analytics Technology Stack (G...

Join us as a Cloud Data Engineer (AWS) at Barclays, where you will be responsible for supporting the successful delivery of location strategy projects to plan, budget, agreed quality, and governance standards. You'll spearhead the evolution of our digital landscape, driving innovation and excellence. You will harness cutting-edge technology to revolutionize our digital offerings, ensuring unparalleled customer experiences. To be successful as a Cloud Data Engineer (AWS) you should have experience with AWS cloud services such as S3, Glue, Athena, Lake Formation, CloudFormation, etc. You should also have a strong SQL knowledge, proficiency in PySpark, a very good understanding of writing and d...

Key Responsibilities: Ontology Development: Design and implement ontologies based on BFO and CCO principles, ensuring alignment with business needs and industry standards. Collaborate with domain experts to capture and formalize domain knowledge into ontological structures. Develop and maintain comprehensive ontologies modeling business entities, relationships, and processes. Data Modeling: Design and implement semantic and syntactic data models adhering to ontological principles. Create scalable, flexible, and adaptable data models to meet evolving business requirements. Integrate data models with existing data infrastructure and applications. Knowledge Graph Implementation: Design and buil...

Job Description Principal Software Engineer The Platforms organization at Fanatics is at the heart of our company&aposs data-driven decision making, building foundational capabilities that empower our application/data engineers and data scientists to unlock the power of data. We work relentlessly on enhancing the fan experience With Exciting Projects Across a Diverse Landscape, Including Commerce Applications: Architecting and designing D2C and B2B commerce applications with workloads distributed across a multi-cloud topology to engage fans around the world. Storage Infrastructure: Building and managing scalable and reliable data storage solutions. Streaming Data Processing: Handling real-ti...

???? Were Hiring: Senior Data Engineer 7+ Years Experience ???? Location: Gurugram, Haryana, India ???? Duration: 6 Months C2H (Contract to Hire) ???? Apply Now: [HIDDEN TEXT] ???? What Were Looking For: ? 7+ years of experience in data engineering ? Strong expertise in building scalable, robust batch and real-time data pipelines ? Proficiency in AWS Data Services (S3, Glue, Athena, EMR, Kinesis, etc.) ? Advanced SQL skills and deep knowledge of file formats: Parquet, Delta Lake, Iceberg, Hudi ? Hands-on experience with CDC patterns ? Experience with stream processing (Apache Flink , Kafka Streams) and distributed frameworks like PySpark ? Expertise in Apache Airflow for workflow orchestrati...