86 Apache Iceberg Jobs

At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide. When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success. Apache Iceberg Developer at BairesDev We are seeking an Apache Iceberg Developer to work on distributed data table formats and metadata manageme...

Skill:-Apache Iceberg Exp- 3 -12 Yrs Job Description: Must Have Skills: • Good experience in Apache Iceberg, Apache Spark, Trino • Proficiency in SQL and data modeling Nice To Have Skills: Technical/Functional Skills Key Qualifications • Experience with open Data Lakehouse using Apache Iceberg • Experience with Data Lakehouse architecture with Apache Iceberg and Trino • Experience with building/managing Lakehouse for large scale data platforms storage, computing aspects, data ingestion/governance and data management and performance. • Experience with distributed computing technology(s) like Spark. • Experience with data platforms, data lakes and ingestion systems that work at scale. • Skille...

Required Skills: Data Engineer, AWS, Spark, Apache Airflow, Kafka, Snowflake, DBT, Flink, CI / CD Pipelines, Apache Iceberg, Glue

Hiring an AWS Data Engineer for a 6-month hybrid contractual role based in Bellandur, Bengaluru. The ideal candidate will have 4-6 years of experience in data engineering, with strong expertise in AWS services (S3, EC2, RDS, Lambda, EKS), PostgreSQL, Redis, Apache Iceberg, and Graph/Vector Databases. Proficiency in Python or Golang is essential. Responsibilities include designing and optimizing data pipelines on AWS, managing structured and in-memory data, implementing advanced analytics with vector/graph databases, and collaborating with cross-functional teams. Prior experience with CI/CD and containerization (Docker/Kubernetes) is a plus.

Job Description We are Omnissa! The world is evolving fast, and organizations everywherefrom corporations to schoolsare under immense pressure to provide flexible, work-from-anywhere solutions. They need IT infrastructure that empowers employees and customers to access applications from any device, on any cloud, all while maintaining top-tier security. That's where Omnissa comes in. The Omnissa Platform is the first AI-driven digital work platform that enables smart, seamless and secure work experiences from anywhere. It uniquely integrates multiple industry-leading solutions including Unified Endpoint Management, Virtual Apps and Desktops, Digital Employee Experience, and Security & Complia...

At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide. When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success. Staff Apache Impala Engineer at BairesDev We are seeking a Staff Apache Impala Engineer with deep expertise in SQL query engines, columnar stora...

Job Description Key Responsibilities . Implement frontend (React + TypeScript) and backend (TypeScript on Node.js Java/Spring Boot where needed) features with CI/CD discipline. . Rapidly provision and operate AWS components per sprint needs following leastprivilege and security best practices. . Ensure code quality: MR reviews, automated tests (unit/integration/E2E), green pipelines, release readiness. . Produce concise technical documentation and reference guides for enablement across teams. . Collaborate with architects and product stakeholders refine requirements support cutovers. MustHave Skills: . AWS (strong, handson): quickly spin up services (IAM, VPC/SecGroups, KMS, CloudWatch, Secr...

Role Overview: As the Team Lead of Data Engineering, you will be responsible for driving the design, development, and optimization of data engineering pipelines and services with a strong software engineering mindset. Your role will also involve fostering growth and collaboration within the team, mentoring junior colleagues, and refining processes to maintain excellence. If you are eager to have a lasting impact both technically and as a team leader, we are excited to meet you. Key Responsibilities: - Utilize very strong software engineering principles to write maintainable, scalable code, primarily in Python (experience with Rust or C# is a plus). - Perform data processing and manipulation ...

Role Overview: As a Technical Lead Engineer - Data at our company, you will be responsible for architecting, implementing, and scaling our end-to-end data platform built on AWS S3, Glue, Lake Formation, and DMS. Your role will involve leading a small team of engineers and collaborating cross-functionally with stakeholders from various departments to ensure reliable, timely, and secure data access across the business. Additionally, you will champion best practices in data design, governance, and observability, leveraging GenAI tools to enhance engineering productivity and accelerate time to insight. Key Responsibilities: - Own the design and scalability of the data lake architecture for both ...

As a Software Data Engineer at FTSE Russell, you will be part of a team dedicated to building scalable data systems with real-world impact. Your role will involve designing and developing testable data pipelines using Python and Apache Spark. You will orchestrate data workflows with AWS tools like Glue, EMR Serverless, Lambda, and S3. Applying modern software engineering practices will be a key part of your responsibilities, including version control, CI/CD, modular design, and automated testing. Additionally, you will contribute to the development of a lakehouse architecture using Apache Iceberg. Collaboration with business teams to translate requirements into data-driven solutions, buildin...

As an experienced Data Engineer at Regnology, you will play a crucial role in designing ingestion pipelines, optimizing query performance, and ensuring data quality, governance, and cost efficiency at scale. Your responsibilities will include: - **Migration Strategy & Execution**: - Design and implement data ingestion pipelines to extract data from Oracle into GCS/Iceberg. - Migrate and modernize existing Oracle schemas, partitions, and materialized views into Iceberg tables. - Define CDC (Change Data Capture) strategies using custom ETL. - **Data Lakehouse Architecture**: - Configure and optimize Trino clusters (coordinator/worker, Helm charts, autoscaling). - Design partitioning, compactio...

As a Senior Data Engineer at our company, you will play a crucial role in leading the development of a scalable data ingestion framework and ensuring high data quality and validation. Your responsibilities will include: - Architecting, developing, and maintaining end-to-end data ingestion framework for extracting, transforming, and loading data from diverse sources - Utilizing AWS services such as Glue, Lambda, EMR, ECS, EC2, and Step Functions to build scalable, resilient automated data pipelines - Developing and implementing automated data quality checks, validation routines, and error-handling mechanisms - Establishing comprehensive monitoring, logging, and alerting systems for data quali...

Build Your Career at Informatica We're looking for a diverse group of collaborators who believe data has the power to improve society. Adventurous minds who value solving some of the world's most challenging problems. Here, employees are encouraged to push their boldest ideas forward, united by a passion to create a world where data improves the quality of life for people and businesses everywhere. Principal Software Engineer - Distributed Systems and Data Engineering, Cloud Metadata Platform We're looking for a Principal Software Engineer who will lead critical innovation efforts on the Informatica Data Management Cloud with a strong focus on building cloud-native, distributed data systems ...

At Seismic, we're proud of our engineering culture where technical excellence and innovation drive everything we do. We're a remote-first data engineering team responsible for the critical data pipeline that powers insights for over 2,300 customers worldwide. Our team manages all data ingestion processes, leveraging technologies like Apache Kafka, Spark, various C# microservices services, and a shift-left data mesh architecture to transform diverse data streams into the valuable reporting models that our customers rely on daily to make data-driven decisions. Additionally, we're evolving our analytics platform to include AI-powered agentic workflows. Who You Are Have working knowledge of one ...

At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide. When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success. Principal Data Lake Engineer at BairesDev We are seeking a Principal Data Lake Engineer with deep expertise in data lake architecture, schema-on...

Kindly find the Job Description Below. Job Title:Technical Lead-Azure Data Engineer Location: Bangalore Years of Experience: 10+ years of experience Sigmoid works with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software Development Engineer. As an Technical Lead- Data Engineer, you will be responsible for building a highly-scalable and extensible big data platform that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels. We are looking for a skilled Data Engineer with 10+ years of experience in...

Lead Data Engineer Skills Mandatory- S3, Glue, Lambda, Step Function, Snowflake . Skills - Primary - PySpark, Snowflake. Skills - Good to have - Cassandra Total Experience - 7+ years ; Relevant Experience - 5+ years Work Location : Cochin/TVM Job Purpose Responsible for consulting for the client to understand their data needs and delivering data solution to the client. Job Description / Duties & Responsibilities Data Ingestion Framework: oDesign & Development: Design, develop, and maintain an end-to-end data ingestion framework that efficiently extracts, transforms, and loads data from diverse sources. oFramework Optimization: Use AWS services such as AWS Glue, Lambda, EC2 and Step Functions...

We are looking for a Senior Data Warehouse Administrator to bolster our expanding data infrastructure team. You'll bring substantial expertise in architecting, managing, and optimizing large-scale data warehousing environments. Hands-on experience with modern data lake architectures, specifically leveraging Apache Iceberg for data organization and schema evolution, is essential. We're also looking for solid practical experience in building and maintaining robust data ingestion pipelines, ideally incorporating awareness of various Change Data Capture (CDC) tools to ensure efficient and timely data flow. Your deep SQL performance tuning skills will be critical, as will your ability to drive th...

We are seeking an experienced and highly motivated Senior Data Engineer to join our dynamic team. The ideal candidate will play a critical role in designing, developing, and maintaining high-performance data infrastructure and pipelines. As a Senior Data Engineer, you will be responsible for ensuring the scalability, performance, and reliability of data systems that support business intelligence, analytics, and data science initiatives across the organization. You will work in a collaborative environment with cross-functional teams to translate business needs into technical solutions and help shape the organizations overall data strategy. This role offers an excellent opportunity to work wit...

Job Title: Data Test Engineer Job Description We are seeking a skilled Data Quality Engineer to join our data team. The successful candidate will be instrumental in ensuring the quality, accuracy, and reliability of our data pipelines, machine learning models, and cloud-based solutions. Key Responsibilities: Test Strategy and Planning: Develop and implement comprehensive test strategies for data processing and machine learning pipelines, ensuring alignment with business requirements. Test Automation: Design, build, and maintain automated test frameworks using Python to validate Apache Spark jobs, Iceberg table operations, and complex data pipelines. Data Validation and Quality Assurance: Imp...

At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide. When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success . Senior Data Lake Engineer at BairesD ev We are seeking a Senior Data Lake Engineer with expertise in data lake architecture, schema-on-read, da...

Title: Staff Data Software Engineer Reporting to: Director, Data & AI Location: Bengaluru (Bangalore) Opportunity Get Well is seeking a skilled and motivated Staff Data Software Engineer to help build and optimize our cloud-native data platform supporting AI, analytics, and clinical applications. You will play a key role in developing secure and scalable data pipelines and collaborating with cross-functional teams to deliver high-quality data solutions in a regulated healthcare environment. This is a hands-on engineering role ideal for someone who enjoys building data infrastructure, working with modern cloud data platforms, and contributing to the architecture and performance of large-scale...

Title: Data Software Engineer, Platform Engineering Reporting to: Senior Director, Product Development Location: Bengaluru (Bangalore) Opportunity: Get Well is seeking a technically adept Data Software Engineer, Platform Engineering to implement, maintain and optimize our cloud-native data platform supporting AI, analytics, and clinical applications. This role will work with the architect to implement scalable, secure, and high-performance data pipelines and processing systems within a regulated healthcare environment. The Data Software Engineer will focus on implementing and optimizing data processing workflows, ensuring data quality, and adhering to healthcare compliance standards such as ...

Job Description What We Do At Goldman Sachs, our Engineers don't just make things we make things possible. Change the world by connecting people and capital with ideas. Solve the most challenging and pressing engineering problems for our clients. Join our engineering teams that build massively scalable software and systems, architect low latency infrastructure solutions, proactively guard against cyber threats, and leverage machine learning alongside financial engineering to continuously turn data into action. Create new businesses, transform finance, and explore a world of opportunity at the speed of markets. Engineering, which is comprised of our Technology Division and global strategists ...

As an Applications Development Group Manager within the Data Engineering group at Citi, you will play a pivotal role in the company's broad transformation strategy. Your responsibilities will include providing architectural vision, developing strategies, planning solutions on an enterprise level, and maintaining awareness of business, technical, and infrastructure issues. You will collaborate with stakeholders globally to develop, implement, and roll out technology solutions to address complex business problems. **Responsibilities:** - Provide architectural vision ensuring conformity to enterprise blueprints - Develop architecture, strategy, planning, and problem-solving solutions on an ente...