121 Apache Iceberg Jobs - Page 3

Kindly find the Job Description Below. Job Title:Technical Lead-Azure Data Engineer Location: Bangalore Years of Experience: 10+ years of experience Sigmoid works with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software Development Engineer. As an Technical Lead- Data Engineer, you will be responsible for building a highly-scalable and extensible big data platform that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels. We are looking for a skilled Data Engineer with 10+ years of experience in...

Lead Data Engineer Skills Mandatory- S3, Glue, Lambda, Step Function, Snowflake . Skills - Primary - PySpark, Snowflake. Skills - Good to have - Cassandra Total Experience - 7+ years ; Relevant Experience - 5+ years Work Location : Cochin/TVM Job Purpose Responsible for consulting for the client to understand their data needs and delivering data solution to the client. Job Description / Duties & Responsibilities Data Ingestion Framework: oDesign & Development: Design, develop, and maintain an end-to-end data ingestion framework that efficiently extracts, transforms, and loads data from diverse sources. oFramework Optimization: Use AWS services such as AWS Glue, Lambda, EC2 and Step Functions...

We are looking for a Senior Data Warehouse Administrator to bolster our expanding data infrastructure team. You'll bring substantial expertise in architecting, managing, and optimizing large-scale data warehousing environments. Hands-on experience with modern data lake architectures, specifically leveraging Apache Iceberg for data organization and schema evolution, is essential. We're also looking for solid practical experience in building and maintaining robust data ingestion pipelines, ideally incorporating awareness of various Change Data Capture (CDC) tools to ensure efficient and timely data flow. Your deep SQL performance tuning skills will be critical, as will your ability to drive th...

We are seeking an experienced and highly motivated Senior Data Engineer to join our dynamic team. The ideal candidate will play a critical role in designing, developing, and maintaining high-performance data infrastructure and pipelines. As a Senior Data Engineer, you will be responsible for ensuring the scalability, performance, and reliability of data systems that support business intelligence, analytics, and data science initiatives across the organization. You will work in a collaborative environment with cross-functional teams to translate business needs into technical solutions and help shape the organizations overall data strategy. This role offers an excellent opportunity to work wit...

Job Title: Data Test Engineer Job Description We are seeking a skilled Data Quality Engineer to join our data team. The successful candidate will be instrumental in ensuring the quality, accuracy, and reliability of our data pipelines, machine learning models, and cloud-based solutions. Key Responsibilities: Test Strategy and Planning: Develop and implement comprehensive test strategies for data processing and machine learning pipelines, ensuring alignment with business requirements. Test Automation: Design, build, and maintain automated test frameworks using Python to validate Apache Spark jobs, Iceberg table operations, and complex data pipelines. Data Validation and Quality Assurance: Imp...

At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide. When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success . Senior Data Lake Engineer at BairesD ev We are seeking a Senior Data Lake Engineer with expertise in data lake architecture, schema-on-read, da...

Title: Staff Data Software Engineer Reporting to: Director, Data & AI Location: Bengaluru (Bangalore) Opportunity Get Well is seeking a skilled and motivated Staff Data Software Engineer to help build and optimize our cloud-native data platform supporting AI, analytics, and clinical applications. You will play a key role in developing secure and scalable data pipelines and collaborating with cross-functional teams to deliver high-quality data solutions in a regulated healthcare environment. This is a hands-on engineering role ideal for someone who enjoys building data infrastructure, working with modern cloud data platforms, and contributing to the architecture and performance of large-scale...

Title: Data Software Engineer, Platform Engineering Reporting to: Senior Director, Product Development Location: Bengaluru (Bangalore) Opportunity: Get Well is seeking a technically adept Data Software Engineer, Platform Engineering to implement, maintain and optimize our cloud-native data platform supporting AI, analytics, and clinical applications. This role will work with the architect to implement scalable, secure, and high-performance data pipelines and processing systems within a regulated healthcare environment. The Data Software Engineer will focus on implementing and optimizing data processing workflows, ensuring data quality, and adhering to healthcare compliance standards such as ...

Job Description What We Do At Goldman Sachs, our Engineers don't just make things we make things possible. Change the world by connecting people and capital with ideas. Solve the most challenging and pressing engineering problems for our clients. Join our engineering teams that build massively scalable software and systems, architect low latency infrastructure solutions, proactively guard against cyber threats, and leverage machine learning alongside financial engineering to continuously turn data into action. Create new businesses, transform finance, and explore a world of opportunity at the speed of markets. Engineering, which is comprised of our Technology Division and global strategists ...

As an Applications Development Group Manager within the Data Engineering group at Citi, you will play a pivotal role in the company's broad transformation strategy. Your responsibilities will include providing architectural vision, developing strategies, planning solutions on an enterprise level, and maintaining awareness of business, technical, and infrastructure issues. You will collaborate with stakeholders globally to develop, implement, and roll out technology solutions to address complex business problems. **Responsibilities:** - Provide architectural vision ensuring conformity to enterprise blueprints - Develop architecture, strategy, planning, and problem-solving solutions on an ente...

Job Description Become a substential part of the Data Platform team, which provides engineering services across the Media Measurement department. Design, develop, test and deploy big data applications and pipelines. Ensure that your and the teams work follow best practices for ensuring validity, efficiency and maintainability. Collaborate in a distributed, cross-functional agile team of Data Scientists and Cloud Engineers to reached shared goals. Take ownership of technical implementations and architecture together with your team and in alignment with communities of practices. Communicate with data producers & consumers to align on data exchange formats and interfaces. Provide suggestions to...

As a Senior Data Engineer specializing in Data Quality, Ingestion & API Development, your role will involve leading the development of a scalable data ingestion framework with a strong focus on ensuring high data quality and validation. You will also be responsible for designing and implementing robust APIs for seamless data integration. Your expertise in building and managing big data pipelines using modern AWS-based technologies will be crucial for driving quality and efficiency in data processing systems. - **Data Ingestion Framework:** - **Design & Development:** Architect, develop, and maintain an end-to-end data ingestion framework that efficiently extracts, transforms, and loads data ...

At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide. When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success. Senior Data Lake Engineer at BairesDev We are seeking a Senior Data Lake Engineer with expertise in data lake architecture, schema-on-read, data...

About Us MatchMove is a leading embedded finance platform that empowers businesses to embed financial services into their applications. We provide innovative solutions across payments, banking-as-a-service, and spend/send management, enabling our clients to drive growth and enhance customer experiences. Are You The One As a Technical Lead Engineer - Data, you will architect, implement, and scale our end-to-end data platform built on AWS S3, Glue, Lake Formation, and DMS. You will lead a small team of engineers while working cross-functionally with stakeholders from fraud, finance, product, and engineering to enable reliable, timely, and secure data access across the business. You will champi...

Job Title: Data Engineer Job Category: Full-Time Work Location: Hyderabad Qualifications: BE/B.Tech./MTech. /MCA/Degree in Computer Science Experience: 4+ years Key Responsibilities: Build and maintain the ETL pipeline using NiFi and Debezium. Implement data transformations and processing workflows. Configure Iceberg tables and MinIO storage. Optimize query performance with Trino. Required Skills: Proficiency in Apache NiFi, Debezium, and Kafka for data ingestion. Experience with Apache Iceberg and MinIO for data lakehouse setup. Strong SQL skills for data transformation and querying. Familiarity with Trino or Presto for distributed querying. Basic scripting skills (e.g., Python, Bash) for a...

Company Description It all started in sunny San Diego, California in 2004 when a visionary engineer, Fred Luddy, saw the potential to transform how we work. Fast forward to today ServiceNow stands as a global market leader, bringing innovative AI-enhanced technology to over 8,100 customers, including 85% of the Fortune 500. Our intelligent cloud-based platform seamlessly connects people, systems, and processes to empower organizations to find smarter, faster, and better ways to work. But this is just the beginning of our journey. Join us as we pursue our purpose to make the world work better for everyone. Job Description What you get to do in this role: Build high-quality, clean, scalable an...

At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide. When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success. Principal Data Lake Engineer at BairesDev We are seeking a Principal Data Lake Engineer with deep expertise in data lake architecture, schema-on...

Job Description: Manager Technology This position is a hands-on Engineering Leader for new Network Surveillance Management technology that supports AT&T's leading-edge networks and services, such as network virtualization and 5G, which require extensive surveillance and cross-domain correlation across multiple services. Evaluate and introduce strategic technology to enable Service Assurance architectural goals and transformation goals. This position requires technical leadership, innovation, and deep subject matter expertise in Network Service Assurance. Will be responsible for leading software development, data modeling, testing, deployment, and support of Network Service Assurance applicat...

As a Data Engineer at Omnissa, you will play a crucial role in delivering as an individual contributor. You should have a minimum of 2 to 8 years of experience in Data Engineering on AWS. Your responsibilities will include: - Strong Proficiency in SQL, Python, Apache Spark, AWS Data Stack (S3, EMR, Glue Catalog, Athena, Lambda, Airflow), Starburst / Trino. - Solid Understanding of Lakehouse Architecture - Apache Iceberg / Delta Lake. - Experience with CI/CD practices using GitHub Actions. - Ability to collaborate in cross-functional teams and communicate technical concepts clearly. - Mindset to design solutions for scale, proactively involve in additional areas and domains. - Experience with...

At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide. When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success. Data Lake Engineer at BairesDev We are seeking a Data Lake Engineer with expertise in data lake architecture, schema-on-read, data governance, a...

About The Team/Role As a Senior Staff SWE of Data Lake House Engineering, this technical leader will be responsible for the design and implementation of the Data Lake house platform (supporting both Data Engineering and Data Lake house applications), Data Engineering pipeline productionalization (E2E data pipelines, model development, deployment, monitoring, refresh, etc), Data Lake house, and related technology, systems, and tools. This technologist will drive the technology development and architecture in these areas to ensure the platforms, systems, tools, models, and services generated from this team are technically sound with strong security, quality, reliability, usability, scalability...

Job Description Alimentation Couche-Tard Inc., (ACT) is a global Fortune 200 company. A leader in the convenience store and fuel space with over 17,000 stores in 31 countries, serving more than 6 million customers each day It is an exciting time to be a part of the growing Data Engineering team at Circle K. We are driving a well-supported cloud-first strategy to unlock the power of data across the company and help teams to discover, value and act on insights from data across the globe. With our strong data pipeline, this position will play a key role partnering with our Technical Development stakeholders to enable analytics for long term success. About The Role We are looking for a Data Engi...

We are looking for a skilled Data Engineer with 8+ years of experience in big data technologies, particularly Python, PYSpark, SQL and data lakehouse architectures. The ideal candidate will have a strong background in building scalable data pipelines and experience with modern data storage formats, including Apache Iceberg. You will work closely with cross-functional teams to design and implement efficient data solutions in a cloud-based environment. Key Responsibilities: Data Pipeline Development: Design, build, and optimize scalable data pipelines using Apache Spark. Implement and manage large-scale data processing solutions across data lakehouses. Data Lakehouse Management: Work with mode...

As a Senior Lead Engineer specializing in Python and Spark in AWS at LSEG, you will be responsible for designing, building, and maintaining robust, scalable, and efficient ETL pipelines. Your primary focus will be on ensuring alignment with data lakehouse architecture on AWS and optimizing workflows using services such as Glue, Lambda, and S3. Collaborating with cross-functional teams, you will gather requirements, provide technical insights, and deliver high-quality data solutions. Your role will involve driving the migration of existing data processing workflows to the lakehouse architecture, leveraging Iceberg capabilities, and enforcing best practices for coding standards and system arch...

Role Overview: As a Senior Data Warehouse Administrator at FloQast, you will play a crucial role in bolstering the expanding data infrastructure team. Your expertise in architecting, managing, and optimizing large-scale data warehousing environments is essential to ensure the efficiency and reliability of the data platform. You will be responsible for designing, implementing, and maintaining scalable and secure data warehouse environments, optimizing data warehouse performance, managing data ingestion pipelines, enforcing data governance and compliance policies, and mentoring junior data warehouse administrators. Key Responsibilities: - Design, implement, and maintain scalable and secure dat...