134 Iceberg Jobs

Role & responsibilities Work as a project manager to Lead the design and evolution of our large-scale data lakehouse architecture, ensuring it is scalable, reliable, and cost-effective. Provide technical leadership and mentorship to data engineers and analysts. Collaborate closely with Software Engineers, and business stakeholders to understand requirements and deliver effective data solutions. Experience in data modelling, data mapping, data profiling and meta data management. Architect and tune high-performance data processing pipelines. Identify and resolve complex performance issues in distributed computing environments involving Spark execution, Hive query optimization, and Iceberg meta...

Develop and migrate data pipelines using Spark, Python/Scala. Move Hive and Control-M jobs to Airflow/DBT. Integrate with Kafka, Solace, S3, MinIO, and deploy on Kubernetes ensuring scalable, automated, production-ready solutions. Required Candidate profile Experienced Data Engineer (6–9 yrs) with strong Spark, Python/Scala, and SQL skills. Hands-on in Airflow, DBT, Kafka, Kubernetes, and data lakehouse tools.Capable of independent delivery and migration

Company Overview Milestone Technologies is a global IT managed services firm that partners with organizations to scale their technology, infrastructure and services to drive specific business outcomes such as digital transformation, innovation, and operational agility. Milestone is focused on building an employee-first, performance-based culture and for over 25 years, we have a demonstrated history of supporting category-defining enterprise clients that are growing ahead of the market. The company specializes in providing solutions across Application Services and Consulting, Digital Product Engineering, Digital Workplace Services, Private Cloud Services, AI/Automation, and ServiceNow. Milest...

Role & responsibilities Hands-on experience designing and implementing AWS cloud infrastructure at scale, leveraging services such as Glue, Lambda, S3, SNS, and EventBridge. Proficiency in scripting languages like Python or Bash for automating cloud operations, ETL workflows, and Snowflake tasks. Expertise in Snowflake Data Platform, including: Data modelling and Governance, schema design, and query optimization. Implementing Snowflake best practices for performance tuning, cost optimization, and security. Managing Snowflake features such as Virtual Warehouses, Streams, Tasks, Masking, and Time Travel. Strong understanding of ETL/ELT methodologies, with experience integrating diverse data so...

You have a strong background in data engineering or a related field with over 8 years of experience. Your expertise includes hands-on experience with Azure Databricks, Spark, Python/Scala, CICD, and scripting for data processing. You have worked with multiple file formats such as Parquet, Delta, and Iceberg, and have knowledge of streaming technologies like Kafka for real-time data ingestion. Additionally, you are experienced in data governance and data security in Azure, and have a deep understanding of Azure Data Services. Key Responsibilities: - Utilize Azure Databricks, Spark, Python, and Scala for scalable and distributed data processing. - Work with various file formats like Parquet, D...

At JPMorgan Chase, you'll have the opportunity to advance your career and push the boundaries of data engineering by developing innovative, secure solutions that transform financial services. As a Data Engineer at JPMorgan Chase within the Employee Platforms team, you will become an integral part of an agile team dedicated to enhancing, building, and delivering trusted market-leading technology products in a secure, stable, and scalable way. Job Responsibilities Execute creative software and data solutions, including design, development, and technical troubleshooting, by thinking beyond routine or conventional approaches to build solutions or break down technical problems. Develop secure, hi...

As a Software Engineer III at JPMorgan Chase within the Commercial & Investment Bank, you will be part of an agile team responsible for designing and delivering trusted market-leading technology products in a secure, stable, and scalable manner. Your role involves executing software solutions, developing high-quality production code, and contributing to the continuous improvement of software applications and systems. You will also be accountable for ensuring design constraints are met by software code development. **Key Responsibilities:** - Execute software solutions, design, development, and technical troubleshooting with innovative approaches - Create secure and high-quality production co...

Role Overview: You will be responsible for leading and managing the technical strategy and execution of financial technology services within Fanatics Commerce. As the Director of Engineering, Financial Technology Systems, you will need to possess strategic vision, technical expertise, and a deep understanding of financial systems to deliver scalable and compliant solutions. Your role will involve overseeing the integration and daily operation of Oracle ERP and Microsoft D365 ERP systems, leveraging AWS, OCI, and Azure to manage a collection of integration services. Key Responsibilities: - **Technical Leadership:** - Manage a large team aligned to execute on the strategic goals of the Fanatic...

Company Overview Milestone Technologies is a global IT managed services firm that partners with organizations to scale their technology, infrastructure and services to drive specific business outcomes such as digital transformation, innovation, and operational agility. Milestone is focused on building an employee-first, performance-based culture and for over 25 years, we have a demonstrated history of supporting category-defining enterprise clients that are growing ahead of the market. The company specializes in providing solutions across Application Services and Consulting, Digital Product Engineering, Digital Workplace Services, Private Cloud Services, AI/Automation, and ServiceNow. Milest...

Job Title: Data Platform Engineer Job Type: 8 months contract Duration: through July 2026, with strong possibility to extend. Hours: 3:30 pm to 12:30 am IST Notice: Max 15 days Location: 100% remote Summary: In this role you will have the chance to build large additions to our platform ecosystem, contributing to an infrastructure that centralizes our ETL and streaming infrastructure, enables experimentation and data development, and powers algorithm development. You will design and build scalable engineering solutions to solve business and data problems. Requirements: You have a degree in an engineering or computer science field • You have 3+ years of work experience in platform engineering ...

To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts. Job Category Data Job Details About Salesforce Salesforce is the #1 AI CRM, where humans with agents drive customer success together. Here, ambition meets action. Tech meets trust. And innovation isn't a buzzword it's a way of life. The world of work as we know it is changing and we're looking for Trailblazers who are passionate about bettering business and the world through AI, driving innovation, and keeping Salesforce's core values at the heart of it all. Ready to level-up your career at the company leading workforce transformation in the agen...

Location : Bangalore, Chennai, Pune & Hyderabad Must have skills: ETL/ SQL with pyspark Experience and expertise in pipeline/ETL (Extract, Transform, Load) processes, API integration, scripting languages (Python), and big data technologies (Trio, Iceberg, DuckDB/Parquet). Database design, data modeling, and data warehousing. SQL and at least one cloud platform. Analytical tools (Superset, Power BI), statistical analysis, and SQL. To derive insights from data. Data governance principles and data quality. Data management, data integration projects using IPAAS tools like IBM Sterling, Mulesoft, Dell Boomi About Finacle Finacle is an industry leader in digital banking solutions. We partner with ...

Role: Junior Data Engineer Experience: 0 - 1 Year Qualification: BE / B.Tech, BSc, MSc, BCA, MCA with a minimum of 75% in academics Location: Chennai Employment: Full-time Note: Year of Passing - 2025, 2026 Role Overview: We are looking for passionate and enthusiastic fresh graduates to join our Data Engineering & Analytics team . As a Data Engineer Fresher , you will learn and contribute to building, maintaining, and optimizing modern data pipelines and analytics solutions using technologies like Snowflake, AWS, Apache Airflow, Kafka, Iceberg, and Python . This role provides an excellent opportunity to gain hands-on experience with large-scale data systems and cloud platforms while working ...

As an Enterprise Architect-Vice President at Barclays, your primary responsibility will be to build a scalable data platform utilized across the organization with modern tools and capabilities. Your role will involve enhancing central enterprise architecture capabilities to govern and influence development processes while facilitating integration. To be successful in this role, you should have experience and knowledge in the following areas: - Knowledge of industry-standard enterprise data platform stack technologies and ideally the AWS technology stack, including catalogue, governance, storage and transformation, streaming, data publication, and data consumption capabilities. - Strong commu...

At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide. When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success. Senior Apache Spark Developer at BairesDev We are seeking a Senior Apache Spark Developer to work on distributed data processing systems and rea...

Virima is a leading provider of cloud-based IT Discovery and ITSM solutions, helping enterprises gain visibility and control over their IT infrastructure. We're building the next generation of our platform as a multi-tenant, AI-enabled, container-native cloud platform with a focus on scalability, reliability, and performance. Role Overview We are seeking an SDE2/Software Development Engineer II with 2-5 years of experience to independently design, develop, and optimize scalable features for the Virima cloud platform. This role focuses on owning medium-sized components of our distributed systems, working with modern cloud-native technologies including Kubernetes, Consul, Istio, Redis, MinIO, ...

We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Lead Software Engineer at JPMorgan Chase within the Corporate & Investment Bank Technology team, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. As a core technical contributor, you are responsible for conducting critical technology solutions across multiple technical areas within various business functions in support of the firm's business objectives Job responsibilities Executes creative software solutions, design, development, and technical troublesh...

About the company Our client is a global, AI-powered EdFinTech company, dedicated to simplifying and democratizing access to education financing for students pursuing studies abroad. By leveraging technology and strategic partnerships, our client aims to provide seamless, transparent, and affordable financial solutions to empower the next generation of global leaders. Responsibilities The ideal candidate will bring strong experience in building data pipelines, managing data infrastructure, and deploying ML models into production. This is a hands on, high-impact role that blends data engineering and machine learning to drive actionable intelligence across the business. Responsibilities: Data ...

Harness is a high-growth company that is disrupting the software delivery market. Our mission is to enable the 30 million software developers in the world to deliver code to their users reliably, efficiently, securely and quickly, increasing customers pace of innovation while improving the developer experience. We offer solutions for every step of the software delivery lifecycle to build, test, secure, deploy and manage reliability, feature flags and cloud costs. The Harness Software Delivery Platform includes modules for CI, CD, Cloud Cost Management, Feature Flags, Service Reliability Management, Security Testing Orchestration, Chaos Engineering, Software Engineering Insights and continues...

As a Cloud Data Engineer at Barclays, you will spearhead the evolution of infrastructure and deployment pipelines, driving innovation and operational excellence. Your role involves harnessing cutting-edge technology to build and manage robust, scalable, and secure infrastructure, ensuring seamless delivery of digital solutions. **Key Responsibilities:** - Build and maintain data architectures pipelines for transferring and processing durable, complete, and consistent data. - Design and implement data warehouses and data lakes that manage appropriate data volumes, velocity, and adhere to required security measures. - Develop processing and analysis algorithms suitable for the intended data co...

Build Your Career at Informatica We're looking for a diverse group of collaborators who believe data has the power to improve society. Adventurous, work-from-anywhere minds who value solving some of the world's most challenging problems. Here, employees are encouraged to push their boldest ideas forward, united by a passion to create a world where data improves the quality of life for people and businesses everywhere. Informatica is on a journey to leverage generative AI for cloud data management. We are looking for a Principal Machine Learning Engineer with experience in building applications using generative AI and design and development of large-scale Artificial Intelligence/Machine Learn...

At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide. When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success. Principal Apache Hive Engineer at BairesDev We are seeking a Principal Apache Hive Engineer to work on data warehouse systems and large-scale ba...

At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide. When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success. Apache Hive Developer at BairesDev We are seeking an Apache Hive Developer to work on data warehouse systems and large-scale batch analytics. Yo...

We are building a unified data platform to serve 20+ product modules, enabling ingestion, processing, and retrieval of data to power analytics & systems at scale. This role is part of the Data Ingestion charter under the Unified Data Platform umbrella, focused on designing and developing an extremely high-scale ingestion platform with focus on data streaming, open table based data storage, and highly scalable transformation layer. This platform is the foundation to multiple experiences within Harness including dashboard, analytics, and product utilization. About the Role You will participate in the design, architecture & development of this platform alongside principal engineers & architects...

We are building a unified data platform to serve 20+ product modules, enabling ingestion, processing, and retrieval of data to power analytics & systems at scale. This role is part of the Data Ingestion charter under the Unified Data Platform umbrella, focused on designing and developing an extremely high-scale ingestion platform with focus on data streaming, open table based data storage, and highly scalable transformation layer. This platform is the foundation to multiple experiences within Harness including dashboard, analytics, and product utilization. About the Role You will participate in the design, architecture & development of this platform alongside principal engineers & architects...