134 Iceberg Jobs - Page 2

At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide. When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success. Staff Apache Hive Engineer at BairesDev We are seeking a Staff Apache Hive Engineer to work on data warehouse systems and large-scale batch anal...

Who We Are We are an organisation that exists to drive progress. That's the red thread that connects everyone at The Economist Group (TEG). Our businesses share a devotion to innovation, independence and rigour in their fields of expertise. We empower people to understand and tackle the critical challenges and changes facing the world. Our analytical rigour, global expertise and evidence-based insights enable individuals and organisations to make sense of these shifts and chart a course through them. We deliver analysis and insights in many formats to subscribers and clients in 170 countries through our four businesses, The Economist, Economist Impact, Economist Intelligence and Economist Ed...

About Us Observe.AI is the leading AI agent platform for customer experience. It enables enterprises to deploy AI agents that automate customer interactions, delivering natural conversations for customers with predictable outcomes for the business. Observe.AI combines advanced speech understanding, workflow automation, and enterprise-grade governance to execute end-to-end workflows with AI agents. It also enables teams to guide and augment human agents with AI copilots, and analyze 100% of human and AI interactions for insights, coaching, and quality management. Companies like DoorDash, Affordable Care, Signify Health, and Verida use Observe.AI to transform customer experiences every day by ...

Role Overview: At EY, you'll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture, and technology to become the best version of you. We are counting on your unique voice and perspective to help EY become even better. Join us to build an exceptional experience for yourself and contribute to creating a better working world for all. Key Responsibilities: - Develop, deploy, and monitor machine learning models in production environments. - Automate ML pipelines for model training, validation, and deployment. - Optimize ML model performance, scalability, and cost efficiency. - Implement CI/CD workflows for ML model versioning, testing, and deplo...

As a Software Engineer at Google, you will be developing next-generation technologies that impact how billions of users connect, explore, and interact with information and each other. Your role will involve handling information at massive scales and contributing to various areas such as information retrieval, distributed computing, system design, networking, security, artificial intelligence, and more. You will have the opportunity to work on critical projects and collaborate with diverse teams, showcasing your leadership skills and adaptability as you tackle new challenges across the full technology stack. Key Responsibilities: - Enhance Apache Spark for improved performance, reliability, s...

Join us as a Data Engineer at Barclays, where you will spearhead the evolution of our infrastructure and deployment pipelines, driving innovation and operational excellence. You will harness cutting-edge technology to build and manage robust, scalable and secure infrastructure, ensuring seamless delivery of our digital solutions. To be successful as a Data Engineer, you should have experience with: Hands on experience in pyspark and strong knowledge on Dataframes, RDD and SparkSQL. Hands on Experience in developing, testing and maintaining applications on AWS Cloud. Strong hold on AWS Data Analytics Technology Stack (Glue, S3, Lambda, Lake formation, Athena). Design and implement scalable an...

Job Description YOUR IMPACT Are you passionate about leveraging cutting-edge AI/ML techniques, including Large Language Models, to solve complex, mission-critical problems in a dynamic environment Do you want to contribute to safeguarding a leading global financial institution OUR IMPACT We are Compliance Engineering, a global team of engineers and scientists dedicated to preventing, detecting, and mitigating regulatory and reputational risks across Goldman Sachs. We build and operate a suite of platforms and applications that protect the firm and its clients. We Offer Access to vast amounts of structured and unstructured data to fuel your AI/ML models, including textual data suitable for LL...

10+ years of experience in data architecture, distributed systems, or ML platform engineering. Deep experience building on-premises or hybrid data systems (e.g., Spark, Kafka, Trino, Iceberg, Airflow). Strong understanding of LLM architecture, embeddings, vector search, and agentic workflows. Proven experience designing and implementing ML pipelines, inference runtimes, and data retrieval frameworks. Proficiency with at least one programming language (e.g., Python, Go, Java) and AI/ML frameworks (e.g., LangChain, Haystack, Hugging Face Transformers). Demonstrated expertise in designing and building scalable, production-grade RESTful APIs, enabling seamless integration across distributed syst...

Data Platform Engineer 241 Key Responsibilities Develop and maintain end-to-end data pipelines for ingesting, wrangling, transforming, and joining data from diverse sources. Design and implement scalable, high-performance ETL pipelines using tools such as AWS Glue, Databricks, Apache Airflow, and DataProc. Develop data models, schemas, and storage solutions for relational, NoSQL, and lakehouse environments (Snowflake, BigQuery, Delta Lake). Optimize data pipelines for performance and cost, including infrastructure considerations. Implement CI/CD pipelines for data solutions and infrastructure using tools like GitHub Actions, Jenkins, Terraform, or similar. Collaborate with teams to define ar...

Job Category Data Job Details About Salesforce Salesforce is the #1 AI CRM, where humans with agents drive customer success together. Here, ambition meets action. Tech meets trust. And innovation isn't a buzzword - it's a way of life. The world of work as we know it is changing and we're looking for Trailblazers who are passionate about bettering business and the world through AI, driving innovation, and keeping Salesforce's core values at the heart of it all. Ready to level-up your career at the company leading workforce transformation in the agentic era You're in the right place! Agentforce is the future of AI, and you are the future of Salesforce. As a Senior Data Engineer on our Marketin...

Position Overview The Team Lead for Advanced Data Systems Delivery will lead a team responsible for delivering high-performance, scalable data solutions, with a focus on designing and optimizing data architectures for mission-critical Tier 1 systems. This role requires deep expertise in deploying real-time and batch processing systems, utilizing the ArcOne AI platform to architect scalable topologies, tune critical components, and ensure compliance with NFRs and SLAs, while maintaining a strong foundation in data architecture principles. Key Responsibilities Project Leadership & Delivery : Lead the end-to-end delivery of advanced data systems for mission-critical Tier 1 applications, focusin...

The D. E. Shaw group is a global investment and technology development firm with more than $60 billion in investment capital as of March 1, 2024, and offices in North America, Europe, and Asia. Since our founding in 1988, our firm has earned an international reputation for successful investing based on innovation, careful risk management, and the quality and depth of our staff. We have a significant presence in the world's capital markets, investing in a wide range of companies and financial instruments in both developed and developing economies. We seek an experienced data engineer to join our Equities team at the D. E. Shaw India office in Hyderabad/Gurugram. The Equities India group colla...

Data Architect Pando (www.pando.ai) is pioneering the future of autonomous logistics with innovative AI capabilities. Trusted by Fortune 500 enterprises with global customers across North America, Europe, and Asia Pacific regions, we are leading the global disruption of supply chain software, with our AI-powered, no-code, & unified platform empowering Autonomous Supply Chain. We have been recognized by Gartner for our transportation management capabilities, by the World Economic Forum (WEF) as a Technology Pioneer, by G2 as a Market Leader in Freight Management, and named one of the fastest-growing technology companies by Deloitte. Why Pando? We are one of the fastest growing companies reima...

You are applying for the position of Senior Platform Engineer with Autodesk's Data Platform team. Your main responsibilities will include: - Defining and aligning Data Lake and Data Warehouse usage strategies across the organization - Designing, developing, and maintaining Data Lake and Data Warehouse solutions - Performing and maintaining data lake and data warehouse administration tasks, including user management, security, and performance tuning - Collaborating with data architects, business stakeholders, and other teams to understand data requirements and set up guidelines and processes - Defining cost attribution, optimization, and monitoring strategies for the data platform - Developin...

Data Engineer (36 Years) We are looking for a Data Engineer who can work across modern data platforms and streaming frameworks to build scalable and reliable pipelines. If you enjoy working with Spark on Databricks, Kafka, Snowflake, and MongoDB and want to solve real-world data integration challenges this role is for you. What you'll do: You will develop ETL/ELT pipelines in Databricks (PySpark notebooks) or Snowflake (SQL/Snowpark), ingesting from sources like Confluent Kafka Handle data storage optimizations using Delta Lake/Iceberg formats, ensuring reliability (e.g., time travel for auditing in fintech pipelines). Integrate with Azure ecosystems (e.g., Fabric for warehousing, Event Hubs...

Job Title : Engineering (Data Engineering) Location : Gurgaon Experience Required : 1+ Years Employment Type : Full-Time Department : Data & Analytics About The Role We are looking for a motivated Data Engineer to contribute to the design and development of scalable data frameworks and solutions. The role involves working with big data technologies like Spark, Kafka, and Python/Scala to support data management, analytics, and reporting requirements. This is a hands-on role where you will work closely with senior engineers to implement high-quality data pipelines and applications. Key Responsibilities Work on data ingestion, transformation, and loading (ETL) processes. Support the design and ...

At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide. When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success. Senior Apache Hive Developer at BairesDev We are seeking a Senior Apache Hive Developer to work on data warehouse systems and large-scale batch ...

At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide. When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success. Senior Apache Spark Developer at BairesDev We are seeking a Senior Apache Spark Developer to work on distributed data processing systems and rea...

Title: Data Engineer - PySpark About CentricaSoft: CentricaSoft is a data-driven technology partner delivering end-to-end data solutions for our clients. We design, build, and scale modern data platforms that empower business decisions. We're growing our data engineering team and seeking a hands-on PySpark Developer who thrives in a fast-paced, collaborative environment. Role Summary We are looking for a PySpark Developer with solid AWS or Azure or GCP experience and in-depth knowledge of CI/CD pipelines with Parquet/JSON/Avro/Iceberg/Databricks. The candidate will work on multiple ETL data processing integrations, including API data pulls, Database extracts, and handling semi-structured dat...

Role Overview: As a Senior AWS Data Engineer - Vice President at Barclays, you will lead the evolution of the Reference Data Services function by spearheading the engineering of software components. Your role will involve collaborating with a team of engineers to design, build, and test software components. Effective stakeholder management, leadership, and decision-making will be crucial to support the business strategy and risk management. Your primary focus will be on AWS cloud services, data engineering, and automation using Python, ETL frameworks, data transformation, and data quality tools. Key Responsibilities: - Build and maintain data architectures pipelines to ensure the transfer an...

Join us as a Data Engineer responsible for supporting the successful delivery of Location Strategy projects to plan, budget, agreed quality and governance standards. You'll spearhead the evolution of our digital landscape, driving innovation and excellence. You will harness cutting-edge technology to revolutionise our digital offerings, ensuring unparalleled customer experiences. To be successful as a Data Engineer you should have experience with: Hands on experience in pyspark and strong knowledge on Dataframes, RDD and SparkSQL Hands on Experience in developing, testing and maintaining applications on AWS Cloud. Strong hold on AWS Data Analytics Technology Stack (Glue, S3, Lambda, Lake for...

Join us as a Cloud Data Engineer at Barclays, where you will spearhead the evolution of our infrastructure and deployment pipelines, driving innovation and operational excellence. You will harness cutting-edge technology to build and manage robust, scalable and secure infrastructure, ensuring seamless delivery of our digital solutions. To be successful as a Cloud Data Engineer, you should have experience with: Expertise in PySpark. AWS cloud services such as S3, Glue, Athena, Lake Formation, CloudFormation etc. Strong SQL knowledge. Very good understanding of writing and debugging of code. Quick learner, strong analytical and problem-solving skills and should possess excellent written and ve...

Join us as a Data Engineer - Pyspark,SQL at Barclays, where you'll spearhead the evolution of our digital landscape, driving innovation and excellence. You'll harness cutting-edge technology to revolutionise our digital offerings, ensuring unparalleled customer experiences. As a part of team of developers, you will deliver technology stack, using strong analytical and problem solving skills to understand the business requirements and deliver quality solutions. To be successful as a Data Engineer - Pyspark,SQL you should have experience with: Hands on experience in Pyspark and strong knowledge on Dataframes, RDD and SparkSQL Hands on experience in Pyspark performance optimization techniques ....

At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide. When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success. Senior Apache Spark Developer at BairesDev We are seeking a Senior Apache Spark Developer to work on distributed data processing systems and rea...

As a Senior Back End Engineer at micro1, you will play a crucial role in designing and implementing high-performance microservices using technologies like Python, FastAPI, and Kubernetes. Your expertise will contribute to building scalable solutions for our platforms. Here is what will be expected from you: - Design and develop backend services with a focus on FastAPI to ensure high-performance applications. - Architect and orchestrate microservices to efficiently handle high concurrency I/O requests. - Deploy and manage applications on AWS, guaranteeing robust and scalable solutions. - Implement and maintain messaging queues using Celery, RabbitMQ, or AWS SQS. - Utilize WebSockets and async...