1597 Spark Jobs - Page 16

Description Data engineer with 4 to 6 years of hands on experience working on Big Data Platforms Experience building and optimizing Big data data pipelines and data sets ranging from Data ingestion to Processing to Data Visualization. Good Experience in writing and optimizing Spark Jobs, Spark SQL etc. Should have worked on both batch and steaming data processing Good experience in any one programming language -Scala/Python , Python preferred. Experience in writing and optimizing complex Hive and SQL queries to process huge data. good with UDFs, tables, joins,Views etc Experience in using Kafka or any other message brokers Configuring, monitoring and scheduling of jobs using Oozie and/or Air...

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. Job Description For Data Scientist Objectives and Purpose The Lead Data Scientist is responsible for applying expertise and best practices in full-stack data science capabilities including advanced data analytics, statistical modeling (AI/ML), MLOps, data engineering, and data visualization to develop data-driven solutions to enable business ...

About Agoda At Agoda, we bridge the world through travel. Our story began in 2005, when two lifelong friends and entrepreneurs, driven by their passion for travel, launched Agoda to make it easier for everyone to explore the world. Today, we are part of Booking Holdings [NASDAQ: BKNG], with a diverse team of over 7,000 people from 90 countries, working together in offices around the globe. Every day, we connect people to destinations and experiences, with our great deals across our millions of hotels and holiday properties, flights, and experiences worldwide. No two days are the same at Agoda. Data and technology are at the heart of our culture, fueling our curiosity and innovation. If you’r...

About Agoda At Agoda, we bridge the world through travel. Our story began in 2005, when two lifelong friends and entrepreneurs, driven by their passion for travel, launched Agoda to make it easier for everyone to explore the world. Today, we are part of Booking Holdings [NASDAQ: BKNG], with a diverse team of over 7,000 people from 90 countries, working together in offices around the globe. Every day, we connect people to destinations and experiences, with our great deals across our millions of hotels and holiday properties, flights, and experiences worldwide. No two days are the same at Agoda. Data and technology are at the heart of our culture, fueling our curiosity and innovation. If you’r...

Job Description Senior Data Engineer – Databricks (Azure/AWS) Role Overview: We are looking for a hands-on Senior Data Engineer experienced in migrating and building large-scale data pipelines on Databricks using Azure or AWS platforms. The role will focus on implementing batch and streaming pipelines, applying the bronze-silver-gold data lakehouse model, and ensuring scalable and reliable data solutions. Required Skills and Experience: 6+ years of hands-on data engineering experience, with 2+ years specifically working on Databricks in Azure or AWS. Proficiency in building and optimizing Spark pipelines (batch and streaming). Strong experience implementing bronze/silver/gold data models. Wo...

About Agoda At Agoda, we bridge the world through travel. Our story began in 2005, when two lifelong friends and entrepreneurs, driven by their passion for travel, launched Agoda to make it easier for everyone to explore the world. Today, we are part of Booking Holdings [NASDAQ: BKNG], with a diverse team of over 7,000 people from 90 countries, working together in offices around the globe. Every day, we connect people to destinations and experiences, with our great deals across our millions of hotels and holiday properties, flights, and experiences worldwide. No two days are the same at Agoda. Data and technology are at the heart of our culture, fueling our curiosity and innovation. If you’r...

DESCRIPTION Do you want to join an innovative team of scientists who use machine learning and statistical techniques to create state-of-the-art solutions for providing better value to Amazon’s customers? Do you want to build and deploy advanced algorithmic systems that help optimize millions of transactions every day? Are you excited by the prospect of analyzing and modeling terabytes of data to solve real world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you like to innovate and simplify? If yes, then you may be a great fit to join the Machine Learning and Data Sciences team for India Consumer Businesses. If you ...

DESCRIPTION Do you want to join an innovative team of scientists who use machine learning and statistical techniques to create state-of-the-art solutions for providing better value to Amazon’s customers? Do you want to build and deploy advanced algorithmic systems that help optimize millions of transactions every day? Are you excited by the prospect of analyzing and modeling terabytes of data to solve real world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you like to innovate and simplify? If yes, then you may be a great fit to join the Machine Learning and Data Sciences team for India Consumer Businesses. If you ...

Join Amgen’s Mission of Serving Patients At Amgen, if you feel like you’re part of something bigger, it’s because you are. Our shared mission—to serve patients living with serious illnesses—drives all that we do. Since 1980, we’ve helped pioneer the world of biotech in our fight against the world’s toughest diseases. With our focus on four therapeutic areas –Oncology, Inflammation, General Medicine, and Rare Disease– we reach millions of patients each year. As a member of the Amgen team, you’ll help make a lasting impact on the lives of patients as we research, manufacture, and deliver innovative medicines to help people live longer, fuller happier lives. Our award-winning culture is collabo...

DESCRIPTION Do you want to join an innovative team of scientists who use machine learning and statistical techniques to create state-of-the-art solutions for providing better value to Amazon’s customers? Do you want to build and deploy advanced algorithmic systems that help optimize millions of transactions every day? Are you excited by the prospect of analyzing and modeling terabytes of data to solve real world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you like to innovate and simplify? If yes, then you may be a great fit to join the Machine Learning and Data Sciences team for India Consumer Businesses. If you ...

The people here at Apple don’t just build products- they craft the kind of wonder that has revolutionised entire industries. It’s the diversity of those people and their ideas that encourages the innovation that runs through everything we do, from amazing technology to industry-leading environmental efforts. Imagine what you could do here. Join Apple, and help us leave the world better than we found it. A job at Apple is unlike any other you’ve had. You will be challenged. You will be inspired. And you’ll be proud! At Apple, phenomenal ideas have a way of becoming phenomenal products, services, and customer experiences very quickly. Bring passion and dedication to your job, and there's no te...

Apache Spark Technical Lead - French Language Full-time Company Description About Sopra Steria Sopra Steria, a major Tech player in Europe with 50,000 employees in nearly 30 countries, is recognised for its consulting, digital services and solutions. It helps its clients drive their digital transformation and obtain tangible and sustainable benefits. The Group provides end-to-end solutions to make large companies and organisations more competitive by combining in-depth knowledge of a wide range of business sectors and innovative technologies with a collaborative approach. Sopra Steria places people at the heart of everything it does and is committed to putting digital to work for its clients...

Overview Do you see yourself as a coach, a collaborator, and a customer-focused engineering leader? Does pioneering new and innovative ways to collect and showcase key customer data sound exciting to you? Do you care deeply about fostering a great team? Do you want to contribute to an effort that is one of the most critical for the future success of Microsoft 365 and the Experiences + Devices organization? If so, the Insights, Data Engineering & Analytics team might be an excellent place for you to grow your career. The Insights, Data Engineering & Analytics (IDEAs) is at the core of our Company’s mission to enable people and organizations to achieve more. Our team’s goal is to champion a da...

Arcadis is the world's leading company delivering sustainable design, engineering, and consultancy solutions for natural and built assets. We are more than 36,000 people, in over 70 countries, dedicated to improving quality of life. Everyone has an important role to play. With the power of many curious minds, together we can solve the world’s most complex challenges and deliver more impact together. Qualification & Experience: Minimum of 8 years of experience as a Data Scientist/Engineer with demonstrated expertise in data engineering and cloud computing technologies. Technical Responsibilities – Excellent proficiency in Python, with a strong focus on developing advanced skills. Extensive ex...

We are seeking a highly skilled and motivated Big Data Engineer to join our data engineering team. The ideal candidate will have hands-on experience with Hadoop ecosystem, Apache Spark, and programming expertise in Python (PySpark), Scala, and Java. You will be responsible for designing, developing, and optimizing scalable data pipelines and big data solutions to support analytics and business intelligence initiatives.

Description Have you ever ordered a product on Amazon and when that box with the smile arrived you wondered how it got to you so fast? Have you wondered where it came from and how much it cost Amazon to deliver it to you? If so, the WW Amazon Logistics, Business Analytics team is for you. We manage the delivery of tens of millions of products every week to Amazon’s customers, achieving on-time delivery in a cost-effective manner. We are looking for an enthusiastic, customer obsessed, Sr. Applied Scientist with good analytical skills to help manage projects and operations, implement scheduling solutions, improve metrics, and develop scalable processes and tools. The primary role of an Operati...

Description Have you ever ordered a product on Amazon and when that box with the smile arrived you wondered how it got to you so fast? Have you wondered where it came from and how much it cost Amazon to deliver it to you? If so, the WW Amazon Logistics, Business Analytics team is for you. We manage the delivery of tens of millions of products every week to Amazon’s customers, achieving on-time delivery in a cost-effective manner. We are looking for an enthusiastic, customer obsessed, Sr. Applied Scientist with good analytical skills to help manage projects and operations, implement scheduling solutions, improve metrics, and develop scalable processes and tools. The primary role of an Operati...

Job Description A career with us is a journey, not a destination. This could be the next best step in your technical career. Join us if you are excited about shaping the future of technology and driving significant business impact in financial services. Join our team and help us develop game changing, high-quality solutions. As an Senior Lead Data Architect at JPMorgan Chase within the Home Lending division, you will be an integral part of a dynamic team dedicated to transforming the way we manage and utilize data. Our team is focused on developing innovative data architecture solutions that enhance our software applications and platform products. We are committed to leveraging modern data s...

Overview As an Analyst, Data Modeling, your focus would be to partner with D&A Data Foundation team members to create data models for Global projects. This would include independently analyzing project data needs, identifying data storage and integration needs/issues, and driving opportunities for data model reuse, satisfying project requirements. Role will advocate Enterprise Architecture, Data Design, and D&A standards, and best practices. You will be performing all aspects of Data Modeling working closely with Data Governance, Data Engineering and Data Architects teams. As a member of the data modeling team, you will create data models for very large and complex data applications in publi...

Overview Role Overview As a Data Modeler , you will partner with the D&A Data Foundation team to design and implement data models for global projects. This includes analyzing project data needs, identifying storage and integration requirements, and driving opportunities for data model reuse. You will advocate Enterprise Architecture, Data Design standards, and best practices , creating conceptual, logical, and physical data models for large-scale, cloud-based applications impacting PepsiCo’s flagship data products in areas like Revenue Management, Supply Chain, Manufacturing, and Logistics . Responsibilities Key Responsibilities Design conceptual, logical, and physical data models for platfo...

We are looking for a Manager Software Engineering to join our IMS Team in Bangalore. This is an amazing opportunity to work on Big Data technologies involved in content ingestion. The team consists of 10-12 engineers and is reporting to the Sr Manager. We have a great skill set in Spark, Java, Scala, Hive, Sql, XSLT, AWS EMR, S3, etc, and we would love to speak with you if you have skills in the same. About You – Experience, Education, Skills, And Accomplishments Minimum 7 years’ experience in Big Data projects involved in content ingestion, curation, transformation Databricks, Spark, Python/Java, Scala, AWS EMR, S3, SQS, Hive, XSLT, Education (bachelor’s degree in computer science or relate...

We are seeking a highly skilled and experienced Consultant to join our team. In this role, you will be responsible for designing and developing robust data pipelines using Python, Apache Spark on Databricks. You will also be responsible for optimizing and troubleshooting existing pipelines for performance and reliability. As a Consultant, you will collaborate with data scientists and analysts to understand their requirements and ensure data quality, integrity, and security across various sources. Additionally, you will implement ETL processes and integrate with cloud platforms such as Azure, AWS, and GCP. Other responsibilities include maintaining and monitoring Databricks clusters and noteb...

Req ID: 343719 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a MLE - Intermediate / Senior Machine Learning Engineer (Production & MLOps Focus) to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). Job Title: Intermediate / Senior – MLE – Python, ML Frameworks, MLOps, Containerization, Terraform, GCP, Vertex AI, IBM Watsonx About Machine Learning Engineering at UPS Technology: We’re the obstacle overcomers, the problem get-arounders. From figuring it out to getting it done… our innovative culture demands “yes ...

Position Summary... What you'll do... About Team You will be part of a Data Engineering team that builds and operates scalable, intelligent data platforms enabling analytics, automation and AI-driven decision-making across the organization. Our work focuses on designing high-performance data systems, ensuring reliability and operational excellence and integrating Generative AI capabilities to enhance how data is processed, understood, and used. We work at the intersection of data engineering and applied AI, developing production-grade agentic systems that handle data at scale, automate complex workflows, and drive measurable business impact. The team culture emphasizes ownership, collaborati...

Position Summary... What you'll do... About Team Data Engineering at Enterprise Business Services (EBS) enables Walmart’s business and technology partners to unlock the power of data at scale. We design and build foundational data platforms and pipelines that fuel analytics, machine learning, and real-time decision-making across Walmart’s global ecosystem. As a Senior Software Engineer – Data Engineering, you will be part of a high-impact team that develops the next generation of enterprise-grade data solutions. Our engineers work in an agile environment, solving complex data problems and delivering highly reliable, secure, and scalable systems. You will design robust data architectures, opt...