139 Spark Jobs - Page 4

Design, develop, and maintain efficient and reliable data pipelines using Java, Scala, Apache Spark and Confluent Cloud (Kafka, KStreams, kSQLDB, Schema Registry) Leverage Apache Spark (Java/Scala) for large-scale data processing and transformation. Experience with building, maintaining and debugging applications and data pipelines using Confluent Cloud (Kafka, KStreams, kSQLDB, Schema Registry). Build and optimize data storage solutions using NoSQL databases such as ScyllaDB and/or Cassandra. Experienced with AWS services required for Data Engineering such as EMR, ServerlessEMR, AWS Glue, CodeCommit, EC2, S3 etc. Familiarity with workflow orchestration tools such as Airflow Experience with ...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developing strea...

As a consultant at IBM, you''ll play a vital role in the development, design of application, provide regular support/guidance to project teams on complex coding, issue resolution and execution. Your primary responsibilities include Lead the design and construction of new solutions using the latest technologies, always looking to add business value and meet user requirements. Strive for continuous improvements by testing the build solution and working under an agile framework. Discover and implement the latest technologies trends to maximize and build creative solutions Required education Bachelor''s Degree Preferred education Master''s Degree Required technical and professional expertise 8-1...

JLL supports the Whole You, personally and professionally. Our people at JLL are shaping the future of real estate for a better world by combining world class services, advisory and technology to our clients. We are committed to hiring the best, most talented people in our industry; and we support them through professional growth, flexibility, and personalized benefits to manage life in and outside of work. Whether you’ve got deep experience in commercial real estate, skilled trades, and technology, or you’re looking to apply your relevant experience to a new industry, we empower you to shape a brighter way forward so you can thrive professionally and personally. Position Overview We are see...

JLL supports the Whole You, personally and professionally. Our people at JLL are shaping the future of real estate for a better world by combining world class services, advisory and technology to our clients. We are committed to hiring the best, most talented people in our industry; and we support them through professional growth, flexibility, and personalized benefits to manage life in and outside of work. Whether you’ve got deep experience in commercial real estate, skilled trades, and technology, or you’re looking to apply your relevant experience to a new industry, we empower you to shape a brighter way forward so you can thrive professionally and personally. Position: Building Manager B...

JLL supports the Whole You, personally and professionally. Our people at JLL are shaping the future of real estate for a better world by combining world class services, advisory and technology to our clients. We are committed to hiring the best, most talented people in our industry; and we support them through professional growth, flexibility, and personalized benefits to manage life in and outside of work. Whether you’ve got deep experience in commercial real estate, skilled trades, and technology, or you’re looking to apply your relevant experience to a new industry, we empower you to shape a brighter way forward so you can thrive professionally and personally. About JLL : JLL (NYSE: JLL) ...

Work Schedule Standard (Mon-Fri) Environmental Conditions Office Job Description As part of the Thermo Fisher Scientific team, you’ll discover meaningful work that makes a positive impact on a global scale. Join our colleagues in bringing our Mission to life every single day to enable our customers to make the world healthier, cleaner and safer. We provide our global teams with the resources needed to achieve individual career goals while helping to take science a step beyond by developing solutions for some of the world’s toughest challenges, like protecting the environment, making sure our food is safe or helping find cures for cancer. Job Title: Data Engineer – Pharmaceutical CDMO Locatio...

JD : Technical Skills: Languages: Scala, Java • Big Data Orchestration: Airflow, Spark on Kubernetes, Yarn, Oozie Big Data Processing: Hadoop, Kafka, Spark & Spark Structured Streaming. Experience on SOLID & DRY principles with Good Software Architecture & Design implementation experience Advanced Scala experience (e.g. Functional Programming, using Case classes, Complex Data Structures & Algorithms) Proficient in developing automated frameworks for unit & integration testing. Experience with Docker and Helm and related container technologies. Proficient in deploying and managing Spark workloads on Kubernetes clusters. Experience in evaluation and implementation of Data Validation & Data Qua...

Company Description About Sopra Steria Sopra Steria, a major Tech player in Europe with 50,000 employees in nearly 30 countries, is recognised for its consulting, digital services and solutions. It helps its clients drive their digital transformation and obtain tangible and sustainable benefits. The Group provides end-to-end solutions to make large companies and organisations more competitive by combining in-depth knowledge of a wide range of business sectors and innovative technologies with a collaborative approach. Sopra Steria places people at the heart of everything it does and is committed to putting digital to work for its clients in order to build a positive future for all. In 2024, t...

Job Purpose To spearhead the development and deployment of advanced analytics and data-driven solutions across the CBG value chaindriving process optimization, predictive insights, and innovation in production, maintenance, supply chain, and commercial operations. Key Responsibilities Analytics Strategy & Roadmap: Define and own the advanced analytics roadmap, aligning data initiatives with CBG business objectives (yield maximization, cost reduction, quality improvement). Identify high-impact use cases across feedstock selection, digester performance, purification, bottling, logistics, and sales forecasting. Data Modelling & Solution Development Lead the design, development, and validation o...

DESCRIPTION As a Data Engineer in Data Infrastructure and Strategy group, you will play a key role in transforming the way Operations Finance teams access and analyse the data. You will work to advance 3 Year Data Infrastructure Modernisation strategy and play a key role in adopting and expanding a unified data access platform and scalable governance and observability frameworks that follow modern data architecture and cloud-first designs. Your responsibilities will include supporting and migrating data analytics use cases of a targeted customer group and new features implementations within the central platform: component design, implementation using NAWS services that follow best engineerin...

Location: Pune Work Mode: Hybrid (2-3 days office in a week) Full time Job Description: 5-14 Years of in Big Data & Data related technology experience Expert level knowledge and experience in Apache Spark ( Advance Concepts i.e. RDDs, DataFrames, fault tolerance, Spark internals, Catalyst optimizer and AQE). Hands on programming with Scala Or Java. Understands exception handling and its practical applications. Proficient in using Python for data engineering and automation. Experience with building stream-processing systems, using technologies such as Spark-Streaming Experience with integration of data from multiple data sources such as RDBMS (SQL Server, Oracle), ERP, Files Good understandin...

About Agoda At Agoda, we bridge the world through travel. Our story began in 2005, when two lifelong friends and entrepreneurs, driven by their passion for travel, launched Agoda to make it easier for everyone to explore the world. Today, we are part of Booking Holdings [NASDAQ: BKNG], with a diverse team of over 7,000 people from 90 countries, working together in offices around the globe. Every day, we connect people to destinations and experiences, with our great deals across our millions of hotels and holiday properties, flights, and experiences worldwide. No two days are the same at Agoda. Data and technology are at the heart of our culture, fueling our curiosity and innovation. If you’r...

Apache Spark Technical Lead - French Language Full-time Company Description About Sopra Steria Sopra Steria, a major Tech player in Europe with 50,000 employees in nearly 30 countries, is recognised for its consulting, digital services and solutions. It helps its clients drive their digital transformation and obtain tangible and sustainable benefits. The Group provides end-to-end solutions to make large companies and organisations more competitive by combining in-depth knowledge of a wide range of business sectors and innovative technologies with a collaborative approach. Sopra Steria places people at the heart of everything it does and is committed to putting digital to work for its clients...

Overview Do you see yourself as a coach, a collaborator, and a customer-focused engineering leader? Does pioneering new and innovative ways to collect and showcase key customer data sound exciting to you? Do you care deeply about fostering a great team? Do you want to contribute to an effort that is one of the most critical for the future success of Microsoft 365 and the Experiences + Devices organization? If so, the Insights, Data Engineering & Analytics team might be an excellent place for you to grow your career. The Insights, Data Engineering & Analytics (IDEAs) is at the core of our Company’s mission to enable people and organizations to achieve more. Our team’s goal is to champion a da...

As an Associate Lead Data Scientist, you will have the exciting opportunity to work with a dynamic team of researchers, data scientists, and developers. Your primary focus will be on developing and optimizing cutting-edge AI solutions in various industries such as commerce, agriculture, insurance, financial markets, and procurement. Here is a breakdown of your responsibilities: Key Responsibilities: - Develop, optimize, and lead ML, NLP, Deep Learning, and Generative AI model/projects. - Research and implement state-of-the-art algorithms for supervised and unsupervised learning. - Handle large-scale datasets in distributed environments. - Apply the best ML approaches based on an understandin...

Introduction A career in IBM Consulting is rooted by long-term relationships and close collaboration with clients across the globe. You'll work with visionaries across multiple industries to improve the hybrid cloud and AI journey for the most innovative and valuable companies in the world. Your ability to accelerate impact and make meaningful change for your clients is enabled by our strategic partner ecosystem and our robust technology platforms across the IBM portfolio Your Role And Responsibilities As a consultant at IBM, you'll play a vital role in the development, design of application, provide regular support/guidance to project teams on complex coding, issue resolution and execution....

About Agoda At Agoda, we bridge the world through travel. Our story began in 2005, when two lifelong friends and entrepreneurs, driven by their passion for travel, launched Agoda to make it easier for everyone to explore the world. Today, we are part of Booking Holdings [NASDAQ: BKNG], with a diverse team of over 7,000 people from 90 countries, working together in offices around the globe. Every day, we connect people to destinations and experiences, with our great deals across our millions of hotels and holiday properties, flights, and experiences worldwide. No two days are the same at Agoda. Data and technology are at the heart of our culture, fueling our curiosity and innovation. If you’r...

Introduction A career in IBM Consulting is rooted by long-term relationships and close collaboration with clients across the globe. You'll work with visionaries across multiple industries to improve the hybrid cloud and AI journey for the most innovative and valuable companies in the world. Your ability to accelerate impact and make meaningful change for your clients is enabled by our strategic partner ecosystem and our robust technology platforms across the IBM portfolio Your Role And Responsibilities As a consultant at IBM, you'll play a vital role in the development, design of application, provide regular support/guidance to project teams on complex coding, issue resolution and execution....

JLL supports the Whole You, personally and professionally. Our people at JLL are shaping the future of real estate for a better world by combining world class services, advisory and technology to our clients. We are committed to hiring the best, most talented people in our industry; and we support them through professional growth, flexibility, and personalized benefits to manage life in and outside of work. Whether you’ve got deep experience in commercial real estate, skilled trades, and technology, or you’re looking to apply your relevant experience to a new industry, we empower you to shape a brighter way forward so you can thrive professionally and personally. What this job involves You w...

Job Description: Recruiting Job Description Dentsu India has launched Dentsu AMP, a new video-first content engine that helps brands create and scale high-quality storytelling with speed and efficiency. Built for today’s digital culture, Dentsu AMP combines human creativity with AI-enabled workflows to deliver video content that is quicker to produce, sharper in execution, and stronger in performance. Role Overview: We’re looking for a trailblazing Creative Director to lead the charge in creating captivating, trend-setting video content for social media channels. Think 50+ videos monthly for Instagram and YouTube that break through the noise and leave a lasting impact. If you’re passionate a...

JLL supports the Whole You, personally and professionally. Our people at JLL are shaping the future of real estate for a better world by combining world class services, advisory and technology to our clients. We are committed to hiring the best, most talented people in our industry; and we support them through professional growth, flexibility, and personalized benefits to manage life in and outside of work. Whether you’ve got deep experience in commercial real estate, skilled trades, and technology, or you’re looking to apply your relevant experience to a new industry, we empower you to shape a brighter way forward so you can thrive professionally and personally. Procurement Manager - Indust...

As a BigData Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering...

JLL supports the Whole You, personally and professionally. Our people at JLL are shaping the future of real estate for a better world by combining world class services, advisory and technology to our clients. We are committed to hiring the best, most talented people in our industry; and we support them through professional growth, flexibility, and personalized benefits to manage life in and outside of work. Whether you’ve got deep experience in commercial real estate, skilled trades, and technology, or you’re looking to apply your relevant experience to a new industry, we empower you to shape a brighter way forward so you can thrive professionally and personally. Qualifications BE Civil/Mech...

As a Senior Engineer, AVP at Deutsche Bank, you will play a crucial role in building and delivering significant components of engineering solutions to meet complex business goals. You will collaborate closely with the business and be part of a dynamic, creative, and innovative team, working towards making a tangible impact. Key Responsibilities: - Join the dbSleuth Team within Regulatory & Cross Product IT to develop and deliver Trader and Counterparty surveillance solutions across all business segments - Contribute to building surveillance systems in a fast-paced, agile environment using technologies like React for UI development, Python/Spark/Scala for services, and Hadoop Big Data for ano...