35346 Spark Jobs - Page 21

Description Do you want to join an innovative team of scientists who use machine learning and statistical techniques to create state-of-the-art solutions for providing better value to Amazon’s customers? Do you want to build and deploy advanced algorithmic systems that help optimize millions of transactions every day? Are you excited by the prospect of analyzing and modeling terabytes of data to solve real world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you like to innovate and simplify? If yes, then you may be a great fit to join the Machine Learning and Data Sciences team for India Consumer Businesses. If you ...

About Amgen Amgen harnesses the best of biology and technology to fight the world’s toughest diseases, and make people’s lives easier, fuller and longer. We discover, develop, manufacture and deliver innovative medicines to help millions of patients. Amgen helped establish the biotechnology industry more than 40 years ago and remains on the cutting-edge of innovation, using technology and human genetic data to push beyond what’s known today. About The Role Role Description: We are looking for an Associate Data Engineer who can maintain complex data engineering workflows and pipelines and data solutions in 24X7 Shifts. The ideal candidate will be responsible for developing, optimizing and mai...

GCP DE Responsibilities Work closely with our data science team to help build complex algorithms that provide unique insights into our data Use agile software development processes to make iterative improvements to our back-end systems Model front-end and back-end data sources to help draw a more comprehensive picture of user flows throughout the system and to enable powerful data analysis Build data pipelines that clean, transform, and aggregate data from disparate sources Develop models that can be used to make predictions and answer questions for the overall business Required skills and qualifications 7 or more years of experience with Python, SQL, and data visualization/exploration tools...

Key Responsibilities: Bachelors/masters degree in computer science, Information Systems or equivalent. Strong knowledge of object-oriented design, .NET framework, and design patterns. Strong command of essential technologies: C#, SQL Server Expertise in building event-driven scalable & resilient systems Experience with software development lifecycle (SDLC) methodologies like Agile, Test-driven development. Experienced with developing solutions involving relational database technologies on SQL Server platform, stored procedure programming experience using Transact SQL. Experience with Authentication Methods like OATH / JWT Experience with debugging, logging, performance monitoring, data visua...

Key Responsibilities: Develop Python-based solutions using Git/Poetry for code and library management. Work with data processing libraries such as Pandas, Polars, and others. Deploy and manage data pipelines on Databricks and Azure Blob Storage. Monitor and troubleshoot pipelines, logs, and cloud resources. Required Skills & Qualifications: Proficiency in Python , including experience with Git/Poetry for code and dependency management. Expertise in data processing libraries such as Pandas, PySpark, Dataframes, Polars, or equivalent. Familiarity with Azure cloud services , Databricks , and Azure Blob Storage . Ability to read and analyze logs for debugging and performance monitoring . Strong ...

The Role We are looking for intermediate full-stack software engineers who are passionate about solving business problems through innovation and engineering practices. This role will be responsible for writing code, pairing with other developers as appropriate, decomposing acceptance criteria to understand team backlog deliverables, complexities, and risk, while working as a strong contributor on an agile team. From a technical standpoint, the Software Engineer has full-stack coding and implementation responsibilities and adheres to best practice principles, including modern cloud-based software development, agile and scrum, code quality, and tool usage. The Software Engineer works to unders...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. EY GDS – Data and Analytics (D&A) – Manager – Azure Data Architect As part of our EY-GDS D&A (Data and Analytics) team, we help our clients solve complex business challenges with the help of data and technology. We dive deep into data to extract the greatest value and discover opportunities in key business and functions like Banking, Insurance, Manufacturing, Healthcare, Retail, Manufacturing and Auto, Supply Chain, and Finance. The opportunity We’re looking for M...

JLL supports the Whole You, personally and professionally . Our people at JLL and JLL Technologies are shaping the future of real estate for a better world by combining world class services, advisory and technology to our clients. We are committed to hiring the best, most talented people in our industry; and we support them through professional growth, flexibility, and personalized benefits to manage life in and outside of work. Whether you’ve got deep experience in commercial real estate, skilled trades, and technology, or you’re looking to apply your relevant experience to a new industry, we empower you to shape a brighter way forward so you can thrive professionally and personally. What t...

Job Summary: Data Engineer will be responsible to Develop set processes for data mining, data modeling, and data production. Develop and maintain scalable data pipelines and builds out new integrations to support increases in data volume and complexity. Employ an array of technological languages and tools to connect data sets. Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization. Role & responsibilities Data Engineer, Key Deliverables Work in collaboration of IT infrastructure, Business teams and team members to create/develop and maintains op...

Job Description We are seeking a passionate and experienced Full Stack AI/ML Engineer with a strong background in machine learning and a drive for building intelligent systems. As a Full-Stack AI/ML Engineer on the Ford Pro Charging team, you will design, build, and ship intelligent services that power our global EV-charging platform. If you love turning data into real-world impact and thrive on end-to-end ownership—from research notebooks to production APIs—this is your playground. Responsibilities Design & Develop AI Solutions: Lead the design, development, training, and evaluation of machine learning models and AI solutions across various domains to enhance our products and services. Iden...

The Mission: Build the operating system for the future of AI-powered entertainment. About Us Our journey at Dashverse began with a simple question: what if AI could power the next generation of entertainment? As a Series A company backed by leading investors like Peak XV, Matrix, and Stellaris, we first redefined storytelling with Dashtoon, our revolutionary AI comics creation and distribution platform. Now, with Dashreels, we are creating a new universe of short-form video, pairing addictive short dramas with our own game-changing AI-generated originals. We're on a mission to become the world's go-to destination for compelling, short-form narrative content. About the Role We are looking for...

As a Technical Lead - Big Data Platform at Incedo, you will be responsible for designing and implementing big data platforms to support large-scale data integration projects. You will work with data architects and data engineers to define the platform architecture and build the necessary infrastructure. You will be skilled in big data technologies such as Hadoop, Spark, and Kafka and have experience in cloud computing platforms such as AWS or Azure. You will be responsible for ensuring the performance, scalability, and security of the big data platform and troubleshooting any issues that arise. Roles & Responsibilities: Designing, developing and maintaining large-scale big data platforms usi...

Data Engineer - Quant Trading About Deeter Investments Deeter Investments is a founder‑led proprietary trading firm built around real‑time, data‑driven decision‑making. We prize curiosity, collaboration, and a bias for action. After years of discretionary success, we’re launching a dedicated algorithmic division. Role Description As our first Data Engineer, you’ll own critical datasets end-to-end from ingestion and system architecture to reliability and access. You'll be designing, building, and running the data backbone for our algorithmic team. You’ll work directly with traders and researchers to turn messy external feeds into high-performance, well-structured datasets that guide decisions...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. EY GDS – Data and Analytics (D&A) – Manager – Azure Data Architect As part of our EY-GDS D&A (Data and Analytics) team, we help our clients solve complex business challenges with the help of data and technology. We dive deep into data to extract the greatest value and discover opportunities in key business and functions like Banking, Insurance, Manufacturing, Healthcare, Retail, Manufacturing and Auto, Supply Chain, and Finance. The opportunity We’re looking for M...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. EY GDS – Data and Analytics (D&A) – Manager – Azure Data Architect As part of our EY-GDS D&A (Data and Analytics) team, we help our clients solve complex business challenges with the help of data and technology. We dive deep into data to extract the greatest value and discover opportunities in key business and functions like Banking, Insurance, Manufacturing, Healthcare, Retail, Manufacturing and Auto, Supply Chain, and Finance. The opportunity We’re looking for M...

We are currently looking for an experienced Lead Data Engineer with demonstrated technical experience within pySpark, Phyton, and Java technologies to join the team in India, within our global Technology department. If this sounds interesting to you and you are skilled in Query engines Postgres/SQL/AWS/Java/Kotlin, we would love to speak with you. About You experience, education, skills, and accomplishments: Bachelor/master's degree in computer science, computer engineering, information technology, or relevant field At least 8+ years experience in working in software development At least 8+ years experience in building massively scalable distributed data processing solutions At least 6+ year...

We are currently looking for an experienced Lead Data Engineer with demonstrated technical experience within pySpark, Phyton, and Java technologies to join the team in India, within our global Technology department. If this sounds interesting to you and you are skilled in Query engines Postgres/SQL/AWS/Java/Kotlin, we would love to speak with you. About You experience, education, skills, and accomplishments: At least 6+ years experience in working in software development At least 6+ years experience in building massively scalable distributed data processing solutions At least 6+ years experience of database design & development. Alt least 4 years of experience in Apache Spark, ElasticSearch ...

Are you passionate about building robust Python applications and leveraging big data technologies to solve complex business challenges? Do you thrive in environments where your technical expertise drives meaningful impact? We are seeking an experienced Python Lead Developer to join our dynamic LSH Data Platform Team. You will play a pivotal role in designing, developing, and maintaining Python-based data processing applications and services that support scalable big data solutions. If you're excited about combining deep Python skills with cutting-edge technologies like Apache Spark, PySpark , GraphDB , SQL, and relational databases, we want to hear from you. About You experience, education, ...

We are looking for a data engineer with 2-5 years of expertise. Design and develop the database schemas as well as scripts for importing and exporting data utilizing AWS Glue tasks. In an agile environment, the data engineer will work closely with the development team. About You experience, education, skills, and accomplishments Minimum of 2+ years industry experience in data engineering. Bachelors or masters degree in computer science (or similar) Extensive experience in Pyspark/SQL, postgres Experience with AWS services like Glue, s3, Lambda Experience with data modelling and data warehouse. Experience of working within an Agile delivery environment. Good knowledge and understanding of Ver...

We are looking for a Manager Software Engineering to join our IMS Team in Bangalore . This is an amazing opportunity to work on Big Data technologies involved in content ingestion. The team consists of 10-12 engineers and is reporting to the Sr Manager. We have a great skill set in Spark, Java, Scala, Hive, Sql, XSLT, AWS EMR, S3, etc and we would love to speak with you if you have skills in the same. About You experience, education, skills, and accomplishments: Work Experience: Minimum 7 years experience in Big Data projects involved in content ingestion, curation, transformation Technical Skill: Databricks, Spark, Python/Java , Scala, AWS EMR, S3, SQS, Hive, XSLT, Education (bachelors degr...

Established in 2004, OLIVER is the world’s first and only specialist in designing, building, and running bespoke in-house agencies and marketing ecosystems for brands. We partner with over 300 clients in 40+ countries and counting. Our unique model drives creativity and efficiency, allowing us to deliver tailored solutions that resonate deeply with audiences. As a part of The Brandtech Group , we're at the forefront of leveraging cutting-edge AI technology to revolutionise how we create and deliver work. Our AI solutions enhance efficiency, spark creativity, and drive insightful decision-making, empowering our teams to produce innovative and impactful results. Job Title: Copy Supervisor Loca...

Years of experience - 4 to 10 years Job Description: We are seeking a highly skilled and motivated Lead/Senior Data Engineer to join our Data Integration and Analytics team. The ideal candidate will bring deep expertise in AWS Redshift, with strong knowledge of Redshift architecture, query performance tuning, and workload optimization. You will be responsible for leading the design, development, and optimization of scalable ETL/ELT pipelines that enable efficient data integration and power critical business intelligence and analytics initiatives. This role requires a proven ability to troubleshoot complex data challenges, drive performance improvements, and ensure our data ecosystem is both ...

Job Title: GCP Data Engineer Location: Pune, India Experience: 4 to 7 Years Job Type: Full-Time Job Summary: We are looking for a highly skilled GCP Data Engineer with 4 to 7 years of experience to join our data engineering team in Pune . The ideal candidate should have strong experience working with Google Cloud Platform (GCP) , including Dataproc , Cloud Composer (Apache Airflow) , and must be proficient in Python , SQL , and Apache Spark . The role involves designing, building, and optimizing data pipelines and workflows to support enterprise-grade analytics and data science initiatives. Key Responsibilities: Design and implement scalable and efficient data pipelines on GCP, leveraging Da...

SPARK EDM OPERATOR TO WORK ON OSCAR MAX ZNC MACHINE WORK PIECE DIALLING, ELECTRODE DIALLING, CENTRALIZING, PROGRAMMING AND INSPECTION SHOULD BE ABLE TO READ AND INTERPRET 2D DRAWINGS Job Type: Full-time Pay: ₹28,000.00 - ₹30,000.00 per month Benefits: Health insurance Ability to commute/relocate: Kamakshipalya, Bengaluru - 560079, Karnataka: Reliably commute or planning to relocate before starting work (Preferred) Education: Secondary(10th Pass) (Preferred) Experience: total work: 1 year (Preferred) License/Certification: ITI (Preferred) Work Location: In person

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Manager Job Description & Summary At PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics techniques to help clients optimise their operations and achieve their strategic goals. In data analysis at PwC, you will focus on utilising advanced analytical techniques to extract insights from large datasets and drive data-driven decision-making. You will leverage skills in data manipulation, visualisation, and statistical modelling to support clients in solving complex business problems. Why ...