50049 Spark Jobs - Page 11

Data Scientist We are seeking a Data Scientist with around 3 years of experience to join our analytics and machine learning team in the Ad Tech domain. In this role, you will apply statistical and machine learning techniques to improve campaign targeting, audience segmentation, and recommendation systems. You will collaborate with engineers, analysts, and product teams to transform data into insights and deploy models that directly impact business outcomes. This position is ideal for someone eager to take ownership of end-to-end projects while continuing to expand their expertise in advanced machine learning and applied statistics. Key Responsibilities Develop and deploy machine learning and...

Role: Data Engineer Experience: 6-9 Years Location: Bangalore/Pune Notice Period: Immediate Joiners Only Technical and professional skills: We are looking for a flexible, fast learning, technically strong Data Engineer. Expertise is required in the following fields: 6+ years of experience in Cloud Data Engineering. Proficient in Cloud Services Azure Build ETL and data movement solutions. Migrate data from traditional database systems to Cloud environment Strong hands-on experience for working with Streaming dataset Building Complex Notebook in Databricks to achieve business Transformations. Hands-on Experience in Data Refinement using Pyspark and Spark SQL Familiarity with building dataset u...

Established in 2004, OLIVER is the world’s first and only specialist in designing, building, and running bespoke in-house agencies and marketing ecosystems for brands. We partner with over 300 clients in 40+ countries and counting. Our unique model drives creativity and efficiency, allowing us to deliver tailored solutions that resonate deeply with audiences. As a part of The Brandtech Group , we're at the forefront of leveraging cutting-edge AI technology to revolutionise how we create and deliver work. Our AI solutions enhance efficiency, spark creativity, and drive insightful decision-making, empowering our teams to produce innovative and impactful results. Role: Product Marketing Manager...

Role Summary & Role Description Technical Lead (overall 9+ years good development experience) with good hands-on experience in Python/PySpark with strong experience in Spark /PySpark, Databricks, AWS services ,Spark SQL for big data processing and,Kafka, Airflow. Worked in a complex deadline driven projects with minimal supervision. Ability to architect/design/develop with minimum requirements by effectively. 2+ experience on Apache Kafka streaming processing and Python/PySpark. End to end understanding of Databricks architecture, design, development and implementation. Min 8+ years of good experience on AWS clouds and Data bricks,Airflow. Excellent work ethics with ability to work independe...

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. EY GDS – Data and Analytics (D&A) – AWS DBX – Senior As part of our EY-GDS D&A (Data and Analytics) team, we help our clients solve complex business challenges with the help of data and technology. We dive deep into data to extract the greatest value and discover opportunities in key business and functions like Banking, Insurance, Manufacturi...

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. EY GDS – Data and Analytics (D&A) – AWS DBX – Senior As part of our EY-GDS D&A (Data and Analytics) team, we help our clients solve complex business challenges with the help of data and technology. We dive deep into data to extract the greatest value and discover opportunities in key business and functions like Banking, Insurance, Manufacturi...

Role & responsibilities Location: Bangalore / Pune / Mumbai / Gurgaon / Noida Experience Level: Associate / Senior Associate Experience Range: 4-7 years Key Skills: Python, Spark, Hadoop, NoSQL,Azure Job Description: We are hiring a Data Engineer to design and implement scalable data pipelines and architectures. The ideal candidate should have experience in big data frameworks such as Hadoop and Spark, and hands-on expertise in Python , Azure and NoSQL databases. Responsibilities: Develop and maintain data pipelines for processing large datasets. Work with distributed data systems like Hadoop and Spark. Implement ETL workflows and data transformations. Collaborate with analytics and engineer...

Role & responsibilities Location: Bangalore / Pune / Mumbai / Gurgaon / Noida Experience Level: Associate / Senior Associate Experience Range: 4-7 years Key Skills: Python, Spark, Hadoop, NoSQL,AWS Job Description: We are hiring a Data Engineer to design and implement scalable data pipelines and architectures. The ideal candidate should have experience in big data frameworks such as Hadoop and Spark, and hands-on expertise in Python , AWS and NoSQL databases. Responsibilities: Develop and maintain data pipelines for processing large datasets. Work with distributed data systems like Hadoop and Spark. Implement ETL workflows and data transformations. Collaborate with analytics and engineering ...

Application Developer with Python, SQL and VQL Job Location: Pune Location Flexibility: Primary Location Only Req Id: 4434 Posting Start Date: 12/5/25 Role: Application Developer with Python, SQL and VQL Experience : 5+yrs Shifts: 6:30 AM to 3:30 PM IST. Work Location : Pune Job Purpose This role is responsible for delivering assigned tasks to clients while operating as a valued team member under moderate to high supervision. Key responsibilities include designing and developing data pipelines in Python or SQL (for the Databricks environment) and VQL (for the Denodo environment), documenting designs and as-built specifications, performing testing of data pipelines, designing and developing d...

Role & responsibilities Location: Bangalore / Pune / Mumbai / Gurgaon / Noida Experience Level: Associate / Senior Associate Experience Range: 4-7 years Key Skills: Python, Spark, Hadoop, NoSQL Job Description: We are hiring a Data Engineer to design and implement scalable data pipelines and architectures. The ideal candidate should have experience in big data frameworks such as Hadoop and Spark, and hands-on expertise in Python and NoSQL databases. Responsibilities: Develop and maintain data pipelines for processing large datasets. Work with distributed data systems like Hadoop and Spark. Implement ETL workflows and data transformations. Collaborate with analytics and engineering teams for ...

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. EY GDS – Data and Analytics (D&A) – AWS DBX – Senior As part of our EY-GDS D&A (Data and Analytics) team, we help our clients solve complex business challenges with the help of data and technology. We dive deep into data to extract the greatest value and discover opportunities in key business and functions like Banking, Insurance, Manufacturi...

Job Location: Noida | Bangalore | Kolkata Job Description Your Role and Responsibilities Develop, implement, and optimize GenAI solutions , including Large Language Models (LLMs), Retrieval-Augmented Generation (RAG) systems, prompt engineering frameworks, and conversational AI workflows. Build and deploy machine learning and deep learning models across structured, semi-structured, and unstructured data scenarios, including text, images, documents, and time-series datasets. Apply advanced ML methodologies such as clustering, classification, regression, boosting algorithms, recommendation systems, optimization techniques , and NLP-based modeling (BERT, GPT, transformer architectures). Design ...

Responsibilities / Tasks Support internal global customers in the execution of engineering design projects. Design and draft sheet metal components and plant layouts. Complete high-quality design projects on time and within the designated hourly budget. Support the documentation of deliverables for various products within the given technology scope. Other responsibilities as given by Manager. Understand project tasks and evaluate required input from customers. Proactively communicate any missing information, tools, or resources needed for task execution. Create 3D models and 2D drawings of General Arrangements (GA), Plant Layouts, and plant-related equipment based on given GEA technology. Ad...

Job Description Job Purpose: As a Lead Data Scientist within the Data Science Research team in the NIQ Product organization, you will drive definition and support of new products and methods development, and improvement initiatives. This position focuses on innovation in data processing methods for retail measurement and automation of existing statistical procedures. Job Responsibilities: Define, plan and execute analyses regarding innovation initiatives, methodology development and improvement as well as process automation Prototype solutions and support pilot programs for R&D purposes, including trend analyses, representation/sampling, bias reduction, indirect estimation, data integration,...

Primary skills:Bigdata->Pyspark,Bigdata->Python,Bigdata->Spark,Technology->Functional Programming->Scala Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education At least 5 years of experience in Pyspark, Spark with Hadoop distributed frameworks while handling large amount of big data using Spark and Hadoop Ecosystems in Data Pipeline creation , deployment , Maintenance and debugging Experience in scheduling and monitoring Jobs and creating tools for automation At least 4 years of experience with Scala and Python required. Proficient knowledge of SQL with any R...

Role: Data Engineer Experience: 4-8 Years Relevant Experience in Data Engineer : 4+ Years Notice Period: Immediate Joiners Only Job Location: Pune and Chennai Key Responsibilities: Mandatory Skill: Spark,SQL and Python Must Have: Relevant experience of 3-7 years as a Data Engineer SQL: 3+ years of experience Spark: 3+ years of experience NoSQL Databases: 1-2 years of experience Experience in programming language like Python Good Understanding of ETL (Extract, Transform, Load) concepts Good analytical and problem-solving skills Knowledge of a ticketing tool like JIRA/SNOW Good communication skills to interact with Customers on issues & requirements. Reach us:If you are interested in this posi...

Technical Architect Hyderabad (4 days onsite) Willing to come for In-person Interview Job Description: - 10+ years of experience within a Technical Architect role - Experience within data architecture - specifically with hands-on Databricks (data processing and cataloging) - Spark ML/Gen AI experience - Experience designing and implementing metadata catalog integration - Excellent communication. strong cross-functional collaboration, and great stakeholder engagement

Job Title: Data Engineer Location: Hyderabad Experience: 5+Years (Work from Office) Job Summary: We are looking for a skilled and experienced Data Engineer with over 5 years of experience in data engineering and data migration projects. The ideal candidate should possess strong expertise in SQL, Python, data modeling, data warehousing, and ETL pipeline development. Experience with big data tools like Hadoop and Spark, along with AWS services such as Redshift, S3, Glue, EMR, and Lambda, is essential. This role provides an excellent opportunity to work on large-scale data solutions, enabling data-driven decision-making and operational excellence. Key Responsibilities: • Design, build, and main...

Role: Data Engineer Experience: 6-8 Years Relevant Experience in Data Engineer : 6+ Years Notice Period: Immediate Joiners Only Job Location: Pune and Chennai Key Responsibilities: Mandatory Skill: Spark,SQL and Python Must Have: Relevant experience of 6-7 years as a Data Engineer SQL: 3+ years of experience Spark: 5+ years of experience NoSQL Databases: 1-2 years of experience Experience in programming language like Python Good Understanding of ETL (Extract, Transform, Load) concepts Good analytical and problem-solving skills Knowledge of a ticketing tool like JIRA/SNOW Good communication skills to interact with Customers on issues & requirements. Reach us:If you are interested in this posi...

ABOUT THE ROLE Role Description: The role is responsible for leading and charting the course for Corporate Functions, Data & Analytics team that builds and transforms technology capabilities that positively impacts business outcomes. This individual will be responsible for leading a highly talented team that is built for delivering high-end and innovative technologies. The ideal candidate will have a proven track record of leadership in technology-driven environments for Finance and HR business area and has a passion for fostering innovation and excellence in the biotechnology industry. Additionally, collaboration with cross-functional and global teams is required to ensure seamless integrat...

Title and Summary Software Engineer II_Dev/Ops (CI/CD tools (e.g., Jenkins, Git).Chef, XLR, Linux) Job Title Overview Software Engineer II Data Platform Engineering Location Pune, India About the Role As a Software Engineer II on the enterprise-wide Data Platform team, you will focus on automating infrastructure, streamlining deployment processes, and improving system reliability. Youll work closely with senior engineers to build and maintain DevOps pipelines, monitor distributed systems, and support platform operations using technologies like NiFi, Spark, MinIO, Kubernetes, Airflow, and cloud-native tools. Key Responsibilities Develop and maintain CI/CD pipelines for automated deployment an...

Please apply on the following link: https://suprflo.com/jobs/apply/cmistnbfp0001sgy1jxjrjjvs RESOURCE REQUIREMENT: Data Technical Lead / Data Architect (Databricks) WORK MODE & ENGAGEMENT: Remote | Minimum 6 Months Contract (High Likelihood of extension) TIME ZONE: IST EXPERIENCE: 1st Priority: A/A+ player with 7–8 years’ experience 2nd Priority: A/A+ player with 5–7 years’ experience JOB DESCRIPTION: Relevant Experience: Minimum 6 years of experience in Data Engineering and Business Intelligence – designing, developing, testing, and implementing data solutions. 1+ years of hands-on experience with Power BI / Tableau / Analysis Services or comparable tools for visualization and analytics in ...

Senior Data Scientist About the Global Analytics Team The mission of Global Analytics is to lead HEINEKEN into becoming a data-driven company and the best-connected brewer. As a team, we foster a data-driven entrepreneurial culture across the company. We act as an incubator for smart data products in all business areas from sales to logistics, marketing, and purchasing rapidly launching value-creating use cases, such as optimized spare parts management and smarter media spending. This year, our focus is to scale these and other use cases to as many countries as possible around the globe. Our team comprises data scientists, engineers, business intelligence specialists, and analytics translato...

Join phData, a dynamic and innovative leader in the modern data stack. We partner with major cloud data platforms like Snowflake, AWS, Azure, GCP, Fivetran, Pinecone, Glean and dbt to deliver cutting-edge services and solutions. We're committed to helping global enterprises overcome their toughest data challenges. phData is a remote-first global company with employees based in the United States, Latin America and India. We celebrate the culture of each of our team members and foster a community of technological curiosity, ownership and trust. Even though we're growing extremely fast, we maintain a casual, exciting work environment. We hire top performers and allow you the autonomy to deliver...

Join phData, a dynamic and innovative leader in the modern data stack. We partner with major cloud data platforms like Snowflake, AWS, Azure, GCP, Fivetran, Pinecone, Glean and dbt to deliver cutting-edge services and solutions. We're committed to helping global enterprises overcome their toughest data challenges. phData is a remote-first global company with employees based in the United States, Latin America and India. We celebrate the culture of each of our team members and foster a community of technological curiosity, ownership and trust. Even though we're growing extremely fast, we maintain a casual, exciting work environment. We hire top performers and allow you the autonomy to deliver...