35358 Spark Jobs - Page 47

About The Role Seeking a highly skilled and analytical Data Scientist / Machine Learning Engineer to join our team. The ideal candidate will have a strong foundation in data science , machine learning , and statistical analysis , with hands-on experience in building scalable models and working with large datasets in cloud-based environments. Key Responsibilities: Design, develop, and deploy machine learning models for real-world applications using Python , scikit-learn , TensorFlow , or PyTorch . Perform data cleaning , wrangling , transformation , and exploratory data analysis (EDA) using pandas and other Python libraries. Apply statistical techniques such as hypothesis testing , regression...

Overview Prodapt is lookig for Senior Technical Lead in Data Engineering stream having 11+ years of experience having hands on expertise on GCP, BQ, Data Pipeline creation & ETL. Responsibilities Understanding the requirements Performing in-depth analysis on data Setting up secure data pipelines from ingestion to delivery Individual contributor Requirements 11+ years of experience in Data Engineering with strong ability to work independently, communicate effectively, and deliver high-quality solutions. Should have strong SQL programming skills. Experience in cloud-based systems (GCP, BQ) is must. Performs data analysis required to troubleshoot data related issues and assist in the resolution...

Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert requirements to fe...

Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential. Title And Summary Senior Data Scientist Our Vision AI COE is responsible for establishing Mastercard as an AI powerhouse. AI will be leveraged and implemented at scale within Mastercard provid...

Role & responsibilities 1.5+ years experience in Design and develop ETL integration patterns using Python on Spark.. 2 Develop framework for converting existing PowerCenter mappings and to PySpark(Python and Spark) Jobs. 3 Create Pyspark frame to bring data from DB2 to Amazon S3 4 Have experience in processing structured/unstructured/semi-structured data using python. Ex. CSV, XML, HTML, SQL and JSON. 5 Design, develop test, deploy, maintain and improve data integration pipeline 6 Design, develop, test, deploy, support, enhance data integration solutions seamlessly to connect and integrate enterprise systems in our Enterprise Data Platform. 7 Innovate for data integration in Apache Spark-bas...

Job Summary : We are seeking a highly skilled and mathematically grounded Machine Learning Engineer to join our AI team. The ideal candidate will have 5+ years of ML experience with a deep understanding of machine learning algorithms, statistical modeling, and optimization techniques, along with hands-on experience in building scalable ML systems using modern frameworks and tools. Key Responsibilities : - Design, develop, and deploy machine learning models for real-world applications. - Collaborate with data scientists, software engineers, and product teams to integrate ML solutions into production systems. - Understand the mathematics behind machine learning algorithms to effectively implem...

Lodha Group is looking for Sub Catageory Manager to join our dynamic team and embark on a rewarding career journey. Manage a sub - category portfolio focusing on assortment planning, pricing, and vendor relationships. Analyze sales trends, consumer insights, and profitability to develop category strategies. Coordinate with marketing and supply chain teams to optimize inventory and promotions. Negotiate contracts, ensure timely product availability, and drive growth in assigned segments. Disclaimer : This job description has been sourced from a public domain and may have been modified by Naukri. com to improve clarity for our users. We encourage job seekers to verify all details directly with...

Job Title : Machine Learning Engineer Job Type : Full-Time Experience Level : Mid to Senior [5+ Years] Department : Data Science / AI Engineering Job Summary : We are seeking a highly skilled and mathematically grounded Machine Learning Engineer to join our AI team. The ideal candidate will have 5+ years of ML experience with a deep understanding of machine learning algorithms, statistical modeling, and optimization techniques, along with hands-on experience in building scalable ML systems using modern frameworks and tools. Key Responsibilities : - Design, develop, and deploy machine learning models for real-world applications. - Collaborate with data scientists, software engineers, and prod...

Job Title : Machine Learning Engineer Job Type : Full-Time Experience Level : Mid to Senior [5+ Years] Department : Data Science / AI Engineering Job Summary : We are seeking a highly skilled and mathematically grounded Machine Learning Engineer to join our AI team. The ideal candidate will have 5+ years of ML experience with a deep understanding of machine learning algorithms, statistical modeling, and optimization techniques, along with hands-on experience in building scalable ML systems using modern frameworks and tools. Key Responsibilities : - Design, develop, and deploy machine learning models for real-world applications. - Collaborate with data scientists, software engineers, and prod...

Work Timings - Rotational Shifts (IST) Work Location - Remote Notice Period - only 30days Job Description Summary The Data engineer is responsible for managing and operating upon Tableau, Tableau bridge server, Databricks, Dbt, SSRS, SSIS, AWS DWS, AWS APP Flow, PowerBI . The engineer will work closely with the customer and team to manage and operate cloud data platform. Job Description Leads operational coverage: • Resolving pipeline issues / Proactive monitoring for sensitive batches / RCA and retrospection of issues and documenting defects.• Design, build, test and deploy fixes to non-production environment for Customer testing. Work with Customer to deploy fixes on production upon receiv...

Job Summary : We are seeking a highly skilled and mathematically grounded Machine Learning Engineer to join our AI team. The ideal candidate will have 5+ years of ML experience with a deep understanding of machine learning algorithms, statistical modeling, and optimization techniques, along with hands-on experience in building scalable ML systems using modern frameworks and tools. Key Responsibilities : - Design, develop, and deploy machine learning models for real-world applications. - Collaborate with data scientists, software engineers, and product teams to integrate ML solutions into production systems. - Understand the mathematics behind machine learning algorithms to effectively implem...

Job Summary : We are seeking a highly skilled and mathematically grounded Machine Learning Engineer to join our AI team. The ideal candidate will have 5+ years of ML experience with a deep understanding of machine learning algorithms, statistical modeling, and optimization techniques, along with hands-on experience in building scalable ML systems using modern frameworks and tools. Key Responsibilities : - Design, develop, and deploy machine learning models for real-world applications. - Collaborate with data scientists, software engineers, and product teams to integrate ML solutions into production systems. - Understand the mathematics behind machine learning algorithms to effectively implem...

Job Summary : We are seeking a highly skilled and mathematically grounded Machine Learning Engineer to join our AI team. The ideal candidate will have 5+ years of ML experience with a deep understanding of machine learning algorithms, statistical modeling, and optimization techniques, along with hands-on experience in building scalable ML systems using modern frameworks and tools. Key Responsibilities : - Design, develop, and deploy machine learning models for real-world applications. - Collaborate with data scientists, software engineers, and product teams to integrate ML solutions into production systems. - Understand the mathematics behind machine learning algorithms to effectively implem...

We are currently seeking a Data Engineer to join our team in Mumbai, Mahrshtra (IN-MH), India (IN). Job Duties: Key Responsibilities: Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer to infrastructure. Demonstrate proficiency in coding skills, utilizing languages such as Python, Java, and Scala to efficiently move solutions into production while prioritizing performance, security, scala...

We are currently seeking a Business Sys. Analysis Advisor - Nexthink to join our team in Bangalore, Karntaka (IN-KA), India (IN). Roles and Responsibility Collaborate with cross-functional teams to gather requirements and develop business solutions. Analyze data using tools such as Azure, Databricks, Pyspark/Python, SQL, Power BI, Tableau, and Azure Data Factory. Develop and maintain backlogs and data maps to support business operations. Work closely with stakeholders to identify business needs and develop solutions. Utilize strong analytical skills to drive business growth and improvement. Stay up-to-date with industry trends and emerging technologies. Job Requirements Strong combination of...

About the Role As a Senior Data Engineer cum Data Scientist, you will be a key contributor to designing, developing, and operating advanced data architectures, pipelines, and analytics solutions within the Palantir ecosystem. You will leverage your deep expertise in Palantir Foundry and Gotham platforms, combined with strong AI capabilities, to solve complex data challenges and drive actionable insights for enterprise and government clients. You will play a leadership role in translating technical concepts into business outcomes, influencing data-driven decision-making, and enabling AI-powered initiatives. Key Responsibilities Design, build, and maintain complex data pipelines and workflows ...

What We Offer Location: Bangalore,IND Youll benefit from a supportive work culture that encourages you to learn, develop, and grow your career as you take on challenges and drive innovative solutions for our customers. We empower our team to push the boundaries of what is possiblewhile learning every day in a supportive leading global company. Visit our Careers website to learn more. At Applied Materials, we care about the health and wellbeing of our employees. Were committed to providing programs and support that encourage personal and professional growth and care for you at work, at home, or wherever you may go. Learn more about our . Our Team Our team is developing a high-performance comp...

What you will do In this vital role you will lead a team of data engineers to build, optimize, and maintain scalable data architectures, data pipelines, and operational frameworks that support real-time analytics, AI-driven insights, and enterprise-wide data solutions. As a strategic leader, the ideal candidate will drive best practices in data engineering, cloud technologies, and Agile development, ensuring robust governance, data quality, and efficiency. The role requires technical expertise, team leadership, and a deep understanding of cloud data solutions to optimize data-driven decision-making. Lead and mentor a team of data engineers, fostering a culture of innovation, collaboration, a...

Data Engineer What you will do In this vital role you will be responsible for designing, building, maintaining, analyzing, and interpreting data to provide actionable insights that drive business decisions. This role involves working with large datasets, developing reports, supporting and implementing data initiatives and, visualizing data to ensure data is accessible, reliable, and efficiently managed. The ideal candidate has strong technical skills, experience with big data technologies, and a deep understanding of data architecture and ETL processes Design, develop, and maintain data solutions for data generation, collection, and processing Be a key team member that assists in design and ...

Role Description: We are looking for highly motivated expert Principal Data Engineer who can own the design & development of complex data pipelines, solutions and frameworks with domain expertise in R&D domain. The ideal candidate will be responsible to design, develop, and optimize data pipelines, data integration frameworks, and metadata-driven architectures that enable seamless data access and analytics. This role prefers deep expertise in big data processing, distributed computing, data modeling, and governance frameworks to support self-service analytics, AI-driven insights, and enterprise-wide data management. Roles & Responsibilities: Architect and maintain robust, scalable data pipel...

ABOUT THE ROLE Role Description: The role is responsible for developing and maintaining the data architecture of the Enterprise Data Fabric. Data Architecture includes the activities required for data flow design, data modeling, physical data design, query performance optimization. The Data Architect is a senior-level position responsible for developing business information models by studying the business, our data, and the industry. This role involves creating data models to realize a connected data ecosystem that empowers consumers. The Data Architect drives cross-functional data interoperability, enables efficient decision-making, and supports AI usage of Foundational Data. This role will...

Live What You Will Do The External Workforce Sr. Manager is responsible for supporting the management and coordination of the organization's external workforce in partnership with our Master Service Providers (MSP), including contingent workers, independent contractors, vendors, and service providers. This role will lead the planning, governance, and operational management of our external workforce to ensure the efficient use of labor categories and other external resources across the organization while maintaining compliance, optimizing cost, and enhancing workforce agility. This role works cross-functionally with HR, Procurement, Legal, IT, and department heads to ensure cost-effective and...

What you will do In this vital role you will be responsible for designing, developing, and maintaining software applications and solutions that meet business needs and ensuring the availability and performance of critical systems and applications. This role involves working closely with product managers, designers, and other engineers to create high-quality, scalable software solutions and automating operations, monitoring system health, and responding to incidents to minimize downtime. Roles & Responsibilities: Take ownership of complex software projects from conception to deployment Manage software delivery scope, risk, and timeline Provide technical guidance and mentorship to junior devel...

ABOUT THE ROLE We are seeking a seasoned Senior Data Engineer to drive the development and implementation of our data strategy. The ideal candidate possesses a strong blend of technical expertise and data-driven problem-solving skills. As a Senior Data Engineer, you will play a crucial role in designing, building, and optimizing our data pipelines and platforms while mentoring junior engineers. Roles & Responsibilities: Contribute to the design, development, and implementation of automations to monitor our data and cloud platforms for reliability, cost, and maintenance. Take ownership of platform management, managing scope, timelines, and risks. Ensure data quality and integrity through rigo...

What you will do In this vital role you will design, build and maintain data lake solutions for scientific data that drive business decisions for Research. You will build scalable and high-performance data engineering solutions for large scientific datasets and collaborate with Research stakeholders. The ideal candidate possesses experience in the pharmaceutical or biotech industry, demonstrates strong technical skills, has experience with big data technologies, and understands data architecture and ETL processes. Roles & Responsibilities: Design, develop, and implement data pipelines, ETL/ELT processes, and data integration solutions Contribute to data pipeline projects from inception to de...