50049 Spark Jobs - Page 17

As a Machine Learning Engineer, your role will involve designing and implementing scalable machine learning models throughout the entire lifecycle. You will lead feature engineering and model optimization efforts to enhance performance and accuracy. Additionally, you will build and manage end-to-end ML pipelines using MLOps practices for seamless deployment, monitoring, and maintenance of models in production environments. Key Responsibilities: - Lead feature engineering and model optimization efforts - Build and manage end-to-end ML pipelines using MLOps practices - Collaborate with data scientists and product teams to understand business requirements and translate them into effective ML so...

As a PySpark Data Reconciliation Engineer, you should have at least 7 years of relevant experience in technology and development. Your technical skillset should include proficiency in Java or Python, along with hands-on experience in BigData, Hadoop, Spark, and Kafka. Additionally, familiarity with APIs and microservices architecture is essential. If you have UI development and integration experience, it would be considered a strong advantage. Key Responsibilities: - Demonstrate expertise in Java or Python programming languages - Utilize BigData, Hadoop, Spark, and Kafka for data processing and analytics - Work with APIs and microservices architecture to integrate systems - Develop UI compon...

As a Vice President in the Enterprise Technology division at Macquarie, you will be responsible for driving strategic direction and operational excellence. Leading a talented team of engineers, you will foster a culture of innovation and collaboration to achieve business objectives. Your key responsibilities will include: - Developing and executing the strategic roadmap for enterprise data platforms - Ensuring alignment with business objectives and timely project delivery - Collaborating with cross-functional teams to deliver effective data solutions - Maintaining technical excellence and embracing innovative technologies Qualifications required for this role include: - Extensive experience ...

As an Applications Development Intermediate Programmer Analyst, you will play a crucial role in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. Your main objective will be to contribute to applications systems analysis and programming activities. **Key Responsibilities:** - Strong knowledge in Big data, Hadoop, or Cloud Era - Proficiency in programming languages such as spark or scala - Good working knowledge in Kafka API - Consult with users, clients, and other technology groups on issues - Recommend programming solutions, install, and support customer exposure systems - Apply fundamental knowledge of programm...

Description Job Title : Databricks Lead. Location : : 8-10 years of overall experience and 5+ years of hands-on leadership in data engineering projects. Budget : Open to discuss. Notice Period : Immediate joiner/ Serving notice with less than 60 days/Notice is less than 60 days. About The Role We are looking for a highly skilled Databricks Lead with 810 years of overall experience and 5+ years of hands-on leadership in data engineering projects. The ideal candidate will lead teams in designing, building, and optimizing scalable data pipelines and Lakehouse solutions on Databricks. Key Responsibilities Lead the development and delivery of end-to-end data pipelines using Databricks, Spark, Del...

Job Title : AI Technology Lead Experience Level : 10 to 15 years overall; 3+ years in AI leadership Job Location : Onsite Hybrid - Coimbatore ODC - India Reports To : Head of AI Practice/Director of Delivery Role Overview The AI Technology Lead will be responsible for leading a multi-disciplinary team (2040 members) delivering end-to-end AI, Data Engineering, and Digital Transformation solutions for global enterprise clients. This role combines deep technical expertise with delivery leadership to guide solution architecture, mentor engineers, ensure technical excellence, and drive innovation across Generative AI, Agentic AI, and Data ecosystems. Additionally, the role will provide pre-sales ...

You will be part of a dynamic team of researchers, data scientists, and developers as an AI/ML Developer. Your primary responsibility will involve working on cutting-edge AI solutions in various industries like commerce, agriculture, insurance, financial markets, and procurement. Your focus will be on developing and optimizing machine learning and generative AI models to address real-world challenges effectively. - Developing and optimizing ML, NLP, Deep Learning, and Generative AI models - Researching and implementing advanced algorithms for supervised and unsupervised learning - Working with large-scale datasets in distributed environments - Understanding business processes to select and a...

Job Description Skills & Qualifications 4+ years of experience as a Python developer with strong client communication skills and team leadership experience. In-depth knowledge of Python frameworks such as Django, Flask, or FastAPI. Strong expertise in cloud technologies (AWS, Azure, GCP). Deep understanding of microservices architecture, multi-tenant architecture, and best practices in Python development. Familiarity with serverless architecture and frameworks like AWS Lambda or Azure Functions. Experience with deployment using Docker, Nginx, Gunicorn, Uvicorn, and Supervisor. Hands-on experience with SQL and NoSQL databases such as PostgreSQL and AWS DynamoDB. Proficiency with Object Relati...

dharani.wikilabs@gmail.com We are seeking a skilled and motivated Data Engineer to join our team. The ideal candidate will be responsible for designing, implementing, and maintaining our data infrastructure to support our B2B intelligence platform. Responsibilities Design, build, and maintain scalable data pipelines for collecting, processing, and storing large volumes of business data Develop ETL processes to integrate data from various sources, including web scraping, APIs, and third-party data providers Implement data quality checks and monitoring systems to ensure data accuracy and integrity Optimize data storage and retrieval processes for high performance and scalability Collaborate wi...

As a Staff Engineer - Data at SonyLIV's Digital Business in Mumbai, your role is vital in leading the data engineering strategy, architecting scalable data infrastructure, driving innovation in data processing, ensuring operational excellence, and building a high-performance team to enable data-driven insights for OTT content and user engagement. **Key Responsibilities:** - Define the technical vision for scalable data infrastructure using technologies like Spark, Kafka, Snowflake, and cloud services. - Lead innovation in data processing and architecture through real-time data processing and streaming analytics. - Ensure operational excellence in data systems by setting and enforcing standar...

As a Data Analyst, your role involves collecting, organizing, and cleaning large datasets from various sources like internal databases, external APIs, and spreadsheets. It is crucial to ensure data accuracy, completeness, and consistency by cleaning and transforming raw data into usable formats. Your responsibilities include: - Performing exploratory data analysis (EDA) to identify trends, patterns, and anomalies - Conducting statistical analysis to support decision-making and uncover insights - Identifying opportunities for process improvements, cost reductions, and efficiency enhancements - Creating and maintaining clear, actionable reports and dashboards for technical and non-technical st...

Role Overview: Sciative, a fast-growing startup in Navi Mumbai, is seeking a dynamic and organized self-starter to join their Tech Team. As part of this role, you will collaborate with data scientists, software engineers, and business stakeholders to design efficient data models and develop scalable data pipelines. Your responsibilities will include extracting, transforming, and loading data from various sources, optimizing data processing systems, and ensuring data quality, integrity, and consistency. Additionally, you will contribute to the continuous improvement of data engineering practices within the organization and stay updated with industry trends in data engineering, artificial inte...

As an Advisor, Statistical Analysis at Fiserv, you will utilize your expertise in Computer Science, Data Science, Statistics, Mathematics, or related fields to drive impactful insights. Your responsibilities will involve leveraging your proficiency in Python, SQL, and data science libraries such as pandas, scikit-learn, TensorFlow, and PyTorch to analyze and interpret data effectively. - Hands-on experience with big data technologies like Spark, Hadoop, as well as cloud platforms including AWS, GCP, and Azure is required. - Strong problem-solving skills will be crucial in tackling complex challenges. - Ability to thrive in a dynamic and collaborative work environment is essential. If you are...

As a data analyst at PwC, your primary focus will involve leveraging advanced analytical methods to extract insights from extensive datasets and steer data-driven decision-making processes. Your responsibilities will entail utilizing skills in data manipulation, visualization, and statistical modeling to assist clients in addressing intricate business challenges. - Effectively respond to varying perspectives, needs, and emotions of others. - Employ a wide array of tools, methodologies, and techniques to generate innovative ideas and resolve complex problems. - Apply critical thinking to deconstruct intricate concepts. - Grasp the broader objectives of your projects or roles and understand ho...

As a Senior Manager of Applied Data Science at Aarki, you will play a crucial role in leading a high-performing data science team dedicated to optimizing our programmatic demand-side platform (DSP). Your responsibilities will include: - Building, nurturing, and mentoring a talented data science team, focusing on technical growth and long-term career development. - Spearheading the development of scalable machine learning pipelines specifically designed for programmatic mobile advertising. - Establishing best practices for model deployment, monitoring, and performance evaluation. - Taking charge of process enhancements across the machine learning lifecycle. - Collaborating with decision scien...

Role Overview: As the Lead Data Infrastructure Engineer at CBG, your primary responsibility will be to develop and manage a robust data infrastructure and pipelines across the network. Your role is crucial in enabling the delivery of data as a product, ensuring high-quality, accessible, and timely data for advanced analytics, reporting, and decision-making across all operational and business functions. Key Responsibilities: - Design, implement, and manage scalable data architecture for collecting, storing, and processing large volumes of data from CBG plant systems. - Own the cloud/on-prem data lake, data warehouse, and structured databases supporting real-time and batch processing. - Develo...

Who we are Metropolis is an artificial intelligence company that uses computer vision technology to enable frictionless, checkout-free experiences in the real world. Today, we are reimagining parking to enable millions of consumers to just "drive in and drive out." We envision a future where people transact in the real world with a speed, ease and convenience that is unparalleled, even online. Tomorrow, we will power checkout-free experiences anywhere you go to make the everyday experiences of living, working and playing remarkable - giving us back our most valuable asset, time. Who you are Metropolis is seeking a Senior Technical Recruiter to join our team. We are searching for an entrepren...

JOB_POSTING-3-76633 Job Description Role Title: Manager, AML Analytics (L09) Company Overview Synchrony (NYSE: SYF) is a premier consumer financial services company delivering one of the industry’s most complete digitally enabled product suites. Our experience, expertise and scale encompass a broad spectrum of industries including digital, health and wellness, retail, telecommunications, home, auto, outdoors, pet and more. We have recently been ranked #2 among India’s Best Companies to Work for by Great Place to Work. We were among the Top 50 India’s Best Workplaces in Building a Culture of Innovation by All by GPTW and Top 25 among Best Workplaces in BFSI by GPTW. We have also been recogniz...

As a skilled Data Engineer with 7-10 years of experience, you will play a vital role in designing and optimizing data pipelines to handle large datasets and extract valuable business insights. Your responsibilities will include: - Designing, building, and maintaining scalable data pipelines and architecture - Developing and enhancing ETL processes for data ingestion and transformation - Collaborating closely with data scientists and analysts to meet data requirements and deliver effective solutions - Monitoring data integrity through data quality checks - Ensuring compliance with data governance and security policies - Leveraging cloud-based data technologies and services for storage and pro...

JOB_POSTING-3-76633-2 Job Description Role Title: Manager, AML Analytics (L09) Company Overview Synchrony (NYSE: SYF) is a premier consumer financial services company delivering one of the industry’s most complete digitally enabled product suites. Our experience, expertise and scale encompass a broad spectrum of industries including digital, health and wellness, retail, telecommunications, home, auto, outdoors, pet and more. We have recently been ranked #2 among India’s Best Companies to Work for by Great Place to Work. We were among the Top 50 India’s Best Workplaces in Building a Culture of Innovation by All by GPTW and Top 25 among Best Workplaces in BFSI by GPTW. We have also been recogn...

Job Title: Senior Analyst - Brand Analytics GCL: D1 Introduction To Role Do you feel prepared to make a significant impact in the world of pharmaceuticals? As a Senior Analyst in Brand Analytics, you'll be at the forefront of driving strategic and operational excellence within our Commercial Organization. This hands-on analytical role involves acting as a proactive internal consultant to a specific brand team, crafting commercial solutions that enable data-driven decisions. Your expertise in predictive and prescriptive analytics will be essential as you coordinate the understanding of various datasets and implement analytical solutions for business opportunities, customer segmentation, and m...

Job Title: Senior Analyst - Brand Analytics GCL: D1 Introduction To Role Do you feel prepared to make a significant impact in the world of pharmaceuticals? As a Senior Analyst in Brand Analytics, you'll be at the forefront of driving strategic and operational excellence within our Commercial Organization. This hands-on analytical role involves acting as a proactive internal consultant to a specific brand team, crafting commercial solutions that enable data-driven decisions. Your expertise in predictive and prescriptive analytics will be essential as you coordinate the understanding of various datasets and implement analytical solutions for business opportunities, customer segmentation, and m...

JOB_POSTING-3-76633-1 Job Description Role Title: Manager, AML Analytics (L09) Company Overview Synchrony (NYSE: SYF) is a premier consumer financial services company delivering one of the industry’s most complete digitally enabled product suites. Our experience, expertise and scale encompass a broad spectrum of industries including digital, health and wellness, retail, telecommunications, home, auto, outdoors, pet and more. We have recently been ranked #2 among India’s Best Companies to Work for by Great Place to Work. We were among the Top 50 India’s Best Workplaces in Building a Culture of Innovation by All by GPTW and Top 25 among Best Workplaces in BFSI by GPTW. We have also been recogn...

About Buddy: Buddy brings friendly, relatable experts to your fingertips — people who are easy to talk to, and even easier to trust. This isn’t about random chats; it’s about real, meaningful conversations that offer clarity, confidence, and actionable guidance. Whether it’s fitness, style, wellness, relationships, or mindset — users turn to Buddy for support from real humans, not algorithms. Every expert on our platform is someone who’s always been the “go-to” in their circle — the one friends count on to listen deeply, understand intuitively, and help them grow. If you’re someone who inspires trust, leads with empathy, and knows how to spark transformation through conversation — Buddy is b...

Responsibilities A day in the life of an InfoscionAs part of the Infosys delivery team, your primary role would be to provide best fit architectural solutions for one or more projects. You would also provide technology consultation and assist in defining scope and sizing of work You would implement solutions, create technology differentiation and leverage partner technologies. Additionally, you would participate in competency development with the objective of ensuring the best-fit and high quality technical solutions. You would be a key contributor in creating thought leadership within the area of technology specialization and in compliance with guidelines, policies and norms of Infosys.If y...