50049 Spark Jobs - Page 34

Role & responsibilities Take on a role within the development teams and tackling complex assignments. Provide substantial technical expertise in end-to-end development cycle and. Provide guidance to junior team members. Execute on technical and business strategies and ensure functional goals are met. Support products at a holistic level, understanding how all the pieces fit together. Preferred candidate profile Support complex software development projects by playing a critical role in planning, systems design and mentoring junior developers. Innovate and architect solutions for intricate technical problems or system improvements. Execute the technical strategy for product development, inclu...

Role & responsibilities Job Overview: We are looking for a Senior Data Engineer with strong expertise in SQL, Python, Azure Synapse, Azure Data Factory, Snowflake, and Databricks . The ideal candidate should have a solid understanding of SQL (DDL, DML, query optimization) and ETL pipelines while demonstrating a learning mindset to adapt to evolving technologies. Key Responsibilities: Collaborate with business and IT stakeholders to define business and functional requirements for data solutions. Design and implement scalable ETL/ELT pipelines using Azure Data Factory, Databricks, and Snowflake . Develop detailed technical designs, data flow diagrams, and future-state data architecture . Evang...

Role & responsibilities Job Overview: We are looking for a Senior Data Engineer with strong expertise in SQL, Python, Azure Synapse, Azure Data Factory, Snowflake, and Databricks . The ideal candidate should have a solid understanding of SQL (DDL, DML, query optimization) and ETL pipelines while demonstrating a learning mindset to adapt to evolving technologies. Key Responsibilities: Collaborate with business and IT stakeholders to define business and functional requirements for data solutions. Design and implement scalable ETL/ELT pipelines using Azure Data Factory, Databricks, and Snowflake . Develop detailed technical designs, data flow diagrams, and future-state data architecture . Evang...

Role & responsibilities Job Overview: We are looking for a Senior Data Engineer with strong expertise in SQL, Python, Azure Synapse, Azure Data Factory, Snowflake, and Databricks . The ideal candidate should have a solid understanding of SQL (DDL, DML, query optimization) and ETL pipelines while demonstrating a learning mindset to adapt to evolving technologies. Key Responsibilities: Collaborate with business and IT stakeholders to define business and functional requirements for data solutions. Design and implement scalable ETL/ELT pipelines using Azure Data Factory, Databricks, and Snowflake . Develop detailed technical designs, data flow diagrams, and future-state data architecture . Evang...

About The Role PubMatic is seeking Data Analytics focused Senior Software Engineers with expertise in building and optimizing AI agents, including strong skills in Hadoop, Spark, Scala, Kafka, Spark Streaming, and cloud-based solutions, with proficiency in programming languages such as Scala and Python. You will be responsible for developing advanced AI agents that enhance our data analytics capabilities, enabling our platform to handle complex information retrieval, contextual understanding, and adaptive interactions, ultimately improving our data-driven insights and analytical workflows What You’ll Do Build, design, and implement our highly scalable, fault-tolerant big data platform to pro...

Job Title: Data Engineer Experience: 8+ Years Location: No Constraints Key Responsibilities: Design, develop, and maintain robust data pipelines, architectures, and datasets to support analytics and business needs. Perform debugging, performance tuning, and optimization of data processes and databases. Support production databases , ensuring data reliability, scalability, and performance. Conduct root cause analysis on internal and external data to identify opportunities for process improvement. Collaborate with cross-functional teams to deliver high-quality data solutions and ensure adherence to coding standards and PR processes . Provide technical guidance and mentorship to junior engineer...

Job Title: Data Engineer Experience: 8+ Years Location: No Constraints Key Responsibilities: Design, develop, and maintain robust data pipelines, architectures, and datasets to support analytics and business needs. Perform debugging, performance tuning, and optimization of data processes and databases. Support production databases , ensuring data reliability, scalability, and performance. Conduct root cause analysis on internal and external data to identify opportunities for process improvement. Collaborate with cross-functional teams to deliver high-quality data solutions and ensure adherence to coding standards and PR processes . Provide technical guidance and mentorship to junior engineer...

Job Title: Data Engineer Experience: 8+ Years Location: No Constraints Key Responsibilities: Design, develop, and maintain robust data pipelines, architectures, and datasets to support analytics and business needs. Perform debugging, performance tuning, and optimization of data processes and databases. Support production databases , ensuring data reliability, scalability, and performance. Conduct root cause analysis on internal and external data to identify opportunities for process improvement. Collaborate with cross-functional teams to deliver high-quality data solutions and ensure adherence to coding standards and PR processes . Provide technical guidance and mentorship to junior engineer...

We are looking for Senior Data Engineers who have the right attitude, aptitude, skills, empathy, compassion, and hunger for learning. Build products in the data analytics space. A passion for shipping high-quality data products, interest in the data products space; curiosity about the bigger picture of building a company, product development and its people. Roles and Responsibilities Develop and manage robust ETL pipelines using Apache Spark (Scala) Understand Spark concepts, performance optimization techniques, and governance tools Develop a highly scalable, reliable, and high-performance data processing pipeline to extract, transform, and load data from various systems to the Enterprise Da...

Why it’s worth it: Are you a passionate Software Engineer who has a proven track record of solving complex problems and being at the forefront of innovation? Pursuing a career at ReliaQuest will allow you to write code and manipulate data in ways that have never been done before, driving automation of threat detection and response for one of the world’s fastest growing industries. You will lead the creation, testing, and deployment of cutting-edge security technology to enterprise customers across the globe. Above all else, this role will allow you to work and learn from some of the most talented people in the business as well as have a direct contribution to the growth and success of RQ. Th...

This role is for one of the Weekday's clients Min Experience: 7 years Location: NOIDA, Gurugram, Delhi JobType: full-time We are seeking an experienced and highly skilled Data Architect to design, develop, and optimize scalable data architectures that support business analytics, data governance, and enterprise reporting. The ideal candidate will have strong hands-on technical expertise in Python and PySpark, deep understanding of modern data platforms, and proven experience building robust, secure, and high-performing data ecosystems. This role requires a strategic thinker who can translate complex business requirements into effective data models and scalable systems, while ensuring data qua...

Job Title: Associate Director / Director – Finance Technology & Transformation Location: Pune About QKS Group QKS Group is a global research and advisory firm known for its SPARK Matrix™, a globally recognized framework for vendor evaluation and competitive intelligence. We work with leading technology providers and enterprise buyers to deliver deep insights, technology research, and strategic advisory support. Our products and services, including SPARK Plus, SPARK Matrix™, and tailored analyst advisory engagements, help vendors accelerate go-to-market success, improve positioning, and strengthen customer perception through trusted analyst validation. About the Role We are hiring a finance-t...

This role is for one of the Weekday's clients Min Experience: 7 years Location: NOIDA, Gurugram, Delhi JobType: full-time We are seeking an experienced and highly skilled Data Architect to design, develop, and optimize scalable data architectures that support business analytics, data governance, and enterprise reporting. The ideal candidate will have strong hands-on technical expertise in Python and PySpark, deep understanding of modern data platforms, and proven experience building robust, secure, and high-performing data ecosystems. This role requires a strategic thinker who can translate complex business requirements into effective data models and scalable systems, while ensuring data qua...

We are looking for highly skilled professionals for Senior AWS Data Engineer with strong cloud engineering and data pipeline expertise to be part of our fast-growing IT team in Hyderabad . If you're passionate about delivering scalable, real-time data solutions and have a strong foundation in AWS and big data technologies, we want to hear from you. Position Details: Role: Senior AWS Data Engineer Location: Hyderabad Gachibowli (Vasavi Sky City) Experience: 5+ years Shift: 12:30 PM 9:30 PM IST (Flexible) Work Mode: Hybrid (Mon & Fri WFH) Interview Process: 2 Technical Rounds Key Skills Required Streaming tools: Kafka, Kinesis , Spark, Flink AWS services : S3, SNS, SQS, MWAA (Airflow), Glue, D...

About Albertsons Companies Inc: As a leading food and drug retailer in the United States, Albertsons Companies, Inc. operates over 2,200 stores across 35 states and the District of Columbia. Our well-known banners across the United States, including Albertsons, Safeway, Vons, Jewel-Osco and others, serve more than 36 million U.S customers each week. We build and shape technology solutions that solve customers’ problems every day, making things easier for them when they shop with us online or in a store. We have made bold, strategic moves to migrate and modernize our core foundational capabilities, positioning ourselves as the first fully cloud-based grocery tech company in the industry. Our ...

About the Role : Information and Document Systems is a global technology change and delivery organization comprising nearly 200 individuals located mostly in Switzerland, Poland, and Singapore. Providing global capturing and document processing, archiving, and retrieval solutions to all business divisions focusing on supporting Legal, Regulatory, and Operational functions. Responsibilities : Configuration and customization of Selenium in various integrations Automation of various projects, e.g., a framework, communication and interaction with stakeholders to solve their problems Development of equipment automation plans and their approval Share and contribute: Support and guide less senior t...

Job Position - AI / ML Engineer Experience Required - 1-3 Years Job Type - FTE Location - Hyderabad Overview We are looking for a talented and motivated AI/ML Engineer with 1-3 years of experience to join our dynamic team. In this role, you will be responsible for developing and implementing machine learning models, as well as analysing large datasets to extract actionable insights. You will play a crucial role in enhancing our AI-driven products and solutions. Role and Responsibilities Design and implement machine learning models to address business needs and enhance product functionality. Clean, preprocess, and analyze large datasets, both structured and unstructured, to uncover meaningful...

JOB DESCRIPTION Roles & responsibilities Here are some of the key responsibilities of AI Cloud Architect : Architecture Design: Lead the design and implementation of data architecture solutions, utilizing hyper-scalers like GCP, AWS or Azure to enable data integration, management, and analytics across various data sources. Data Strategy Development: Develop and execute a comprehensive data strategy that aligns with business goals, ensuring best practices in data governance, quality, and security. Create architectural pattern and crucial components of a software architecture. Create reusable solution to a commonly occurring problem in software architecture in a certain context. Apply Design p...

Bachelor's degree in computer science, engineering or related field. Proven experience in Gen AI architecture, design and implementation. Proficiency in programming languages such as Python Strong understanding of machine learning, deep learning and natural language processing. Excellent communication and problem-solving skills. Ability to work in a fast-paced, dynamic environment and manage multiple projects simultaneously. Roles and Responsibilities Develop Gen AI architecture and design solutions that align with business objectives and requirements. Collaborate with cross-functional teams to identify and prioritize Gen AI use cases for our clients. Lead the development and implementation ...

Were Hiring: Big Data Engineer Locations: Chennai, TN | Pune, MH | Mumbai, MH Experience: 6+ Years Skills: Big Data, Hadoop Ecosystem, MapR, Python, Spark, Hive Are you a Big Data professional with strong hands-on experience in building enterprise-scale data solutions? This is an exciting opportunity with one of our premium clients for talented engineers passionate about modern data engineering technologies. Must-Have Skills: Strong proficiency in Scala (Certification preferred) Experience building enterprise-level software solutions solid understanding of OOP concepts & design patterns Basic working knowledge of HDFS, Hive & Spark Ability to quickly research and build skills independently P...

Content Writer – Elevate Content Strategy with a Leading FinTech Innovator Position: Content Writer Location: Remote Employment Type: Full-Time About RemitBee RemitBee is a dynamic FinTech company based in Mississauga, ON, with a mission to "Spark the financial revolution by connecting people and money - across borders, currencies, and cultures." Our innovative platform enables customers to transfer money securely and affordably to over 100 countries. Additionally, we provide services like currency exchange, bill payments, gift cards, and more to simplify and enhance the financial experience. Recognized as one of the GTA's most admired FinTech companies, RemitBee is expanding globally and ac...

This role is for one of the Weekday's clients Min Experience: 7 years Location: NOIDA, Gurugram, Delhi JobType: full-time We are seeking an experienced and highly skilled Data Architect to design, develop, and optimize scalable data architectures that support business analytics, data governance, and enterprise reporting. The ideal candidate will have strong hands-on technical expertise in Python and PySpark, deep understanding of modern data platforms, and proven experience building robust, secure, and high-performing data ecosystems. This role requires a strategic thinker who can translate complex business requirements into effective data models and scalable systems, while ensuring data qua...

We at Digital Refresh Networks partner with brands to craft stories, build identities, and design campaigns that connect with people. We thrive on collaboration, innovation, and work that makes an impact, making sure every idea gets the attention it deserves. Over the past decade, we’ve built campaigns for 200+ brands, teamed up with passionate creators, and grown into a family of 100+ innovators. By blending creativity, culture, and technology, our team of strategists, designers, and storytellers craft brand experiences that spark attention and build connections. Whether shaping the first impression for a young brand or reimagining the story of a household name, we deliver ideas that cut th...

Company Description Story Digital focuses on delivering consumer-centric solutions to drive culture, commerce, and communities for brands and businesses. We are pioneering the new age of advertising by building a dynamic and creative community, #Creaticity. Join us on this exciting journey to redefine how brands connect with their audiences. Position: Social Media Intern Location: Okhla Phase 1, Delhi Duration: 4 Months Stipend: Rs. 10,000/- Key Responsibilities: Assist in creating and scheduling engaging content for social media platforms (Instagram, Facebook, LinkedIn, Twitter, etc.) Monitor and respond to comments/messages under guidance Track basic social media metrics and performance re...

Senior Data Engineer with expertise in AWS, SQL, Pyspark, Databricks, Snowflake and Python to design, build, and optimize data pipelines and platforms. To perform Bug fixing and work on enhancements. This role requires strong technical leadership and the ability to guide a team of engineers toward delivering scalable, secure, and high-performance data solutions.