50049 Spark Jobs - Page 26

About Us: Planet Spark is reshaping the EdTech landscape by equipping kids and young adults with future-ready skills like public speaking, and more. We're on a mission to spark curiosity, creativity, and confidence in learners worldwide. If you're passionate about meaningful impact, growth, and innovation—you're in the right place. Location: Gurgaon (On-site) Experience Level: Entry to Early Career (Freshers welcome!) Shift Options: Domestic | Middle East | International Working Days: 5 days/week (Wednesday & Thursday off) | Weekend availability required Target Joiners: Any (Bachelor’s or Master’s) 🔥 What You'll Be Owning (Your Impact): Lead Activation: Engage daily with high-intent leads th...

As a AWS Data Architect specializing in AWS Integration, your role will involve the following key responsibilities: - Design, implement, and maintain a data lake on AWS using Iceberg tables on S3, ensuring data consistency, high availability, and easy querying. - Work with AWS Glue for ETL processes, creating Glue jobs to process, transform, and load data from SQL Server and other sources into Iceberg tables. - Implement and optimize Spark-based data transformations in AWS Glue, ensuring efficient and scalable data workflows. - Lead the migration of on-premises SQL Server data to AWS S3 using AWS Glue, DMS, and other relevant tools. - Design and implement CDC (Change Data Capture) pipelines ...

A career in our Advisory Acceleration Centre is the natural extension of PwC’s leading class global delivery capabilities. We provide premium, cost effective, high quality services that support process quality and delivery capability in support for client engagements. At PwC - AC, as an Azure Senior Developer, the candidate is responsible for end-to-end implementation of Cloud data engineering solutions. The candidate should have strong experience in Azure cloud using Storage services (Blob, ADLS, PaaS SQL), Azure Data factory and Azure Databricks, Snowflake and SQL . Strong in planning and organization skills. Ability to work as cloud developer/lead on an agile team and provide automated cl...

As a Distributed Systems Software Engineer at Salesforce, you will be responsible for leading Big Data infrastructure projects to develop reliable and efficient data infrastructure supporting scalable data processing and analytics for both internal and external customers. **Key Responsibilities:** - Build Data Processing and Analytics Services: You will develop scalable data processing and analytics services using big data technologies like Spark, Trino, Airflow, and Kafka to support real-time and batch data workflows. - Architect Distributed Systems: Design, develop, and operate resilient distributed systems managing thousands of compute nodes across multiple data centers to ensure scalabil...

Job Description: You will be working as an Engineering Manager Data Engineering at Nuaav, where you will be leading a team of data engineers to architect and deliver scalable data platforms on Microsoft Azure. Your role will require deep expertise in Azure cloud services, Python programming, and strong leadership skills to drive technical strategy, team growth, and execution of robust data infrastructures. Key Responsibilities: - Lead, mentor, and grow a high-performing data engineering team focused on delivering next-generation data solutions on Azure. - Architect and oversee the development of scalable data pipelines and analytics platforms using Azure Data Lake, Data Factory, Databricks, ...

As a Global COUPA Technical/Functional Lead at Cigres Technologies Private Limited, your role involves driving, managing, and supporting the delivery of technical solutions to ensure that the COUPA platform meets the needs of SONY globally. You will lead the design and development of new architecture and major functional upgrades for COUPA, as well as build expertise in the entire COUPA application suite to enhance application and data frameworks for SONY. Key Responsibilities: - Lead the design and development of new architecture and major functional upgrades for the COUPA Platform - Build expertise in the entire COUPA application suite to design application and data frameworks for SONY - A...

As a Data Engineer or ML Engineer at UBS, you will play a crucial role in driving the delivery of an innovative ecosystem of tools and services to support the bank's global AI Strategy. Your main responsibilities will include: - Leading a team of Senior Engineers in the country - Interacting directly with product owners and internal users to identify requirements, develop technical solutions, and execute projects - Developing an SDK to capture data product, dataset, and AI/ML model metadata automatically - Integrating and publishing metadata into UBS's AI Use-case inventory and data product and dataset catalog for discovery and regulatory compliance - Designing and implementing services to c...

We use cookies to offer you the best possible website experience. Your cookie preferences will be stored in your browser’s local storage. This includes cookies necessary for the website's operation. Additionally, you can freely decide and change any time whether you accept cookies or choose to opt out of cookies to improve website's performance, as well as cookies used to display content tailored to your interests. Your experience of the site and the services we are able to offer may be impacted if you do not accept all cookies. Skip to main content Home Page Home Page Life At YASH Core Values Careers Business Consulting Jobs Digital Jobs ERP IT Infrastructure Jobs Sales & Marketing Jobs Sof...

Description Role & Responsibilities You will be responsible for architecting, implementing, and optimizing Dremio-based data lakehouse environments integrated with cloud storage, BI, and data engineering ecosystems. The role requires a strong balance of architecture design, data modeling, query optimization, and governance enablement in large-scale analytical environments. Design and implement Dremio lakehouse architecture on cloud (AWS/Azure/Snowflake/Databricks ecosystem). Define data ingestion, curation, and semantic modeling strategies to support analytics and AI workloads. Optimize Dremio reflections, caching, and query performance for diverse data consumption patterns. Collaborate with...

You have an exciting job opportunity with a French multinational information technology (IT) services and consulting company that is committed to leveraging technology for business transformation. Here is the job description for the role: Role Overview: You will be responsible for developing enterprise applications using .Net, .Net Core, and C#. Your expertise in event-driven and microservices architecture will be crucial in this role. Additionally, you will demonstrate a strong understanding of SOLID design principles, Dependency Injection, and event sourcing. Your responsibilities will include writing automated unit tests using NUnit/XUnit and a mocking framework. You should have a good gr...

As a Vice President, Big Data Scala Engineer, you will be responsible for leading the design, development, and implementation of next-generation big data platforms and applications. Your technical expertise in Scala, Spark, and other big data technologies will be crucial in driving innovation, mentoring engineers, and collaborating with cross-functional teams. You will play a key role in translating business requirements into technical architectures and leading their execution. **Key Responsibilities:** - **Technical Leadership:** - Lead the architecture, design, and development of high-performance, scalable, and reliable big data processing systems using Scala and Apache Spark. - Drive tech...

We have vacancies for Aws - Bigdata Specialist position. We are looking for a highly skilled Senior AWS Data Engineer to join our growing data engineering team. The ideal candidate will have deep hands-on experience in AWS cloud services, big data processing frameworks, and advanced SQL programming. You will be responsible for building and maintaining scalable, high-performance data solutions that enable advanced analytics and data-driven decision-making across the organization. This is a great opportunity for someone passionate about working with modern data technologies and optimizing large-scale distributed systems. Key Responsibilities Design, build, and optimize data pipelines and ETL p...

Description About us : At Data Unveil, we believe in delivering the best for our clients (Pharma Companies). We use the latest technology and tools to aggregate and analyze specialty healthcare data received from various data partners. We provide clear and hassle-free business insights to enhance the clients vision and drive business success. Key Responsibilities Develop and optimize ETL workflows and data pipelines using Python and PySpark. Write and optimize SQL queries for Oracle and MySQL databases. Perform distributed data processing and large-scale data transformations with PySpark. Implement data ingestion, transformation, validation, and integration procedures. Work with AWS services...

Role Overview: As a Senior Data Engineer at Magna, you will be leading the data engineering & analytics team by designing, implementing, and managing data infrastructure and analytical systems. Your role will involve providing technical expertise in data modeling, ETL processes, and database management. As a team lead, you will mentor other data engineers to ensure high-quality deliverables and drive the team's success. Key Responsibilities: - Design, develop, and implement data models, ETL processes, and data pipelines using Databricks for efficient and accurate data flow. - Lead and manage a team of data engineers, providing technical guidance, mentoring, and support. - Implement and enfor...

As a Manager Data Science at a global powerhouse in the food & beverage industry, you will play a pivotal role in influencing business-critical decisions at scale through digital transformation, advanced analytics, and AI-driven decision-making. Your primary responsibility will be to lead high-impact modeling and machine learning initiatives, mentor a team of data scientists, and collaborate with cross-functional stakeholders to translate data into business value. This role will require a combination of strategic thinking, hands-on model development, experimentation, and innovation. Key Responsibilities: - Lead and mentor a team of data scientists working across agile pods - Develop predicti...

Unlock Your Future with Nexaminds! At Nexaminds, we're on a mission to redefine industries with AI. We're passionate about the limitless potential of artificial intelligence to transform businesses, streamline processes, and drive growth. Join us on our visionary journey. We're leading the way in AI solutions, and we're committed to innovation, collaboration, and ethical practices. Become a part of our team and shape the future powered by intelligent machines. If you're driven by ambition, success, fun, and learning, Nexaminds is where you belong. We are currently seeking a highly motivated Sr. Azure Data Engineer with experience in Healthcare Domain. This role collaborate closely with produ...

As a Data and Visualization Engineer, you will play a crucial role in enabling the site's data and AI journey by designing scalable data pipelines, integrating data sources, ensuring data quality, and delivering actionable insights through data visualization. Your expertise in data engineering, analytics, and visualization will be key in supporting data-driven decision-making across the organization. **Key Responsibilities:** - Design and implement scalable data pipelines and integrations using GMS/GQendorsed platforms. - Develop and maintain ETL/ELT processes, ensuring reusability, performance, and compliance with data governance standards. - Standardize data integration processes, aligning...

As a Snowflake Lead at NTT DATA, you will play a crucial role in architecting and designing Snowflake-based data platforms on Azure. Your responsibilities will include: - Leading the end-to-end architecture and design of Snowflake-based data platforms on Azure, integrating with Azure services such as ADF, Synapse pipelines, Azure Functions, Key Vault, and ADLS. - Defining and implementing data modeling standards tailored for analytics, BI, and downstream data products, including star/snowflake schema, data vault, and dimensional modeling. - Designing secure, scalable, and cost-efficient Snowflake environments, including warehouses, databases, schemas, roles, resource monitors, and virtual wa...

At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and data transformation solutions. Job Description At PwC - AC, as an Azure Senior Developer, the candidate is responsible for end-to-end implementation ...

We are seeking an experienced and highly motivated Lead Big Data Developer (C12) to drive the development, standardization, and governance of data across our Big Data Portfolio. This role is crucial in ensuring compliance with regulatory mandates, consent orders, and data governance policies, while also optimizing data pipelines and architectures for high-performance applications. The successful candidate will work closely with business stakeholders, data scientists, and engineering teams to establish enterprise-wide data consistency and improve data quality, lineage, and reconciliation processes. The ideal candidate will have a strong background in Big Data technologies, data standardizatio...

Role Overview: As a Java Backend Developer at American Express, you will be a core member of an agile team responsible for driving user story analysis and elaboration. Your role will involve designing and developing responsive web applications using the best engineering practices. You will be engaged in hands-on software development, including writing code, unit tests, proof of concepts, code reviews, and testing in ongoing sprints. Continuous improvement through ongoing code refactoring is essential. Managing your time effectively, working both independently and as part of a team, and bringing a culture of innovation and continuous improvement will be encouraged. Collaboration with product ...

Responsibilities & Skills (Short Version): Manage Databricks workspaces, clusters, jobs, and user access across environments. Implement RBAC, security policies, and optimize clusters for cost and performance. Automate admin tasks using Python/Bash/PowerShell and handle monitoring, troubleshooting, and CI/CD integration. Support data teams, maintain documentation/SOPs, ensure compliance, and manage cloud integrations across Azure/AWS/GCP. Thanks & Regards, Swapna Jambapuram Sr Talent Acquisition Specialist : Swapna@eliteexceed.com https://www.eliteexceed.com

Duration: 15 Weeks of contract Job Description: we’re looking for a data engineer to add to our dynamic and rapidly scaling team. We’re making this investment to help us optimize our digital channels and technology innovations with the end goal of creating competitive advantages for our restaurants around the globe. We’re looking for a solid engineer who brings fresh ideas from past experiences and is eager to tackle new challenges in our company. We’re in search of a candidate who knows about and loves working with modern data integration frameworks, big data and cloud technologies. Candidates must also be proficient with data programming languages (e.g., Python and SQL). Data engineer will...

We are seeking an experienced and highly motivated Lead Big Data Developer (C12) to drive the development, standardization, and governance of data across our Big Data Portfolio. This role is crucial in ensuring compliance with regulatory mandates, consent orders, and data governance policies, while also optimizing data pipelines and architectures for high-performance applications. The successful candidate will work closely with business stakeholders, data scientists, and engineering teams to establish enterprise-wide data consistency and improve data quality, lineage, and reconciliation processes. The ideal candidate will have a strong background in Big Data technologies, data standardizatio...

We are seeking a highly experienced, strategic, and technically proficient Senior Lead Java/J2EE, Big Data Developer (C13) & AI Innovation resource to drive the development, standardization, and governance of data across our Big Data Portfolio. This role is crucial in enabling enterprise-wide data consistency, ensuring adherence to industry data standards, and optimizing data pipelines for high-performance applications. The ideal candidate will have extensive experience in data standardization, metadata management, lineage tracking, and data governance, along with deep expertise in modern Big Data technologies and distributed computing frameworks. This role demands a thought leader who can w...