50049 Spark Jobs - Page 20

Job Purpose Effectively capable of handling Development and Support. Interact with cross functional business teams to understand business needs and prioritize requirements and deliver it. Duties and Responsibilities Would be required to understand business logic from PMO team and convert it into technical specification Should be responsible for project deliveries on time. Would prepare technical design for enhancements/new projects and get it developed from team (External Business partner/internal). Would be responsible to Design, build and launch new data extraction, transformation and loading processes. Would be responsible to provide support with resolution for all critical process relate...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. EY-Advisory - Data and Analytics – Senior – Data Engineering (Snowflake) As part of our EY-GDS D&A (Data and Analytics) team, we help our clients solve complex business challenges with the help of data and technology. We dive deep into data to extract the greatest value and discover opportunities in key business and functions like Banking, Insurance, Manufacturing, Healthcare, Retail, Manufacturing and Auto, Supply Chain, and Finance. Roles and Responsibilities: S...

Project description Lead the design and development of advanced quantitative and AI-driven models for market abuse detection across multiple asset classes and trading venues. Drive the solutioning and delivery of large-scale surveillance systems in a global investment banking environment, leveraging Python, PySpark, big data technologies, and MS Copilot for model development, automation, and code quality. Play a pivotal role in communicating complex technical concepts through compelling storytelling, ensuring alignment, and understanding across business, compliance, and technology teams. Responsibilities Architect and implement scalable AI/ML models (using MS Copilot, Python, PySpark, and ot...

Project description Information and Document Systems is a global technology change and delivery organization comprising nearly 200 individuals located mostly in Switzerland, Poland, and Singapore. Providing global capturing and document processing, archiving, and retrieval solutions to all business divisions focusing on supporting Legal, Regulatory, and Operational functions. Responsibilities Design, implement, and manage data solutions on Azure Develop and maintain data pipelines using Databricks Ensure efficient data storage and retrieval using Azure Storage and Data Lake Automate infrastructure and application deployments with Ansible Write clean, maintainable code in Python Collaborate w...

Established in 2004, OLIVER is the world’s first and only specialist in designing, building, and running bespoke in-house agencies and marketing ecosystems for brands. We partner with over 300 clients in 40+ countries and counting. Our unique model drives creativity and efficiency, allowing us to deliver tailored solutions that resonate deeply with audiences. As a part of The Brandtech Group , we're at the forefront of leveraging cutting-edge AI technology to revolutionise how we create and deliver work. Our AI solutions enhance efficiency, spark creativity, and drive insightful decision-making, empowering our teams to produce innovative and impactful results. Role: Product Marketing Manager...

Role – ERP Manager Global IT Delivery Center At Alfa Laval, we always go that extra mile to overcome the toughest challenges. Our driving force is to accelerate success for our customers, people and planet. You can only achieve that by having dedicated people with a curious mind. Curiosity is the spark behind great ideas. And great ideas drive progress. Background At Alfa Laval’s Global IT Delivery Centre, we play a pivotal role in enabling and delivering technical capacity across the organization. Our operations are overseen by Line Managers who ensure that delivery excellence, resource alignment, and strategic priorities are consistently met. The Centre is home to a diverse team of more th...

SQL, GCP BQ, ETL pipelines using Pythin/Airflow,Experience on Spark/Hive/HDFS,Data modeling for Data conversion Resources Prior experience working on a conv/migration HR project is additional skill needed along with above mentioned skills Common Skils - SQL, GCP BQ, ETL pipelines using Pythin/Airflow,Experience on Spark/Hive/HDFS,Data modeling for Data conversion Resources Prior experience working on a conv/migration HR project is additional skill needed along with above mentioned skillsData Engineer -Knows HR Knowledge , all other requirement from Functional Area given by UBER

Description We're seeking an exceptional Data Engineer to join our Risk and Compliance Solutions (RCS) Data Engineering team, where you'll architect and build data systems that power Amazon's compliance operations. This role combines technical expertise with business acumen to transform complex data into actionable insights that protect Amazon's ecosystem of buyers, brands, and sellers. Your work will directly influence Amazon's compliance framework and risk management capabilities, ensuring the company's continued growth while maintaining regulatory compliance. You'll be instrumental in building the next generation of data-driven compliance tools that protect Amazon's global marketplace. Yo...

Overview Do you have a relentless passion for data and analytics and a desire to drive future products via key data insights? Do you want to help shape the future of collaboration experience and personal computing, by helping direct where investments should happen? Does the thought of being able to influence the product in each stage of the lifecycle through insights & predictions excite you? Do you love measuring, understanding, and predicting based on real-world user data to come up with insights that drive experiments and recommendations to help move business metrics? If so, we want to talk to you! We are the Data & Applied Sciences team for Windows at Hyderabad, India. We work across var...

Description Python Backend Developer Location – Remote, India EGNYTE YOUR CAREER. SPARK YOUR PASSION. Role Egnyte is a place where we spark opportunities for amazing people. We believe that every role has meaning, and every Egnyter should be respected. With 22,000+ customers worldwide and growing, you can make an impact by protecting their valuable data. When joining Egnyte, you’re not just landing a new career, you become part of a team of Egnyters that are doers, thinkers, and collaborators who embrace and live by our values: Invested Relationships Fiscal Prudence Candid Conversations About Egnyte Egnyte is the secure multi-cloud platform for content security and governance that enables or...

About The Team Our Data Science team is the Avengers to Meesho’s S.H.I.E.L.D 🛡️. And why not? We are the ones who assemble during the toughest challenges and devise creative solutions, building intelligent systems for millions of our users looking at a thousand different categories of products. We’ve barely scratched the surface, and have amazing challenges in charting the future of commerce for Bharat. Our typical day involves dealing with fraud detection, inventory optimisation, and platform vernacularisation. As Data Scientist, you will navigate uncharted territories with us, discovering new paths to creating solutions for our users.🔍 You will be at the forefront of interesting challenges...

We are seeking a highly skilled and motivated MLOps Site Reliability Engineer (SRE) to join our team. In this role, you will be responsible for ensuring the reliability, scalability, and performance of our machine learning infrastructure. You will work closely with data scientists, machine learning engineers, and software developers to build and maintain robust and efficient systems that support our machine learning workflows. This position offers an exciting opportunity to work on cutting-edge technologies and make a significant impact on our organization's success. Responsibilities: Design, implement, and maintain scalable and reliable machine learning infrastructure. Collaborate with data...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. Job description: Talent Data & Insight Delivery Lead Function: Talent Executive, Talent Insights and Proposed rank: Associate Director Analytics Sub Function: Talent Data and Insights Reports to: Global TI&A Leader Position Summary: This position is accountable for building and maintaining the foundational reporting infrastructure, with a focus on ensuring data quality, accessibility, and the development of standardized reports and dashboards. The Talent Data and ...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. Job description: Talent Data & Insight Delivery Lead Function: Talent Executive, Talent Insights and Proposed rank: Associate Director Analytics Sub Function: Talent Data and Insights Reports to: Global TI&A Leader Position Summary: This position is accountable for building and maintaining the foundational reporting infrastructure, with a focus on ensuring data quality, accessibility, and the development of standardized reports and dashboards. The Talent Data and ...

Role: Technical Lead — Databricks (Data Platform Operations) Location: Ghansoli, Navi Mumbai Mode: General shift (weekend/night support only when required) Experience: 12–15 years Immediate joiners preferred. About the Role: We’re looking for a seasoned Technical Lead who can guide a Databricks operations team, drive stability across the platform, and take charge of troubleshooting, governance and automation. If you’ve led support teams and have deep hands-on expertise with Databricks, Spark and Azure, you’ll fit right in. Key Responsibilities: Provide technical leadership and mentor the support team Run daily operations and ensure smooth 24×7 support Validate releases/changes and recommend ...

At FourKites we have the opportunity to tackle complex challenges with real-world impacts. Whether it's medical supplies from Cardinal Health or groceries for Walmart, the FourKites platform helps customers operate global supply chains that are efficient, agile and sustainable. Join a team of curious problem solvers that celebrates differences, leads with empathy and values inclusivity. As a Staff Software Engineer, you will be a technical leader shaping the future of logistics technology. You'll architect and build end-to-end backend solutions using cutting-edge technologies, working closely with our US team and Fortune 500 clients to transform the global supply chain industry. This role de...

About Us At Assembly, we help brands find the change to fuel business growth. We are an award-winning global brand performance agency, home to 1,600 talented people across 25 offices globally. We create unique data, technology and media solutions that enable faster and smarter problem solving and an inspired, collaborative workplace culture. At Assembly we embody three core values: Show Up - actively contribute to a space of personal and collective growth; Make Change - embrace obstacles as opportunities, taking intentional steps to drive positive change; and Win Well - approach success with integrity, responsibility, and a commitment to collaboration, understanding that the journey is as im...

Experienced in Core Java & Spring boot  Design, develop, and implement Kafka-based microservices using Spring Boot.  Build data pipelines for ingesting, processing, and analyzing large-scale data sets.  Optimize Kafka configurations for performance and reliability.  Work with Big Data technologies such as Hadoop, Spark, and NoSQL databases.  Ensure data security, integrity, and compliance with industry standards.  Troubleshoot and resolve issues related to Kafka topics, consumers, and producers.  Monitor system performance and proactively address bottlenecks.  Participate in code reviews and mentor junior developers.  Collaborate with cross-functional teams to understand business re...

Overview Do you see yourself as a coach, a collaborator, and a customer-focused engineering leader? Does pioneering new and innovative ways to collect and showcase key customer data sound exciting to you? Do you care deeply about fostering a great team? Do you want to contribute to an effort that is one of the most critical for the future success of Microsoft 365 and the Experiences + Devices organization? If so, the Insights, Data Engineering & Analytics team might be an excellent place for you to grow your career. The Insights, Data Engineering & Analytics (IDEAs) is at the core of our Company’s mission to enable people and organizations to achieve more. Our team’s goal is to champion a da...

Overview Does pioneering new and innovative ways to collect and showcase key customer data sound exciting to you? Are you passionate about data and do you feel we have been missing the opportunity to be more data-informed at Microsoft? Do you want to contribute to an effort that is one of the most critical for the future success of Microsoft and E+D? If so, the Insights, Data Engineering & Analytics (IDEAs) team might be an excellent place for you to grow your career. Be part of the team building platform services handling millions of users and exabytes of data. This is not just some large-scale web service: the implementation ranks among the world’s largest and state of the art distributed ...

Overview Does pioneering new and innovative ways to collect and showcase key customer data sound exciting to you? Are you passionate about data and do you feel we have been missing the opportunity to be more data-informed at Microsoft? Do you want to contribute to an effort that is one of the most critical for the future success of Microsoft and E+D? If so, the Insights, Data Engineering & Analytics (IDEAs) team might be an excellent place for you to grow your career. Be part of the team building platform services handling millions of users and exabytes of data. This is not just some large-scale web service: the implementation ranks among the world’s largest and state of the art distributed ...

Job Title: Data Architect Location: Noida Experience: 8+ years Role Overview: We are seeking a seasoned Data Architect to design and implement robust, scalable, and secure data solutions. The ideal candidate will have deep expertise in data engineering , SQL , PySpark , and data modelling , with exposure of Power BI for reporting and visualization. Key Responsibilities: Define and implement data architecture strategies aligned with business goals. Design and optimize data pipelines and ETL workflows using PySpark and SQL . Develop and maintain data models (dimensional, relational, star schema) for analytics and BI. Ensure data quality, governance, and security across all platforms. Collabora...

Are you a talented Data Strategist passionate about building scalable data solutions and shaping the future of work? Are you passionate about leveraging data to drive growth and innovation? Singularis Ventures is seeking an experienced Data Strategist to lead our data initiatives and play a pivotal role in a critical Learning Management System project for a UK-based University Group. As our Data Strategist, you will collaborate closely with senior leadership to design and execute a company-wide data strategy. You will be the expert voice on data architecture, governance, security, and analytics, transforming complex data into actionable insights that shape our products and business decisions...

Job Title: Lead Consultant Data Engineer Department: Data Engineering Experience: 9 to 15 Years About Us Tekonika Technologies is committed to delivering advanced data-driven solutions that enable businesses to enhance efficiency, scalability, and innovation. We are looking for an experienced Lead Data Engineer to join our skilled technology team and contribute to high-impact projects. Key Responsibilities Provide strong technical expertise and thought leadership to advise clients on their current and future data landscape. Design, build, and optimize scalable data pipelines using Spark, ensuring high performance and reliability. Collaborate with client Machine Learning engineers to define a...

Role Description We are seeking an experienced Senior Data Engineer to design, develop, and optimize robust data ingestion and transformation pipelines using Azure Cloud services and GSK data platform tools. The ideal candidate will have strong technical expertise, a passion for building scalable data solutions, and the ability to lead engineering best practices across teams. Key Responsibilities : Design, build, and maintain scalable data ingestion, egress, and transformation pipelines using Azure and GSK data platform tools. Optimize complex data engineering solutions using industry standard design patterns and best practices. Deliver high-quality, production ready data pipelines with auto...