50049 Spark Jobs - Page 28

Design, develop, and implement data pipelines and architectures. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data systems and databases. Ensure data quality and integrity through data validation and testing procedures. Optimize data processing workflows for improved performance and efficiency. Troubleshoot and resolve complex technical issues related to data engineering. Job Requirements Strong understanding of data structures, algorithms, and software design patterns. Experience with big data technologies such as Hadoop, Spark, and NoSQL databases. Excellent problem-solving skills and attention to detail. Ability ...

Advanced SQL, PySpark, Autosys

About The Role We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Uber you will play a leading role in designing and building datasets that power analytics for teams across Uber. You will also be working closely with Data Analysts, Data Scientists and stakeholders to gather requirements and translate them into a data engineering roadmap for the team. Minimum Qualifications 4+ years of relevant industry experience. 4+ years of SQL experience. 4+ years of python/java/scala experience. 2+ years of data modeling experience. Experience designing and deploying high performance sy...

Hiring for an exciting role in Hyderabad location Work Mode: Hybrid (10 days a month) Shifts : General Description Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together. ...

ValueLabs is Hiring: Data Engineer | Cloudera Data Platform (CDP) Location: Hyderabad Experience: 5+ Years Employment Type: Full-Time About ValueLabs ValueLabs is a global technology company committed to delivering innovative solutions and exceptional client experiences. We are expanding our data engineering team in Hyderabad and are looking for a skilled Data Engineer with strong expertise and the Cloudera Data Platform (CDP) . Role Overview As a Data Engineer , you will design and maintain scalable ETL pipelines, ensuring high data quality, performance, and reliability across our data ecosystem. Key Responsibilities Build and optimize ETL pipelines using PySpark on CDP Ingest data from RDB...

Overview Cvent is a leading meetings, events, and hospitality technology provider with more than 4,800 employees and ~22,000 customers worldwide, including 53% of the Fortune 500. Founded in 1999, Cvent delivers a comprehensive event marketing and management platform for marketers and event professionals and offers software solutions to hotels, special event venues and destinations to help them grow their group/MICE and corporate travel business. Our technology brings millions of people together at events around the world. In short, we’re transforming the meetings and events industry through innovative technology that powers the human connection. The DNA of Cvent is our people, and our cultu...

Work Schedule Standard (Mon-Fri) Environmental Conditions Office As part of the Thermo Fisher Scientific team, you’ll discover meaningful work that makes a positive impact on a global scale. Join our colleagues in bringing our Mission to life every single day to enable our customers to make the world healthier, cleaner and safer. We provide our global teams with the resources needed to achieve individual career goals while helping to take science a step beyond by developing solutions for some of the world’s toughest challenges, like protecting the environment, making sure our food is safe or helping find cures for cancer. Job Title: Data Engineer – Pharmaceutical CDMO Location: [Insert Locat...

About the Role As an Engineering Manager on the FinTech Data & ML Systems team , you will: Lead a high-performing team of data engineers and platform specialists in designing, implementing, and scaling data and ML solutions that power analytics, decision-making, and automation across FinTech. Drive the architecture and delivery of robust data pipelines, feature stores, and data platforms that enable machine learning and advanced analytics use cases. Collaborate closely with product managers, data scientists, and ML engineers to define and deliver reliable data and model workflows that support critical FinTech applications. Provide technical leadership in data architecture, ETL design, model ...

Title and Summary Senior Data Scientist Lead, Data Scientist Our Purpose We work to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments and businesses realize their greatest potential. Our decency quotient, or DQ, drives our culture and everything we do inside and outside of our company. We cultivate a culture of inclusion for all employees that respects their individual strengths, views, and experiences. We believe that our differences enable us to be a better te...

Title and Summary Manager Data Scientist About Mastercard: Mastercard is a leading global technology company in the payments industry. Our mission is to connect and empower an inclusive, digital economy that benefits everyone, everywhere, by making transactions safe, simple, smart, and accessible. Leveraging secure data, robust networks, strategic partnerships, and our commitment to innovation, we enable individuals, financial institutions, governments, and businesses to realise their full potential. With a presence in over 210 countries and territories, we are dedicated to building a sustainable world that unlocks priceless possibilities for all, driven by our core value of decency. _______...

Overview : We are looking for a self-motivated and enthusiastic Lead Cloud Data / Platform Engineer to join the Data Platforms and Engineering Services team. This individual will be responsible to work with our Cloud Architects, Cloud infrastructure, Information Security, Technical Product Managers, Senior Stakeholders and other Cloud data / platform engineers to ensure we are delivering the right solutions for our customers. Data Platform provides real time streaming, batch data processing, pipeline orchestration, data lake management, data cataloging capabilities and deliver data on time with quality, supported by metrics. As a key player of our data platform team, you will have opportunit...

The Opportunity Nutanix is seeking a strong Developer or Technical Lead to join our Nutanix Move team, which builds solutions that simplify application and workload mobility across diverse hypervisors and cloud platforms. If you have deep experience in systems programming, virtualization, and cloud orchestration, and want to work on cutting-edge migration technologies, wed love to hear from you. About the Team At Nutanix, were building a hybrid multicloud platform that powers some of the worlds most demanding workloads. Youll work on innovative migration tools and play a direct role in enabling enterprises to adopt Hybrid Cloud strategies with minimal friction. Your Role Design and develop s...

We are seeking a Senior Software Engineer (ETL) with 10-12 years of experience to join our ETL Development team. This role will report to the Engineering Manager and the candidate will be involved in the planning, design, and implementation of our centralized data warehouse solution for data acquisition, Ingestion and large data processing and automation/optimization across all the company products. About the Role: Candidate will play a crucial role in designing, developing, and leading the implementation of ETL processes and data pipeline solutions. Will collaborate with various stakeholders to ensure the seamless integration, transformation, and loading of data to support our data warehous...

Roles & Responsibilities Design & Build Scalable Data Solutions Improve data processing efficiency, ensuring scalability, speed, and reliability. Work closely with data scientists, analysts, business teams, product owners to understand data needs and deliver reliable, well-structured products. Mentor junior engineers, conduct code reviews, and promote best practices in data engineering. Mandatory Skills: 2-4 years experience in Data Engineering Deep hands-on expertise in Databricks, Python, SQL queries. Must be experienced in Design and implementation of Big Data technologies (Apache Spark, Hadoop ecosystem, Apache Kafka, NoSQL databases) Working as a Big Data Engineer: query tuning, perform...

About The Role Project Role : Data Platform Engineer Project Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Must have skills : Data Science Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Science Practitioner, you will be engaged in formulating, designing, and delivering AI and machine learning-based decision-making frameworks and models that drive business outcomes. Your typical day will inv...

About the role As the Science Tech Lead (Individual Contributor) for the Hailables charter, youll be at the heart of product development, guiding the science direction for a team of 57 talented scientists based in India. Youll work closely with Engineering and Product partners to define strategy, shape roadmaps, and drive execution. You will bring data, algorithms, and business context together to solve complex, real-world problems. In this role, you wont just influence - youll build. Whether it's designing machine learning models to improve matching and pricing, uncovering insights through rigorous experimentation, or applying statistical thinking to shape product levers, youll lead by exam...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : PySpark Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing...

About The Role Project Role : Software Development Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : Python (Programming Language) Good to have skills : Apache Spark, Microservices and Light Weight Architecture, Apache Airflow Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Engineer, you will engage in a dynamic work environment where you will analyze, design, code, and test various components of application code for multiple clients. Your typ...

About The Role Project Role : Software Development Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Apache Airflow, PySpark Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Engineer, you will engage in a dynamic work environment where you will analyze, design, code, and test various components of application code for multiple clients. Your typical day will involve collaborating w...

About The Role We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Uber you will play a leading role in designing and building datasets that power analytics for teams across Uber. You will also be working closely with Data Analysts, Data Scientists and stakeholders to gather requirements and translate them into a data engineering roadmap for the team. Minimum Qualifications 4+ years of relevant industry experience. 4+ years of SQL experience. 4+ years of python/java/scala experience. 2+ years of data modeling experience. Experience designing and deploying high performance sy...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Databricks Unified Data Analytics Platform, Microsoft Azure Databricks, Microsoft Azure Data Services Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day will involve collaborating with cross-functional teams to gather r...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : PySpark Good to have skills : Python (Programming Language) Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various stakeholders to gather requirements, overseeing the development process, and ensuring that the applications meet the specified needs. You will a...

About The Role Project Role : Data Architect Project Role Description : Define the data requirements and structure for the application. Model and design the application data structure, storage and integration. Must have skills : Reltio Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Architect/MDM Architect is a senior technology leader responsible for designing, building, and overseeing the enterprise's Master Data Management solution. This role is pivotal in establishing a "single source of truth" for critical data domains such as Customer, Product, Vendor, and Employee.You will be the chief t...

About The Role Project Role : Data Platform Engineer Project Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : Engineering graduate preferably Computer Science graduate 15 years of full time education Summary :As a Data Platform Engineer, you will assist with the data platform blueprint and design, encompassing the relevant data platf...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Business Agility Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data p...