15947 Pyspark Jobs - Page 17

World Wide Technology Holding Co, LLC (WWT) is a privately held global technology integrator and supply chain solutions provider. Through our culture of innovation, we inspire, build and deliver business results, from idea to outcome. Based in St. Louis, WWT works closely with industry leaders such as Cisco, VMware, NetApp, Dell EMC, HPE and several others, but also include emerging tech players. WWT employs more than 10,000 people and operates in more than 2 million square feet of state-of-the-art warehousing, distribution and integration space strategically located throughout the world. WWT ranks Glassdoors Best Places to Work and has been on Fortune’s 100 Best Companies to Work For list 1...

WPP is the creative transformation company. We use the power of creativity to build better futures for our people, planet, clients, and communities. Working at WPP means being part of a global network of more than 100,000 talented people dedicated to doing extraordinary work for our clients. We operate in over 100 countries, with corporate headquarters in New York, London and Singapore. WPP is a world leader in marketing services, with deep AI, data and technology capabilities, global presence and unrivalled creative talent. Our clients include many of the biggest companies and advertisers in the world, including approximately 300 of the Fortune Global 500. Our people are the key to our succ...

Location: Remote within Europe, with occasional travel to customer sites as needed. About Us: C-Serv is on the cutting edge of technology, harnessing the power of Big Data and Generative AI to deliver innovative solutions. We are a passionate team of engineers dedicated to transforming how data is utilized across industries. The opportunity: As a Senior Software Engineer specializing in Big Data and Generative AI, you will be at the forefront of designing and implementing large-scale data solutions. Your insights and creativity will help shape next-generation applications that leverage the latest advancements in AI technology. This role requires a combination of software development skills a...

Location: Remote within Europe, with occasional travel to customer sites as needed. About Us: C-Serv is dedicated to driving innovation in the fields of Generative AI and Machine Learning. Our team consists of forward-thinking engineers dedicated to advancing how organizations leverage data to build intelligent applications. We encourage a collaborative and inclusive work environment where every team member can contribute their unique talents and perspectives. The opportunity: As a Senior Engineer focused on Generative AI and Machine Learning, you will play a pivotal role in developing cutting-edge solutions that harness the power of machine learning algorithms to transform data into actiona...

At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career. Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express. Global Merchant & Network Services (GMNS), the merchant and bank partner network of American Express, acquires and maintains relationships with merchants and banks...

Location: Remote within Europe, with occasional travel to customer sites as needed. About Us: C-Serv is dedicated to driving innovation in the fields of Generative AI and Machine Learning. Our team consists of forward-thinking engineers dedicated to advancing how organizations leverage data to build intelligent applications. We encourage a collaborative and inclusive work environment where every team member can contribute their unique talents and perspectives. The opportunity: As a Senior Engineer focused on Generative AI and Machine Learning, you will play a pivotal role in developing cutting-edge solutions that harness the power of machine learning algorithms to transform data into actiona...

We are looking for a skilled Data Engineer with 4 to 7 years of experience to join our team in Bangalore. The ideal candidate will have expertise in Python, SQL, AWS, Spark, and Big Data processing frameworks. Roles and Responsibility Design and develop scalable data pipelines using Python, Scala, or Java. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data systems using Hadoop and Big Data processing frameworks. Ensure data quality and integrity by implementing robust testing and validation procedures. Optimize data storage and retrieval processes for improved performance and efficiency. Participate in code reviews t...

Role: Data Architect Location: Delhi Mode: Hybrid Type: Contract Job Description: We are looking for an experienced Data Architect with strong expertise in data modeling , Azure data services , and data pipeline development . The ideal candidate will have hands-on experience with ADF , Databricks , and PySpark (mandatory), and be proficient in SQL . Strong stakeholder management skills are essential for collaborating with cross-functional teams and translating business needs into scalable data solutions. Key Skills Required: Proven experience as a Data Architect Strong data modeling skills (conceptual, logical, physical) Hands-on with Azure Tech Stack (e.g., Azure Data Factory, Azure Databri...

Key Responsibilities: Design and develop scalable data pipelines. Extract, transform, and load (ETL/ELT) data from various sources. Build and maintain data warehouses and data lakes. Integrate structured and unstructured data. Manage and optimize databases (SQL and NoSQL). Ensure data quality, accuracy, and consistency. Monitor and improve data pipeline performance. Collaborate with data scientists, analysts, and business teams. Maintain data security and follow compliance regulations (e.g., GDPR). Document data workflows, architecture, and systems. Use tools like Apache Spark, Kafka, Airflow, Hadoop, Snowflake, etc. Work with cloud platforms like AWS, GCP, or Azure. Troubleshoot data issues...

About the Role We are seeking a highly skilled Lead Data Engineer to define and drive the data migration strategy from legacy RDBMS platforms to PostgreSQL for a mission-critical billing and invoicing system. This role requires a hands-on technical leader who can design the migration architecture, oversee implementation, and ensure seamless transition without disruption to core business functions. The ideal candidate will have deep expertise in data migration frameworks, large-scale distributed processing (Spark preferred), and experience with both open-source and AWS ecosystem tools. They will work closely with business stakeholders and customers to manage expectations, deliver with precisi...

Job Description Job title: Data Engineer ( Python + PySpark + SQL ) Candidate Specification: Minimum 6 to 8 years of experience in Data Engineer Job Description Data Engineer with strong expertise in Python, PySpark, and SQL.Expert in Kafka. Design, develop, and maintain robust data pipelines using PySpark and Python. Strong understanding of SQL and relational databases (e.g., PostgreSQL, MySQL, SQL Server). Proficiency in Python for data engineering tasks and scripting. Hands-on experience with PySpark in distributed data processing environments. Strong command of SQL for data manipulation and querying large datasets. Skills Required RoleData Engineer ( Kafka ) Industry TypeIT/ Computers - ...

Job Summary: As a Data Scientist specializing in Generative AI & Hyper-Personalization, you will work on developing and implementing on use cases related to collections with resolution optimization & machine learning models that power advanced personalization capabilities. You will leverage generative AI techniques to create dynamic, tailored user experiences across multiple touchpoints, while optimizing data-driven strategies to enhance customer-collector/channel engagement, resolution rates, and Low operational cost. Key Responsibilities: Generative AI Model Development: Design, develop, and deploy generative AI models use case (e.g., GPT, GANs, VAEs) to enhance personalization in recommen...

Job Title: Senior Data Engineer Pyper | AWS Lambda | AWS Glue | Snowflake Experience Required: 5 to 9 years Location: Remote Joining Timeline: Immediate to 15 Days Job Summary: We are seeking a highly skilled and experienced Senior Data Engineer with strong expertise in Pyspark , AWS Lambda , AWS Glue , and Snowflake . The ideal candidate will be responsible for building and maintaining scalable data pipelines, ensuring seamless data integration and transformation across platforms, and delivering high-performance solutions in a cloud-native environment. This is a remote position , open only to candidates who can join immediately or within 15 days . Key Responsibilities: Design, build, and ma...

Urgent requirement for AWS Data Engineer. Top 3 skills AWS data technologies (S3, Redshift, Athena, Glue), Python, Pyspark, SQL, ETL toolsets, inc. Informatica CDC, ETL, Kafka Work location NTTData office India (Hybrid) Shift timings Normal shift Experience 7+ yrs POSITION OVERVIEW : Data Engineer Position Overview Summary: The Data Engineer will expand and optimize the data and data pipeline architecture, as well as optimize data flow and collection for cross functional teams The Data Engineer will perform data architecture analysis, design, development and testing to deliver data applications, services, interfaces, ETL processes, reporting and other workflow and management initiatives The ...

We are looking for a skilled Azure Big Data Engineer with expertise in PySpark to join our team in Chennai, Bangalore, Pune, Mumbai, Noida, and Hyderabad. The ideal candidate will have 6-10 years of experience in data engineering and cloud technologies. Roles and Responsibility Design and develop scalable big data solutions using Azure, Spark, and PySpark. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data pipelines and architectures. Optimize data processing workflows for performance and efficiency. Ensure data quality and integrity through robust testing and validation procedures. Participate in code reviews and co...

We are looking for a skilled professional with expertise in Apache Spark to join our team. The ideal candidate will have 5-10 years of experience and be based in Bangalore, Hyderabad, Pune, Chennai, Coimbatore, or Greater Noida. Roles and Responsibility Design, develop, and implement scalable data processing solutions using Apache Spark. Collaborate with cross-functional teams to identify business requirements and develop technical solutions. Optimize application performance through tuning and optimization techniques. Develop and maintain large-scale data pipelines using Hadoop, Hive, and Unix Shell Scripting. Ensure seamless integration of Apache Spark applications with other systems and to...

We are looking for a skilled professional with expertise in Apache Spark and cloud technologies to join our team. The ideal candidate will have 5-7 years of experience. Roles and Responsibility Design, develop, and implement scalable data processing pipelines using Apache Spark. Collaborate with cross-functional teams to integrate Spark applications with cloud services like Azure and AWS. Develop and maintain large-scale data warehouses and data lakes using Synapse and Snowflake. Implement data engineering tools and technologies to optimize data processing workflows. Troubleshoot and resolve complex technical issues related to Spark and cloud infrastructure. Participate in code reviews and c...

Role: ETL Data engineer/ETL developer Experience: 3.9 Years - 9 Years Location: Chennai, Guindey,WFO Notice Period: Only Immediate Joiners SKills: Mandatory skills: 1.ETL 2.AWS,Lambda,SNS 3.Python,Pyspark 4.Apache airflow Interested candidates can share their updated to CV to pravallika@wrootsglobal.in

· 4+ years of advanced working knowledge of SQL, Python, and PySpark AWS Exposure Python & Pyspark-Candidate should be equally good-Coding is important

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics techniques to help clients optimise their operations and achieve their strategic goals. In business intelligence at PwC, you will focus on leveraging data and analytics to provide strategic insights and drive informed decision-making for clients. You will develop and implement innovative solutions to optimise business performance and enhance competitive advantage. *Why PWC At PwC, you will be pa...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics techniques to help clients optimise their operations and achieve their strategic goals. In business intelligence at PwC, you will focus on leveraging data and analytics to provide strategic insights and drive informed decision-making for clients. You will develop and implement innovative solutions to optimise business performance and enhance competitive advantage. *Why PWC At PwC, you will be pa...

Trusted by many of the largest companies globally, Accertify is the leading digital platform assessing risk across the entire customer journey, from Account Monitoring and Payment Risk to Refund Fraud and Dispute Management. Accertify helps maximize revenues and user experience while minimizing loss and customer friction. We offer ultra-fast decision-making and precise control, ensuring our customers are always confidently in the driver’s seat and ready to #MoveAtTheSpeedOfRight. Be in the driver’s seat of your career as a Decision Science Analyst with the industry leader- and build a career you can trust. As part of the Accertify Fraud Decision Sciences team, you will be responsible for bui...

Job Title: AWS Data Engineer Location: Hyderabad, India (Candidates must be based in Hyderabad, Delhi, Noida, or Gurugram only) Must Have Skills & Experience: Minimum 5+ years of experience as a Data Engineer Strong expertise in PySpark with hands-on experience building Spark applications using Spark DataFrames in Python Proven experience with AWS Glue Solid proficiency in Python Strong hands-on experience in PySpark development AWS Certifications (Data Analytics, Solutions Architect, etc.) Demonstrated contributions to AWS Data Engineering projects Hands-on experience with AWS Athena, AWS EMR, and Amazon Redshift Stability in career – minimum 3+ years tenure in at least one organisation Str...

Job Description : : Data Analyst Location : Bengaluru Job Summary We are seeking a highly motivated Data Analyst to join our growing team. This role involves analyzing complex datasets, generating actionable insights, and supporting data-driven decision-making across various business functions. You will work closely with crossfunctional teams to help optimize performance and improve business outcomes. Key Responsibilities Work closely with engineering teams on data availability and quality. Analyze large and complex datasets to identify trends, patterns, and actionable insights. Track KPIs and performance metrics to support operational and strategic decisionmaking. Translate business needs i...

As a Python and PySpark Developer at this intermediate level position, your role involves participating in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. Your overall objective is to contribute to applications systems analysis and programming activities. Key Responsibilities: - Utilize knowledge of applications development procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements, including using script tools and analyzing/interpreting code - Consult with users, clients, and other technology groups on issues, and recommend programming solutions, ...