15947 Pyspark Jobs - Page 40

Shift time-UK Shift time Primary Skillset-Azure datafactory,Azure ,Python, Pyspark, Databricks, SQL,Azure Synapse Experience with Azure datafactory,Azure ,Python, Pyspark, Databricks, SQL Key Responsibilities Design and build ETL/ELT pipelines to ingest, transform, and load data from clinical, omics, research, and operational sources. Optimize performance and scalability of data flows using tools like Apache Spark, Databricks, or AWS Glue. Collaborate with domain experts in genomics, clinical trials, and lab science to understand and implement robust data solutions. Develop and maintain data models, schemas, and governance practices for structured and unstructured biomedical data. Implement ...

Join us as a Software Engineer, PySpark This is an opportunity for a driven Software Engineer to take on an exciting new career challenge Day-to-day, you'll be engineering and maintaining innovative, customer centric, high performance, secure and robust solutions It’s a chance to hone your existing technical skills and advance your career while building a wide network of stakeholders We're offering this role at associate level What you'll do In your new role, you’ll be working within a feature team to engineer software, scripts and tools, as well as liaising with other engineers, architects and business analysts across the platform. You’ll Also Be Producing complex and critical software rapi...

Join us as a Software Engineer, PySpark This is an opportunity for a driven Software Engineer to take on an exciting new career challenge Day-to-day, you'll be engineering and maintaining innovative, customer centric, high performance, secure and robust solutions It’s a chance to hone your existing technical skills and advance your career while building a wide network of stakeholders We're offering this role at associate level What you'll do In your new role, you’ll be working within a feature team to engineer software, scripts and tools, as well as liaising with other engineers, architects and business analysts across the platform. You’ll Also Be Producing complex and critical software rapi...

Join us as a Software Engineer, PySpark This is an opportunity for a driven Software Engineer to take on an exciting new career challenge Day-to-day, you'll be engineering and maintaining innovative, customer centric, high performance, secure and robust solutions It’s a chance to hone your existing technical skills and advance your career while building a wide network of stakeholders We're offering this role at associate level What you'll do In your new role, you’ll be working within a feature team to engineer software, scripts and tools, as well as liaising with other engineers, architects and business analysts across the platform. You’ll Also Be Producing complex and critical software rapi...

🌟 We're Hiring: Data Platform Engineer! 🌟 We are seeking an experienced Data Platform Engineer to design, build, and maintain scalable data infrastructure using AWS cloud services. The ideal candidate will have expertise in Python, PySpark, EMR, and Apache Airflow to develop robust data pipelines and analytics solutions that drive business insights. 📍 Location: Pune, India ⏰ Work Mode: Work from anywhere 💼 Role: AWS, Python, Pyspark, EMR, Apache Airflow- Data Platform Engineer What You'll Do 🎯 Design and implement scalable data pipelines using Apache Airflow ☁️ Build and optimize AWS EMR clusters for big data processing 🐍 Develop data processing applications using Python and PySpark 📊 Create...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Manager Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and data trans...

, Required Skills & Experience: Hands-on experience with Google Cloud Platform (GCP) Strong practical knowledge of core GCP services. Experience in Data Migration Projects Proven track record of migrating data from on-premise environments to the cloud. Expertise in Cloud Storage Solutions – In-depth knowledge of GCP Cloud Storage, BigQuery, and cloud-based cluster management. Strong Programming Skills – Proficient in PySpark and SQL , especially in processing large volumes of semi-structured and unstructured data.

We are seeking a highly skilled Senior PySpark Data Engineer to design, build, and optimize large-scale data pipelines and distributed systems. Beyond deep expertise in Apache Spark (PySpark) and automation, this role requires the ability to manage stakeholders, ensure timely delivery, and assess requirements. You will play a critical role in bridging business needs with technical execution, ensuring high-quality, scalable, and reliable data solutions. KEY RESPONSIBLITIES Technical Delivery Data Pipeline Development: Design, develop, and optimize scalable ETL/ELT pipelines using PySpark. System Integration & Automation: Build automated data ingestion and transformation frameworks integra...

Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients’ most complex digital transformation needs. Leveraging our holistic portfolio of capabilities in consulting, design, engineering, and operations, we help clients realize their boldest ambitions and build future-ready, sustainable businesses. With over 230,000 employees and business partners across 65 countries, we deliver on the promise of helping our customers, colleagues, and communities thrive in an ever-changing world. For additional information, visit us at www.wipro.com. Long Description Role: Lead Developer Role-Databr...

Responsibilities: Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes. Create the data integration and data diagram documentation. Lead the data validation, UAT and regression test for new data asset creation. Create and maintain data models, including schema design and optimization. Create and manage data pipelines that automate the flow of data, ensuring data quality and consistency. Qualifications and Skills: Strong knowledge on Python and Pyspark Expectation is to have ability to write Pyspark scripts for developing data workflows. Strong knowledge on SQL, Hadoop, Hive, Azure, Databricks and Greenplum Expectation is to write S...

Description Shape the Future of Work with Eptura At Eptura, we're not just another tech company—we're a global leader transforming the way people, workplaces, and assets connect. Our innovative worktech solutions empower 25 million users across 115 countries to thrive in a digitally connected world. Trusted by 45% of Fortune 500 companies, we're redefining workplace innovation and driving success for organizations around the globe. Job Description We are seeking a detail-oriented and experienced QA Engineer to join our team, specializing in ETL testing and data validation. In this role, you will design and execute comprehensive test cases and scripts to ensure data accuracy, completeness, an...

Role: Principal Data Engineer Location: Delhi Mode: Hybrid Type: Contract Job Description: We are seeking a Principal Data Engineer with strong enterprise-level data architecture and engineering experience, specifically within the logistics and manufacturing domains . This role is heavily focused on architecting and developing scalable data solutions using the Azure ecosystem , including Databricks , ADF , Synapse , and PySpark . Key Responsibilities: 90% focus on data architecture and hands-on development 10% involvement in stakeholder collaboration Design and build scalable data pipelines and models in Azure Implement best practices in data engineering and architecture Required Skills: Str...

About CITI Citi's mission is to serve as a trusted partner to our clients by responsibly providing financial services that enable growth and economic progress. We have 200 years of experience helping our clients meet the world's toughest challenges and embrace its greatest opportunities. Analytics and Information Management (AIM) Citi AIM was established in 2003 and is located across multiple cities in India – Bengaluru, Chennai, Pune and Mumbai. It is a global community that objectively connects and analyzes information, to create actionable intelligence for our business leaders. It identifies fact-based opportunities for revenue growth in partnership with the businesses. The function balan...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : PySpark Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary: As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes ...

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : PySpark Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary: As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand project needs, developing application features, and ensuring that the applications function seamlessly within the business environment. You will also engage in testing and tr...

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. Generative AI Consultant for Supply Chain Business Process – Senior Consultant The opportunity We’re looking for Senior Level Consultants with expertise in Generative AI who can work on end-to-end pipelines, enabling data curation, building and fine-tuning Generative AI models, and deploying them into scalable production streams. Analytics, A...

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. Generative AI Consultant for Supply Chain Business Process – Senior Consultant The opportunity We’re looking for Senior Level Consultants with expertise in Generative AI who can work on end-to-end pipelines, enabling data curation, building and fine-tuning Generative AI models, and deploying them into scalable production streams. Analytics, A...

Job Summary: The Associate Data Engineer works on different projects of data engineering to support the use cases, data ingestion pipeline and identify potential process or data quality issues. For the SaaS Integration team, the resource will contribute to the design, development, and maintenance of API integrations across enterprise SaaS platforms including Reltio, OneTrust, and Adobe CDP. This will include developing and maintaining RESTful APIs to integrate internal systems with Reltio (MDM), OneTrust (Privacy & Compliance), and Adobe CDP (Customer Data Platform), participating in technical design reviews and contributing to solution architecture discussions and collaborating with product...

JD 2: Senior Data Engineering Sr. Data Developer in SQL, Pyspark In-depth knowledge of data modelling principles and techniques, including relational and dimensional. Excellent problem solving skills and the ability to troubleshoot and debug complex data related issues. Awareness of data tools and platforms like: SQL Pyspark programming languages like SQL. In-depth knowledge of data management principles, methodologies, and best practices with excellent analytical, problem-solving and decision making skills. Develop, implement and maintain database systems using SQL. Write complex SQL queries for integration with applications. Develop and maintain data models (Conceptual, physical and logica...

Job Title: GCP Data Engineer-Contract to Hire Work Location: Bangalore, KA / Chennai, TN / Pune, MH / Mumbai, MH Skill Required: GCP, PySpark, Python, HDFS, Hadoop, SQL Experience Range in Required Skills: 5+ years Responsibility of / Expectations from the Role: 1 Development in a programming language on GCP 2 Testing & Validation 3 Debugging & troubleshooting Essential Skills: (Must-Have) 1 Good hands on knowledge on GCP 2 Should have worked on Data Migration projects, from On-prem to Cloud 3 Should have Cloud Storage Knowledge, Big Query, Cluster Knowledge

- Design, develop, and maintain scalable ETL pipelines for structured and unstructured data. - Work with Python and PySpark to build efficient data processing frameworks. - Implement data ingestion, transformation, and integration workflows across multiple systems. - Leverage AWS Cloud services (S3, Glue, EMR, Redshift, Lambda, Athena, etc.) for data engineering solutions. - Optimize data pipelines for performance, scalability, and cost efficiency. - Ensure data quality, integrity, and governance across all data processes. - Collaborate with data scientists, analysts, and business stakeholders to provide reliable data solutions. - Troubleshoot, debug, and resolve performance bottlenecks in d...

Requisition ID: 10221732 Location: CHENNAI,TN Title: Analyst Skills Required: Digital : Snowflake~Digital : PySpark~SQL Server 2012 Development Required Experience: 4-6 Role Description: Desired Competencies:(Technical/Behavioral Competency) Must-Have*: (Ideally should not be more than 3-5) - Pyspark,airflow,snowflake,dbt Good-to-Have(Ideally should not be more than 3-5)- AWS EMR,Informatica,hive Responsibility of / Expectations from the Role 1 Understand existing etl code or legacy code to identify source to target mappings 2 Build ingestion code based on source type 3 Perform quality checks 4 Cleansing and transform based on requirements and enterprise standards 5 Deployment using git and ...

About The Role : Job Title Senior BI developer LocationMumbai, India Corporate TitleAVP Role Description This role is in Private Bank Lending Operations Division to support in-house application instances to perform Application Management and Maintenance and Application changes in line with Regulatory requirements. Your key responsibilities Daily / Weekly and Monthly reporting need to be generated via SAS Script and disseminated to stakeholders Ensuring the operational readiness (RTB), extension of existing and developing of new functionalities (CTB) for a MIS application (database with web frontend) i.e. Administer Change requests /code changes to existing tools User support in case there ar...

About The Role : Job TitleAFC Transaction Monitoring - Senior Engineer, VP LocationPune, India Role Description You will be joining the Anti-Financial Crime (AFC) Technology team and will work as part of a multi-skilled agile squad, specializing in designing, developing, and testing engineering solutions, as well as troubleshooting and resolving technical issues to enable the Transaction Monitoring (TM) systems to identify Money Laundering or Terrorism Financing. You will have the opportunity to work on challenging problems, with large complex datasets and play a crucial role in managing and optimizing the data flows within Transaction Monitoring. You will have the opportunity to work across...

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. Generative AI Consultant for Supply Chain Business Process – Senior Consultant The opportunity We’re looking for Senior Level Consultants with expertise in Generative AI who can work on end-to-end pipelines, enabling data curation, building and fine-tuning Generative AI models, and deploying them into scalable production streams. Analytics, A...