23086 Pyspark Jobs - Page 18

At Capgemini Invent, we believe difference drives change. As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to deliver cutting-edge solutions. Join us to drive transformation tailored to our client's challenges of today and tomorrow. Informed and validated by science and data. Superpowered by creativity and design. All underpinned by technology created with purpose. Your Role Build and optimize data pipelines and design scalable architectures on Azure Cloud Platform. Collaborate with data scientists, analysts, and developers to deliver high-quality data solutions. Ensure data quality, governance, and secu...

About Position: We are seeking a highly skilled and experienced Data Engineer with expert-level proficiency in Azure Databricks, Apache Spark, and Azure Data Services. The ideal candidate will have a strong background in building production-grade Delta Live Tables (DLT) pipelines, implementing Medallion Architecture, and managing infrastructure using Terraform. This role demands hands-on experience in real-time data ingestion, structured streaming, and CI/CD practices. Familiarity with the Healthcare domain and Snowflake is a plus. Role: Senior Data Engineer Location: All Persistent Locations Experience: 6+ Years Job Type: Full Time Employment What You'll Do: Design, develop, and maintain sc...

Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential. Title And Summary Associate Managing Consultant, Advisors & Consulting Services, Performance Analytics Associate Managing Consultant – Performance Analytics Advisors & Consulting Services Serv...

Requirements Experience At least 5 years of experience in AWS based projects. Technical skills Proficiency in Python and PySpark for data engineering tasks. Big Data Strong knowledge of Big Data technologies and data warehousing concepts. AWS services Experience with AWS Data Engineering stack, including S3, RDS, Athena, Glue, Lambda, and Step Functions. SQL Strong SQL skills for data manipulation and querying. CI CD Experience with CI CD tools like Terraform and Git Actions. Soft skills Good communication skills and ability to work in a multicultural team.

Experience: 5-7years Shift Timings: 1:00 pm to 10:00 pm Main location: Hyderabad Work Type: Work from office Skill: Spark (PySpark), Python and SQL. Employment Type: Full Time Must have Skills: 5+ yrs. Development experience with Spark (PySpark), Python and SQL. • Extensive knowledge building data pipelines • Hands on experience with Databricks Devlopment • Strong experience developing on Linux OS. • Experience with scheduling and orchestration (e.g. Databricks Workflows,airflow, prefect, control-m). Good to have skills: Solid understanding of distributed systems, data structures, design principles. • Agile Development Methodologies (e.g. SAFe, Kanban, Scrum). • Comfortable communicating wit...

About Position: Data Engineer with extensive experience in leading large-scale data migration projects, specializing in PySpark and Databricks. Proven ability to design and optimize high-performance data pipelines, refactor legacy ETL processes, and ensure data integrity across modern cloud platforms. Adept at collaborating with architects and guiding engineering teams to align solutions with enterprise data strategies. Role: Senior Data Engineer Location: Pune Experience: 6 to 9 Years Job Type: Full Time Employment What You'll Do: Design and optimise PySpark pipelines for large-scale data migration. Refactor stored procedures and ETL logic from Oracle to Databricks SQL. Implement validation...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. Development Lead (Full Stack Experience) Work across investment technology stacks, engage directly with global stakeholders across investment, operations, products and wider technology teams and help drive technology solutions that support portfolio management and trading Drive full stack application development using modern technologies across cloud-native and hybrid architectures Own the production environment operations and applications Required 7- 10 years of ...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. Position EY’s GDS Tax Technology team’s mission is to develop, implement and integrate technology solutions that better serve our clients and engagement teams. As a member of EY’s core Tax practice, you’ll develop a deep tax technical knowledge and outstanding database, data analytics and programming skills. Ever-increasing regulations require tax departments to gather, organize and analyse more data than ever before. Often the data necessary to satisfy these ever...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. Position EY’s GDS Tax Technology team’s mission is to develop, implement and integrate technology solutions that better serve our clients and engagement teams. As a member of EY’s core Tax practice, you’ll develop a deep tax technical knowledge and outstanding database, data analytics and programming skills. Ever-increasing regulations require tax departments to gather, organize and analyse more data than ever before. Often the data necessary to satisfy these ever...

Dear Candidate, Greetings from TATA Consultancy Services!! Thank you for expressing your interest in exploring a career possibility with the TCS Family. Hiring For:- AWS Data Engg(AWS+Python+Glue) Location: Noida/ Kolkata/ Pune/ Bangalore/ Chennai/Hyderabad Experience: 4 to 7yrs • Advanced working Scala ,SQL,Python/PySpark knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases. • Experience building and optimizing ‘Cloud big data’ data pipelines, architectures and data sets. • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and iden...

Job description Hiring for Pyspark Develper Mandatory Skills: Pyspark, Python, SQL Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and detailed functio...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. Development Lead (Full Stack Experience) Work across investment technology stacks, engage directly with global stakeholders across investment, operations, products and wider technology teams and help drive technology solutions that support portfolio management and trading Drive full stack application development using modern technologies across cloud-native and hybrid architectures Own the production environment operations and applications Required 7- 10 years of ...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. Position EY’s GDS Tax Technology team’s mission is to develop, implement and integrate technology solutions that better serve our clients and engagement teams. As a member of EY’s core Tax practice, you’ll develop a deep tax technical knowledge and outstanding database, data analytics and programming skills. Ever-increasing regulations require tax departments to gather, organize and analyse more data than ever before. Often the data necessary to satisfy these ever...

Job Description Core Skills (Main): Python Strong proficiency in writing efficient, clean, and scalable code. PySpark Hands-on experience developing distributed data processing pipelines. Supplementary Skill: Azure Databricks – Working knowledge of building, deploying, and managing data workflows in Databricks. Additional Expectations: Solid understanding of data concepts including ETL/ELT processes, data modeling, and data quality. Proven experience performing data transformations using Python and PySpark within Databricks environments. Ability to work with large datasets, optimize Spark jobs, and troubleshoot performance issues.

10- 15 yrs experience in Databrick and exposure to Data/AI platforms. Expertise in Pyspark/Data factory Develop efficient Extract, Load and Transform (ELT/ETL) processes to facilitate seamless data integration, transformation, and loading from various sources into the data platform using Azure and Databricks This includes inbound and outbound data processes. Conduct and support unit and system testing/ SIT/ UAT Support platform deployment and post go-live support Expert in Pyspark and Data Factory

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. Position EY’s GDS Tax Technology team’s mission is to develop, implement and integrate technology solutions that better serve our clients and engagement teams. As a member of EY’s core Tax practice, you’ll develop a deep tax technical knowledge and outstanding database, data analytics and programming skills. Ever-increasing regulations require tax departments to gather, organize and analyse more data than ever before. Often the data necessary to satisfy these ever...

Job Overview: We are seeking an experienced Senior Developer with strong expertise in Python, Node.js, Azure, and a proven track record of migrating cloud applications from AWS to Azure. This role requires hands-on experience in PySpark, Databricks, and Azure data services such as ADF and Synapse Spark. The ideal candidate will lead end-to-end modernization and migration initiatives, code remediation, and deployment of serverless and microservices-based applications in Azure. Key Responsibilities: Lead the migration of Python and Node.js applications from AWS to Azure. Analyze legacy AWS architecture, source code, and cloud service dependencies to identify and implement code refactoring and ...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. Development Lead (Full Stack Experience) Work across investment technology stacks, engage directly with global stakeholders across investment, operations, products and wider technology teams and help drive technology solutions that support portfolio management and trading Drive full stack application development using modern technologies across cloud-native and hybrid architectures Own the production environment operations and applications Required 7- 10 years of ...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. Position EY’s GDS Tax Technology team’s mission is to develop, implement and integrate technology solutions that better serve our clients and engagement teams. As a member of EY’s core Tax practice, you’ll develop a deep tax technical knowledge and outstanding database, data analytics and programming skills. Ever-increasing regulations require tax departments to gather, organize and analyse more data than ever before. Often the data necessary to satisfy these ever...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. Development Lead (Full Stack Experience) Work across investment technology stacks, engage directly with global stakeholders across investment, operations, products and wider technology teams and help drive technology solutions that support portfolio management and trading Drive full stack application development using modern technologies across cloud-native and hybrid architectures Own the production environment operations and applications Required 7- 10 years of ...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. Development Lead (Full Stack Experience) Work across investment technology stacks, engage directly with global stakeholders across investment, operations, products and wider technology teams and help drive technology solutions that support portfolio management and trading Drive full stack application development using modern technologies across cloud-native and hybrid architectures Own the production environment operations and applications Required 7- 10 years of ...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. Position EY’s GDS Tax Technology team’s mission is to develop, implement and integrate technology solutions that better serve our clients and engagement teams. As a member of EY’s core Tax practice, you’ll develop a deep tax technical knowledge and outstanding database, data analytics and programming skills. Ever-increasing regulations require tax departments to gather, organize and analyse more data than ever before. Often the data necessary to satisfy these ever...

We are seeking a skilled Databricks Developer to join our team on a 4-month contract basis. The ideal candidate will have strong expertise in modern data engineering technologies and the ability to work in a fast-paced, remote environment. Key Responsibilities : - Develop, optimize, and manage large-scale data pipelines using Databricks, PySpark, DBT, and AWS S3/Glue/Redshift. - Work in multi-cloud environments including AWS, Azure, and GCP. - Implement workflow orchestration using Airflow or similar frameworks. - Design, implement, and manage data warehouse solutions, schema evolution, and data versioning. - Collaborate with cross-functional teams to deliver high-quality data solutions. Req...

We are seeking a skilled Databricks Developer to join our team on a 4-month contract basis. The ideal candidate will have strong expertise in modern data engineering technologies and the ability to work in a fast-paced, remote environment. Key Responsibilities : - Develop, optimize, and manage large-scale data pipelines using Databricks, PySpark, DBT, and AWS S3/Glue/Redshift. - Work in multi-cloud environments including AWS, Azure, and GCP. - Implement workflow orchestration using Airflow or similar frameworks. - Design, implement, and manage data warehouse solutions, schema evolution, and data versioning. - Collaborate with cross-functional teams to deliver high-quality data solutions. Req...

We are seeking a skilled Databricks Developer to join our team on a 4-month contract basis. The ideal candidate will have strong expertise in modern data engineering technologies and the ability to work in a fast-paced, remote environment. Key Responsibilities : - Develop, optimize, and manage large-scale data pipelines using Databricks, PySpark, DBT, and AWS S3/Glue/Redshift. - Work in multi-cloud environments including AWS, Azure, and GCP. - Implement workflow orchestration using Airflow or similar frameworks. - Design, implement, and manage data warehouse solutions, schema evolution, and data versioning. - Collaborate with cross-functional teams to deliver high-quality data solutions. Req...