23086 Pyspark Jobs - Page 22

About the Company Our client is a trusted global innovator of IT and business services, present in 9+ countries. They specialize in digital & IT modernization, consulting, managed services, and industry-specific solutions. With a commitment to long-term success, they empower clients and society to move confidently into the digital future. Position: Data Engineer Experience: 6+ Years Location: Hyderabad Employment Type: Full-time About the Role We are looking for a highly skilled Data Engineer with 6+ years of experience in designing and building scalable data pipelines, big data processing solutions, and cloud-based data platforms. The ideal candidate will have strong expertise in Big Data t...

EY GDS Data and Analytics (D&A) Senior AWS Engineer As part of our EY-GDS D&A (Data and Analytics) team, we help our clients solve complex business challenges with the help of data and technology. We dive deep into data to extract the greatest value and discover opportunities in key business and functions like Banking, Insurance, Manufacturing, Healthcare, Retail, Manufacturing and Auto, Supply Chain, and Finance. The opportunity Were looking for candidates with deep expertise in AWS cloud technologies and data-driven architectures, having a proven track record in designing and delivering large-scale solutions. This is an exciting opportunity to be part of a leading organization and contribu...

Job description Hiring for Hadoop Developer Mandatory Skills: Hadoop, bigdata, spark Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and detailed funct...

Req ID: 335227 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Business Consulting-Technical analyst with ETL,GCP using Pyspark to join our team in Pune, Mahārāshtra (IN-MH), India (IN). You bring systems design experience with the ability to architect and explain complex systems interactions, data flows, common interfaces and APIs. You bring a deep understanding of and experience with software development and programming languages such as Java/Kotlin, and Shell scripting. You have hands-on experience with the follow...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Microsoft Azure Databricks, Microsoft Azure Analytics Services, PySpark Minimum 5 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education Summary: As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your ...

Company Description Aptus Data Labs is a leading Data and AI company specializing in Pharma, Manufacturing & Supply Chain, Banking & FinTech, and Technology domains. We offer innovative analytical solutions and consulting services to help businesses make quick, data-driven decisions essential for growth and sustainability in evolving industries. Leveraging cutting-edge technologies, Data Science, and Decision Science, along with our proprietary "Aptus Accelerators," we enable organizations to identify risks and capitalize on key business opportunities. Our team of experts brings deep domain knowledge and technical expertise to extract valuable insights from complex datasets and drive impactf...

Introduction In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology. Your Role And Responsibilities As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your Primary Responsibilities Include...

Introduction In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology. Your Role And Responsibilities As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your Primary Responsibilities Include...

Key Responsibilities Pipeline Development – Design, build, and deploy robust ETL/ELT pipelines in Databricks (PySpark, SQL, Delta Lake) to ingest, transform, and curate governance and operational metadata from multiple sources landed in Databricks. Granular Data Quality Capture – Implement profiling logic to capture issue-level metadata (source table, column, timestamp, severity, rule type) to support drill-down from dashboards into specific records and enable targeted remediation. Governance Metrics Automation – Develop data pipelines to generate metrics for dashboards covering data quality, lineage, job monitoring, access & permissions, query cost, usage & consumption, retention & lifecycl...

About Position: As a Data Analyst – Reporting & Data Analytics, you will drive insights by analyzing and rationalizing enterprise reports. You'll collaborate with cross-functional teams to understand reporting needs and translate them into technical solutions. Leveraging tools like SQL, PySpark, Power BI, and Databricks, you'll ensure data accuracy and impactful visualizations. Your role bridges business requirements with data engineering to enable informed decision-making. Role: Data Analyst Location: Mumbai Experience: 4 to 7 Years Job Type: Full Time Employment What You'll Do: Develop and optimize SQL and PySpark queries to extract, transform, and analyze data from Databricks and other da...

Greeting from TCS! TCS has been a great pioneer in feeding the fire of young Techies like you. We are a global leader in the technology arena and there’s nothing that can stop us from growing together. Your role is of key importance, as it lays down the foundation for the entire project. Make sure you have a valid EP number before interview. To create an EP Number, please visit https://ibegin.tcs.com/iBegin/register Kindly complete the registration if you have not done it yet. Position: AI/ML Engineer Experience: 5-8 years Location: Hyderabad/Kolkata/Chennai/Pune/Noida/Indore/Gurugram Job Description: Must Have: 4+ years of experience in AI/ML Python , FastAPI, Cloud (GCP), Langchain, LangGr...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and d...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and d...

TCS is Hiring Pyspark Developer For Chennai, Hyderabad, Kolkata location Experience : 6 - 10 years Mode of interview : Virtual Location : Chennai, Hyderabad, Kolkata JOB DESCRIPTION: Must have: Minimum 3 Years of experience in design, development and deployment of big data applications and ETL jobs using PySpark APIs/sparkSQL. Experience in design, build and deployment of Python based applications. Experience in writing complex SQL queries/procedures using Relational databases like SQL Server or Oracle Experience in version control system like Git and CI/CD pipeline is a must. Experience in Delta lake APIs is a plus Experience in Docker and Kubernetes is a plus Knowledge of AWS services like...

Position: Senior Data Engineer – Experience: 6–9 Years Role Summary We are seeking Senior Data Engineer resources to work on the migration of applications from our legacy Cloudera environment to the new Kubernetes-based data platform. The role requires strong hands-on development skills in data engineering, with the ability to deliver high-quality pipelines under guidance from internal leads. Core Technical Skills (Must-Have) 1. Apache Spark (PySpark / Scala) 2. SQL (Spark SQL / Trino / HiveQL) 3. Apache Iceberg 4. Apache Airflow (Orchestration) 5. DBT (Data Build Tool) 6. Kubernetes (SKE / AKS) 7. ADO / CI-CD 8. Linux & Shell Scripting Nice-to-Have (Secondary) Skills 1. Python 2.Grafana / P...

TCS is Hiring Pyspark Developer For Chennai, Hyderabad, Kolkata location Experience : 6 - 10 years Mode of interview : Virtual Location : Chennai, Hyderabad, Kolkata JOB DESCRIPTION: Must have: Minimum 3 Years of experience in design, development and deployment of big data applications and ETL jobs using PySpark APIs/sparkSQL. Experience in design, build and deployment of Python based applications. Experience in writing complex SQL queries/procedures using Relational databases like SQL Server or Oracle Experience in version control system like Git and CI/CD pipeline is a must. Experience in Delta lake APIs is a plus Experience in Docker and Kubernetes is a plus Knowledge of AWS services like...

We are seeking a Senior Subject Matter Expert (SME) in Digital Analytics to lead our Digital Analytics Practice. The ideal candidate will combine deep technical expertise with business acumen to build and scale analytics capabilities, strengthen client partnerships, and drive practice growth. This role requires hands-on proficiency in Google Analytics 4 (GA4), Power BI, Azure Databricks (Python/PySpark, SQL), and GCP BigQuery, along with leadership experience in managing delivery teams, developing frameworks, and supporting account farming in a dynamic retail/e-commerce environment. Responsibilities: Lead the Digital Analytics Practice, delivery standards and innovation roadmap for clients. ...

The ideal candidate will have expertise in SQL, Python and Big Data concepts - Assist in building scalable data pipelines using Python and SQL. - Support data modeling activities for analytics and reporting use cases. - Perform data cleansing, transformation, and validation using PySpark. - Collaborate with data engineers and analysts to ensure high data quality and availability. - Work on Hadoop ecosystem tools to process large datasets. - Contribute to data documentation and maintain version-controlled scripts Job Requirements Should be good in SQL and Analytical thinking with Problem Solving skills. - Strong proficiency in Python for data processing and scripting. - Good knowledge of SQL ...

Job Description: AWS Data Engineer Experience : 5 to 8 years Location : Hyderabad / Kolkata ( Onsite ) Notice Period : Up to 30 days Interview Mode : Virtual Drive Role Overview We are looking for a highly skilled AWS Data Engineer to join our team supporting ACI’s data transformation initiatives. The ideal candidate will have strong experience in AWS services , Python , PySpark , Glue , Lambda , and CI/CD pipelines , with a focus on building scalable and efficient data solutions. Key Responsibilities Design and develop scalable data pipelines using AWS Glue and PySpark. Implement serverless data processing workflows using AWS Lambda and Step Functions. Build and maintain CI/CD pipelines usi...

TCS is Hiring Pyspark Developer For Chennai, Hyderabad, Kolkata location Experience : 6 - 10 years Mode of interview : Virtual Location : Chennai, Hyderabad, Kolkata JOB DESCRIPTION: Must have: Minimum 3 Years of experience in design, development and deployment of big data applications and ETL jobs using PySpark APIs/sparkSQL. Experience in design, build and deployment of Python based applications. Experience in writing complex SQL queries/procedures using Relational databases like SQL Server or Oracle Experience in version control system like Git and CI/CD pipeline is a must. Experience in Delta lake APIs is a plus Experience in Docker and Kubernetes is a plus Knowledge of AWS services like...

We are seeking a skilled Azure Data Engineer with hands-on experience in modern data engineering tools and platforms within the Azure ecosystem . The ideal candidate will have a strong foundation in data integration, transformation, and migration , along with a passion for working on complex data migration projects . Job Title: Azure Data Engineer Location: Remote work Work Timings: 5:00 PM to 2:00 AM IST No of Openings: 2 Please Note: This is a pure Azure-specific role . If your expertise is primarily in AWS or GCP , we kindly request that you do not apply . Roles and responsibilities: Lead the migration of large-scale SQL workloads from on-premise environments to Azure, ensuring high data ...

About the Company Our client is a trusted global innovator of IT and business services, present in 50+ countries. They specialize in digital & IT modernization, consulting, managed services, and industry-specific solutions. With a commitment to long-term success, they empower clients and society to move confidently into the digital future. Position: Data Engineer Experience: 6+ Years Location: Hyderabad Employment Type: Full-time About the Role We are looking for a highly skilled Data Engineer with 6+ years of experience in designing and building scalable data pipelines, big data processing solutions, and cloud-based data platforms. The ideal candidate will have strong expertise in Big Data ...

About the Company Our client is a trusted global innovator of IT and business services, present in 50+ countries. They specialize in digital & IT modernization, consulting, managed services, and industry-specific solutions. With a commitment to long-term success, they empower clients and society to move confidently into the digital future. Position: Data Engineer Experience: 6+ Years Location: Hyderabad Employment Type: Full-time About the Role We are looking for a highly skilled Data Engineer with 6+ years of experience in designing and building scalable data pipelines, big data processing solutions, and cloud-based data platforms. The ideal candidate will have strong expertise in Big Data ...

About the Company Our client is a trusted global innovator of IT and business services, present in 50+ countries. They specialize in digital & IT modernization, consulting, managed services, and industry-specific solutions. With a commitment to long-term success, they empower clients and society to move confidently into the digital future. Position: Data Engineer Experience: 6+ Years Location: Hyderabad Employment Type: Full-time About the Role We are looking for a highly skilled Data Engineer with 6+ years of experience in designing and building scalable data pipelines, big data processing solutions, and cloud-based data platforms. The ideal candidate will have strong expertise in Big Data ...

Position: Senior Data Engineer – AI/ML & Cloud Experience: 7+ Years Location: Remote- India Shift Timing: 11:00 AM – 8:30 PM IST About the Role We are seeking an experienced Senior Data Engineer with a strong background in AI/ML and Cloud to design, build, and optimize data pipelines and intelligent analytics solutions. You will work closely with data scientists, architects, and product teams to operationalize ML models, automate workflows, and deliver scalable, reliable data ecosystems in modern cloud environments. Key Responsibilities Design, develop, and maintain ETL/ELT pipelines for large-scale structured and unstructured datasets. Architect and optimize data lakes, data warehouses, and...