112 Pyspark Jobs - Page 2

.Responsibilities include translating requirements and data mapping documents into technical designs developing enhancing and maintaining code following best practices and standards supporting regression and system testing efforts debugging and resolving issues found during testing or production communicating status issues and blockers with the project team and supporting continuous improvement by identifying and addressing opportunities. Basic qualifications include a Bachelor’s degree or military experience in a related field preferably computer science with three to five years of ETL development experience in a data warehouse environment deep understanding of enterprise data warehousing b...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. Those in artificial intelligence and machine learning at PwC will focus on developing and implementing advanced AI and ML solutions to drive innovation and enhance business processes. Your work will involve designing and optimising algorithms, mo...

Job requisition ID :: 95693 Date: Feb 3, 2026 Location: Delhi Designation: Senior Consultant Entity: Deloitte Touche Tohmatsu India LLP Your potential, unleashed. India’s impact on the global economy has increased at an exponential rate and Deloitte presents an opportunity to unleash and realize your potential amongst cutting edge leaders, and organizations shaping the future of the region, and indeed, the world beyond. At Deloitte, your whole self to work, every day. Combine that with our drive to propel with purpose and you have the perfect playground to collaborate, innovate, grow, and make an impact that matters. The Team Deloitte’s Technology & Transformation practice can help you uncov...

You will be responsible for analyzing data and creating actionable intelligence for business leaders at Citi. Your key responsibilities will include: - Designing and implementing strategies to improve customer experience and revenue across all stages of the customer lifecycle - Designing, testing, and implementing customer-centric offers to enhance engagement - Designing new products based on customer preferences and usage data, and tracking their performance and profitability - Designing and enhancing P&L forecasting for products and portfolios - Analyzing customer transactions to identify opportunities to meet financial needs and create economic value As a principal Analyst at Citi, you ar...

Role Overview: As an Associate Director - GenAI Architect at EY, you will be responsible for leading and designing advanced AI architectures to drive strategic business outcomes. Your role will involve a deep understanding of data management, application development, AI technologies, cloud solutions, and user interface design. Working closely with cross-functional teams, you will deliver robust and scalable solutions aligned with business objectives. Key Responsibilities: - Architectural Design: Develop and oversee data architectures and application frameworks supporting AI initiatives. Ensure seamless integration of data and applications with existing systems for efficient solutions. - AI S...

As an individual with expertise in Neo4j, your role will involve designing and implementing graph database solutions. This includes creating and maintaining graph schemas, models, and architectures, as well as developing and deploying graph-based solutions using Neo4j. You will be responsible for defining data models, creating nodes, relationships, and properties, and implementing Cypher queries for data retrieval and manipulation. Migrating data from relational or other databases into Neo4j will also be a key aspect of your responsibilities. Additionally, optimizing Cypher queries for performance and integrating Neo4j with BI and other systems will be part of your duties. Key Responsibiliti...

Role Overview: At PwC, as a Senior Associate in data and analytics engineering, you will play a crucial role in designing and developing robust data solutions for clients. Your focus will be on transforming raw data into actionable insights, enabling informed decision-making and driving business growth. You will be part of a vibrant community that leads with trust and creates distinctive outcomes for clients and communities. Your work will be purpose-led, values-driven, and powered by technology, enabling you to make a tangible impact in the real world. Key Responsibilities: - Design and implement scalable data pipelines for batch and near real-time use cases in cloud environments - Write op...

We are hiring for Data Engineer for Hyderabad Location. Please find the below Job Description. Role & responsibilities 6+ years of experience in data engineering, specifically in cloud environments like AWS. Proficiency in Python and PySpark for data processing and transformation tasks. Solid experience with AWS Glue for ETL jobs and managing data workflows. Hands-on experience with AWS Data Pipeline (DPL) for workflow orchestration. Strong experience with AWS services such as S3, Lambda, Redshift, RDS, and EC2. Deep understanding of ETL concepts and best practices.. Strong knowledge of SQL for querying and manipulating relational and semi-structured data. Experience with Data Warehousing an...

Hi, We are hiring for the role of AWS Data Engineer with one of the leading organization for Bangalore & Pune. Experience - 10+ Years Location - Bangalore & Pune Ctc - Best in the industry Job Description Technical Skills PySpark coding skill Proficient in AWS Data Engineering Services Experience in Designing Data Pipeline & Data Lake If interested kindly share your resume at nupur.tyagi@mounttalent.com

Snowflake Data Warehouse Development : Design, implement, and optimize data warehouses on the Snowflake cloud platform. Ensure the effective utilization of Snowflakes features for scalable, efficient, and high-performance data storage and processing. Data Pipeline Development : Develop, implement, and optimize end-to-end data pipelines on the Snowflake platform. Design and maintain ETL workflows to enable seamless data processing across systems. Data Transformation with PySpark : Leverage PySpark for data transformations within the Snowflake environment . Implement complex data cleansing , enrichment , and validation processes using PySpark to ensure the highest data quality. Collaboration :...

Snowflake Data Warehouse Development : Design, implement, and optimize data warehouses on the Snowflake cloud platform. Ensure the effective utilization of Snowflakes features for scalable, efficient, and high-performance data storage and processing. Data Pipeline Development : Develop, implement, and optimize end-to-end data pipelines on the Snowflake platform. Design and maintain ETL workflows to enable seamless data processing across systems. Data Transformation with PySpark : Leverage PySpark for data transformations within the Snowflake environment . Implement complex data cleansing , enrichment , and validation processes using PySpark to ensure the highest data quality. Collaboration :...

Project Manager will be responsible for developing and managing technology initiatives and their cost, time and scope. The primary responsibilities will include: project and task management, financial and resource management and delivery management. Responsibilities: Create & manage project plans for small to medium enhancement/initiatives. Define project schedules, allocate resources and monitor progress. Align project objectives with company goals, and make sure project team is clear on objectives. Deliver and install technology solutions. Tracking and managing financials. Help project team with the design and development tasks. Lead process of issue identification and resolution. Risk man...

About Position: Were looking for an Database Architect to drive the strategy and implementation of a centralized mapping data factory using Databricks as the transformation engine, enabling self-service, governed, and high-fidelity data products across the organization. Role: Databricks Architect Location: Bangalore Experience:10+years Job Type: Full Time Employment What You'll Do: Define and own the Mapping Data Factory” vision: reusable transformation components, mapping DSLs or templates, metadata-driven execution. Build a scalable platform where business-defined mappings can be parameterized and executed in Databricks with minimal engineering friction. Integrate with upstream ingestion s...

Project Manager will be responsible for developing and managing technology initiatives and their cost, time and scope. The primary responsibilities will include: project and task management, financial and resource management and delivery management. Responsibilities: Create & manage project plans for small to medium enhancement/initiatives. Define project schedules, allocate resources and monitor progress. Align project objectives with company goals, and make sure project team is clear on objectives. Deliver and install technology solutions. Tracking and managing financials. Help project team with the design and development tasks. Lead process of issue identification and resolution. Risk man...

As a Senior Azure Synapse Developer at a global enterprise specializing in refrigeration and cold-chain solutions, your role will involve designing and developing Azure Synapse pipelines from scratch, optimizing SQL queries, and building scalable ETL/ELT workflows to support high-quality data integration and reporting. Key Responsibilities: - Design, develop, and optimize Azure Synapse Pipelines and workflows - Build and enhance ETL/ELT processes using Synapse SQL Pool and Spark Pool - Optimize SQL Server queries, procedures, and data warehouse performance - Design and implement dimensional models (Star Schema, SCD Type 1 & 2) - Ensure data quality, performance tuning, and pipeline reliabili...

You are invited to join Citi as an Officer, Big Data Engineer -C10- Hybrid based in Chennai, India. At Citi, we are shaping the future of banking with a focus on innovation and evolution. As part of our global team, you will have access to resources for your well-being and opportunities for personal and professional growth. **Role Overview:** As a Big Data Engineer at Citi, you will be responsible for working on Big data platforms such as Hadoop and Hive. Your role will involve proficiency in programming languages like Python and PySpark, along with SQL for database management. Strong working knowledge of program languages and excellent communication skills are essential for this position. *...

Your role and responsibilities As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform...

Project Manager will be responsible for developing and managing technology initiatives and their cost, time and scope. The primary responsibilities will include: project and task management, financial and resource management and delivery management. Responsibilities: Create & manage project plans for small to medium enhancement/initiatives. Define project schedules, allocate resources and monitor progress. Align project objectives with company goals, and make sure project team is clear on objectives. Deliver and install technology solutions. Tracking and managing financials. Help project team with the design and development tasks. Lead process of issue identification and resolution. Risk man...

Project Role : Custom Software Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : PySpark Good to have skills : NA Minimum 2 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Engineer, your typical day will involve analyzing, designing, coding, and testing various components of application code for multiple clients. You will engage in maintenance and enhancement tasks, ensuring that the applications function optimally and meet client requirements. Collaborat...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics techniques to help clients optimise their operations and achieve their strategic goals. In business intelligence at PwC, you will focus on leveraging data and analytics to provide strategic insights and drive informed decision-making for clients. You will develop and implement innovative solutions to optimise business performance and enhance competitive advantage. Why PWC At PwC, you will be par...

Job Title: Data Engineer AWS + Hadoop Location: Bangalore Experience: 7+ Years About the Role We’re looking for a seasoned Data Engineer with hands-on expertise in AWS data services and the Hadoop ecosystem . You will design, build, and optimize batch/streaming data pipelines, enable reliable data ingestion/processing, and support analytics, ML, and BI use cases at scale. Key Responsibilities Design and implement scalable ETL/ELT pipelines for batch and streaming workloads. Build data ingestion frameworks using Kafka/Kinesis , and process data with Spark (PySpark/Scala). Develop and optimize data lakes and data warehouses on AWS (S3, Glue, EMR, Athena, Redshift). Manage and tune Hadoop ecosy...

Bachelor degree or military experience in related field (preferably computer science). At least 5 years of experience in ETL development within a Data Warehouse. Deep understanding of enterprise data warehousing best practices and standards. Strong experience in software engineering comprising of designing, developing and operating robust and highly-scalable cloud infrastructure services. Strong experience with Python/PySpark, DataStage ETL and SQL development. Proven experience in cloud infrastructure projects with hands on migration expertise on public clouds such as AWS and Azure, preferably Snowflake. Knowledge of Cybersecurity organization practices, operations, risk management processe...

Senior AI/ML Data Developer Primary Skills: AI/ML Snowflake Python PySpark Secondary: dbt Airflow SQL Key Responsibilities Design, develop, and maintain AI/ML-focused data pipelines using Python and PySpark Build scalable data processing and feature engineering pipelines for model training and inference Develop and optimize Snowflake-based data models to support AI/ML workloads and advanced analytics Implement PySpark jobs for large-scale data transformations and ML data preparation Collaborate with data scientists and ML engineers to operationalize AI/ML models Support the ML lifecycle, including data ingestion, feature generation, training, and inference pipelines Optimize performance and ...

Project Role : Data Modeler Project Role Description : Work with key business representatives, data owners, end users, application designers and data architects to model current and new data. Must have skills : PySpark Good to have skills : NAMinimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Modeler, you will engage with key business representatives, data owners, end users, application designers, and data architects to model both current and new data. Your typical day will involve collaborating with various stakeholders to understand their data needs, analyzing existing data structures, and designing effective data model...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : PySpark Good to have skills : Python (Programming Language), Apache Spark, Google BigQueryMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipeline...