15896 Pyspark Jobs - Page 9

Job Summary: We are seeking a skilled and experienced Data Engineer to join our team. The ideal candidate will have expertise in Snowflake or Big Data platforms and a strong background in RDBMS skills like Oracle PL/SQL . You will be responsible for designing, developing, and maintaining data pipelines, ensuring data quality, and optimizing database and data platform performance. This role requires a deep understanding of modern data engineering workflows, ETL processes, and database systems. Key Responsibilities: Data Engineering : Design, develop, and maintain scalable and efficient data pipelines to support business needs. Implement ETL/ELT processes to extract, transform, and load data f...

The Applications Development Senior Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities. Responsibilities: Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas Monitor and control all phases of development pr...

Role Overview: We are looking for a Big Data Engineer with expertise in PySpark and Apache Iceberg to design and implement scalable data pipelines. The candidate will work on processing large datasets, optimizing data workflows, and ensuring data quality and reliability. Key Responsibilities: Design, develop, and maintain big data pipelines using PySpark and Apache Iceberg. Optimize data workflows for performance and scalability. Implement data transformation, cleansing, and enrichment processes. Collaborate with data scientists and analysts to deliver actionable insights. Ensure data quality, consistency, and security across all pipelines. Monitor and troubleshoot data pipeline issues in pr...

About CITI Citi's mission is to serve as a trusted partner to our clients by responsibly providing financial services that enable growth and economic progress. We have 200 years of experience helping our clients meet the world's toughest challenges and embrace its greatest opportunities. Analytics and Information Management (AIM) Citi AIM was established in 2003, and is located across multiple cities in India – Bengaluru, Chennai, Pune and Mumbai. It is a global community that objectively connects and analyzes information, to create actionable intelligence for our business leaders. It identifies fact-based opportunities for revenue growth in partnership with the businesses. The function bala...

Job Description The Data/Information Mgt Sr Anlst is a seasoned professional role. Applies in-depth disciplinary knowledge, contributing to the development of new techniques and the improvement of processes and work-flow for the area or function. Integrates subject matter and industry expertise within a defined area. Requires in-depth understanding of how areas collectively integrate within the sub-function as well as coordinate and contribute to the objectives of the function and overall business. Evaluates moderately complex and variable issues with substantial potential impact, where development of an approach/taking of an action involves weighing various alternatives and balancing potent...

Data Engineer – Big Data Platforms Job Summary: We are seeking a skilled and experienced Data Engineer to join our team. The ideal candidate will have expertise in Big Data platforms and a strong background in designing, developing, and maintaining data pipelines. You will be responsible for ensuring data quality, optimizing data workflows, and working with distributed data systems. This role requires a deep understanding of modern data engineering workflows, ETL processes, and large-scale data processing. Key Responsibilities: Data Engineering : Design, develop, and maintain scalable and efficient data pipelines to support business needs. Implement ETL/ELT processes to extract, transform, a...

At Citi we’re not just building technology, we’re building the future of banking. Encompassing a broad range of specialties, roles, and cultures, our teams are creating innovations used across the globe. Citi is constantly growing and progressing through our technology, with laser focused on evolving the ways of doing things. As one of the world’s most global banks we’re changing how the world does business Shape your Career with Citi We’re currently looking for a high caliber professional to join our team as 25907705 Officer, Big Data developer -C11- Hybrid based in Pune , India. Being part of our team means that we’ll provide you with the resources to meet your unique needs, empower you to...

Job Summary: We are seeking a skilled and experienced Data Engineer to join our team. The ideal candidate will have expertise in Big Data platforms and a strong background in designing, developing, and maintaining data pipelines. You will be responsible for ensuring data quality, optimizing data workflows, and working with distributed data systems. This role requires a deep understanding of modern data engineering workflows, ETL processes, and large-scale data processing Key Responsibilities: Data Engineering : Design, develop, and maintain scalable and efficient data pipelines to support business needs. Implement ETL/ELT processes to extract, transform, and load data from various sources in...

Overview Data Ops Capability Deployment - Analyst is a seasoned professional role. Applies in-depth disciplinary knowledge, contributing to the development of new solutions/frameworks/techniques and the improvement of processes and workflow for Enterprise Data function. Integrates subject matter and industry expertise within a defined area. Requires in-depth understanding of how areas collectively integrate within the sub-function as well as coordinate and contribute to the objectives of the function and overall business. The primary purpose of this role is to perform data analytics and data analysis across different asset classes, and to build data science/Tooling capabilities within the te...

Senior Full Stack Data Engineer (Java, Python, React, SQL, Rest APIs) – Assistant Vice President - C12 – Pune Do you thrive on solving complex problems and building full-stack solutions that make an impact? Ready to influence big tech decisions and help shape the technology strategy of a global bank?" The Chief Technology Office (CTO) is building out its Technology Strategy practice, which is responsible to develop and maintain Citi’s Technology Strategy in support of firm’s Businesses and Functions. As part of the Technology Strategy Team, the candidate will be joining an existing global team of technology strategy analysts, project/product managers and engineers. The role is hands-on devel...

The Applications Development Senior Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities. Responsibilities: Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas Monitor and control all phases of development pr...

As a Senior Data Engineer, you will be responsible for designing and optimizing large-scale data pipelines using Databricks and the AWS ecosystem. Your expertise in Databricks and AWS with a minimum of 7 years of experience is mandatory for this role. Key Responsibilities: - Designing and optimizing large-scale data pipelines using Databricks and AWS technologies - Working with Databricks tools such as PySpark, Delta Lake, and MLflow - Utilizing AWS services including Glue, S3, Lambda, Redshift, and EMR - Developing and maintaining Data Lake, ETL pipelines, CI/CD processes - Proficiency in Python and SQL for data processing and analysis Qualifications Required: - Minimum 7 years of experienc...

JOB_POSTING-3-74707-3 Job Description: Role Title: AVP, Credit Forecasting & Analytics (L11) Company Overview: Synchrony (NYSE: SYF) is a premier consumer financial services company delivering one of the industry’s most complete digitally enabled product suites. Our experience, expertise and scale encompass a broad spectrum of industries including digital, health and wellness, retail, telecommunications, home, auto, outdoors, pet and more. We have recently been ranked #2 among India’s Best Companies to Work for by Great Place to Work. We were among the Top 50 India’s Best Workplaces in Building a Culture of Innovation by All by GPTW and Top 25 among Best Workplaces in BFSI by GPTW. We have a...

Hiring: Azure Data Engineers (Contract Role) Location: Bangalore / Kochi / Gurugram (Hybrid) Contract Duration: 6 to 12 Months (Based on Project Requirements) Open Positions: 2 Job Title: Developer / Sr. Azure Data Engineer Interview Rounds: 23 (Based on Managers Evaluation) Primary Skillset (Mandatory): Azure Databricks Azure Data Factory (ADF) PySpark Advanced SQL Role: Sr. Azure Data Engineer Key Responsibilities: Design, develop, and optimize scalable data pipelines using ADF and PySpark Build and maintain robust ETL/ELT workflows across structured and semi-structured data sources Write efficient, production-grade SQL queries for data transformation, validation, and reporting Collaborate...

JOB_POSTING-3-74707-1 Job Description: Role Title: AVP, Credit Forecasting & Analytics (L11) Company Overview: Synchrony (NYSE: SYF) is a premier consumer financial services company delivering one of the industry’s most complete digitally enabled product suites. Our experience, expertise and scale encompass a broad spectrum of industries including digital, health and wellness, retail, telecommunications, home, auto, outdoors, pet and more. We have recently been ranked #2 among India’s Best Companies to Work for by Great Place to Work. We were among the Top 50 India’s Best Workplaces in Building a Culture of Innovation by All by GPTW and Top 25 among Best Workplaces in BFSI by GPTW. We have a...

JOB_POSTING-3-74707 Job Description: Role Title: AVP, Credit Forecasting & Analytics (L11) Company Overview: Synchrony (NYSE: SYF) is a premier consumer financial services company delivering one of the industry’s most complete digitally enabled product suites. Our experience, expertise and scale encompass a broad spectrum of industries including digital, health and wellness, retail, telecommunications, home, auto, outdoors, pet and more. We have recently been ranked #2 among India’s Best Companies to Work for by Great Place to Work. We were among the Top 50 India’s Best Workplaces in Building a Culture of Innovation by All by GPTW and Top 25 among Best Workplaces in BFSI by GPTW. We have als...

Job Description Some careers shine brighter than others. If you’re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further. HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions. Role - Associate Director, Tech SME In this role, you w...

JOB_POSTING-3-74707-5 Job Description: Role Title: AVP, Credit Forecasting & Analytics (L11) Company Overview: Synchrony (NYSE: SYF) is a premier consumer financial services company delivering one of the industry’s most complete digitally enabled product suites. Our experience, expertise and scale encompass a broad spectrum of industries including digital, health and wellness, retail, telecommunications, home, auto, outdoors, pet and more. We have recently been ranked #2 among India’s Best Companies to Work for by Great Place to Work. We were among the Top 50 India’s Best Workplaces in Building a Culture of Innovation by All by GPTW and Top 25 among Best Workplaces in BFSI by GPTW. We have a...

Job Summary We are seeking a skilled Data Engineer to design, develop, and optimize data pipelines and data warehouse solutions. The ideal candidate will have hands-on expertise in ETL development, Databricks, Python, PySpark, SQL, and AWS . This role involves working closely with business stakeholders to gather requirements, build scalable data solutions, perform data exploration, and ensure high-quality data delivery through proper testing and documentation. Key Responsibilities Design, develop, and maintain ETL pipelines for structured and unstructured data. Work extensively with Databricks, PySpark, Python, and SQL for data integration, transformation, and processing. Build and optimize ...

Experience on Python, Python ML packages, TensorFlow, PyTorch. -Experience on Python, Flask, TensorFlow, PyTorch, SQL, NOSQL, Vector -Understanding of data structures, data modelling and data pipeline design in PySpark, Apache Airflow preferable A day in the life of an Infoscion As part of the Infosys delivery team, your primary role would be to ensure effective Design, Development, Validation and Support activities, to assure that our clients are satisfied with the high levels of service in the technology domain. You will gather the requirements and specifications to understand the client requirements in a detailed manner and translate the same into system requirements. You will play a key ...

• Minimum 5 years + working exp as Databricks Developer • Minimum 3 years + working exp on Redshift, Python, PySpark, and AWS • Associate should hold Databrick Certification and willing to join within 30 Days

Job role & responsibilities:- Understanding operational needs by collaborating with specialized teams Supporting key business operations. This involves architecture designing, building and deploying data systems, pipelines etc Build and support scalable and cost efficiency solution using multiple data services. Support on analysing data pipelines utilizing Azure data stack capabilities Close coordination with Command Centre which performs BAU monitoring and L1 Support Deep dive of failed pipelines to formulate root cause analysis, L2/L3 support Coordinate with Development team on analysis of incidents Technical skills, Qualification and experience required:- 5-7 years of experience in Azure ...

Roles and Responsibilities Design, develop, test, deploy, and maintain big data solutions using Spark (Scala) on Hadoop ecosystem. Collaborate with cross-functional teams to identify business requirements and design scalable data pipelines. Develop high-quality code that meets performance, security, and reliability standards. Troubleshoot complex issues related to big data processing and provide timely resolutions. Stay up-to-date with industry trends and best practices in big data technologies. Desired Candidate Profile 3+ years of experience in working with Spark (Scala) development. Strong understanding of Python programming language and its applications in big data processing. Experience...

Job Description Manager, Data Engineer The Opportunity Based in Hyderabad, join a global healthcare biopharma company and be part of a 130-year legacy of success backed by ethical integrity, forward momentum, and an inspiring mission to achieve new milestones in global healthcare. Be part of an organisation driven by digital technology and data-backed approaches that support a diversified portfolio of prescription medicines, vaccines, and animal health products. Drive innovation and execution excellence. Join a team that is passionate about using data, analytics, and insights to drive decision-making and create custom software, allowing us to tackle some of the world's greatest health threat...

Role: Lead Data Engineer Location: kochi/Trivandrum/ Remote Experience: 7+ years Skill Set: S3, GLue, Lambda, Step function, snowflake, pyspark Budget: Max 25lpa The work location will be Kochi or Trivandrum . Candidates are required to attend the final round of the interview in person . In exceptional cases, a remote interview can be considered; however, the selected candidate must work from the office during the first month. Job Overview We are seeking an experienced Senior Data Engineer to lead the development of a scalable data ingestion framework while ensuring high data quality and validation. The successful candidate will also be responsible for designing and implementing robust APIs ...