15802 Pyspark Jobs - Page 4

Job Description Bachelor’s degree with 2-6 years of proven experience in Python Strong programming skills in Python. Hands-on experience with PySpark, Spark SQL, and distributed data processing. Good understanding of ETL processes, data wrangling, and performance tuning in Spark. Experience with SQL, data lakes, and big data tools (e.g., Hadoop, Hive – optional). Familiarity with version control (Git), workflow orchestration tools (e.g., Airflow), and cloud platforms (AWS/GCP/Azure – optional). Strong analytical thinking, problem-solving skills, and ability to work in Agile teams.

Job Title: AWS Senior Data Engineer with Pyspark, AWS, Glue Location: Bhubaneshawar Experience: 6 to 10 Years Notice Period: 30-45 days Job Description: Must: PySpark, AWS[ETL Concepts, S3, Glue, EMR, Redshift, DMS, AppFlow] ,Qlik Replicate, Data Testing Nice To Have: Hadoop, Teradata Background, IaC[Cloud Formation / Terraform], Git Kind Regards, Priyankha M

Job Title: AWS Senior Data Engineer with Pyspark, AWS, Glue Location: Kolkata Experience: 6 to 10 Years Notice Period: 30-45 days Job Description: Must: PySpark, AWS[ETL Concepts, S3, Glue, EMR, Redshift, DMS, AppFlow] ,Qlik Replicate, Data Testing Nice To Have: Hadoop, Teradata Background, IaC[Cloud Formation / Terraform], Git Kind Regards, Priyankha M

Job Title: AWS Senior Data Engineer with Pyspark, AWS, Glue Location: Kochi Experience: 6 to 10 Years Notice Period: 30-45 days Job Description: Must: PySpark, AWS[ETL Concepts, S3, Glue, EMR, Redshift, DMS, AppFlow] ,Qlik Replicate, Data Testing Nice To Have: Hadoop, Teradata Background, IaC[Cloud Formation / Terraform], Git Kind Regards, Priyankha M

As a Java + Bigdata Engineer at Impetus Technologies, you will be part of a dynamic team where you will design, develop, and maintain robust big data applications using Java and related technologies. Your responsibilities will include collaborating with cross-functional teams to gather requirements, translating them into technical specifications, and optimizing application performance and scalability to handle large data sets effectively. You will implement data processing solutions using frameworks such as Apache Hadoop, Apache Spark, or similar tools. Additionally, you will participate in code reviews, debugging, and troubleshooting of applications to ensure high-quality code standards. It...

As a Data OS + Sigma + Power BI expert at LTIMindtree, you will be part of a dynamic team dedicated to providing a top-notch product experience for a global leading manufacturing client. Your primary responsibility will involve implementing best-in-class PIM solutions to ensure rich, relevant, and trusted product information is available across various channels and digital touchpoints. This will empower end customers to make well-informed purchase decisions, making your role impactful and rewarding. **Key Responsibilities:** - Building Data Products using DataOS platform and developing custom accelerators - Designing and implementing BI systems to measure and influence business decisions - C...

The Applications Development Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities. Responsibilities: Utilize knowledge of applications development procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements Identify and analyze issues, make recommendations, and implement solutions Utilize knowledge of business processes, system processes, and industry standard...

As a Senior AI Solutions Engineer in our pioneering AI team, you will architect and deliver next-generation AI-powered systems by leveraging state-of-the-art generative models and computer vision techniques. Your role is instrumental in transforming cutting-edge research into scalable, production-grade solutions driving innovation across multiple domains, including image synthesis, NLP, and automated content generation. **Key Responsibilities:** - Develop, train, and deploy advanced generative AI architectures such as GANs, VAEs, diffusion models, and large language models for diverse applications. - Integrate computer vision algorithms with generative models to enhance capabilities like obj...

As a Data Engineer with 5-9 years of experience, your role will involve the following: - Code migration from SAS/ legacy systems to Python/ cloud-native frameworks. - Develop and optimize enhanced data pipelines using PySpark for efficient cloud-based processing. - Utilize your strong expertise in SAS, Python, and PySpark to handle code migration and data transformation effectively. No additional details about the company are provided in the job description.,

Role Overview: You will be responsible for supporting process delivery by ensuring the daily performance of the Production Specialists, resolving technical escalations, and developing technical capability within the Production Specialists. Key Responsibilities: - Possess expertise in Azure Data Factory as a primary skill and Azure Data bricks Spark (PySpark, SQL) - Must-have skills include being cloud certified in one of the following categories: Azure Data Engineer, Azure Data Factory, Azure Data bricks Spark (PySpark or Scala), SQL, DATA Ingestion, Curation, Semantic Modelling/Optimization of the data model to work within Rahona - Experience in Azure ingestion from on-prem sources such as ...

As a Business Analytics AVP at this company, you play a key role in driving enhancements and projects to create efficiencies through automation and standardization. You integrate subject matter and industry expertise within your defined area, contributing significantly to project size, geography, and more. **Key Responsibilities:** - Manage projects by creating project plans, assigning responsibilities, and identifying data patterns & trends to enhance business decision-making capabilities - Independently manage end-to-end business partner communication and collaborate with different departments to understand reporting needs - Drive automation of existing processes to improve efficiency and ...

🔥 Lead Python Engineer - WFH THIS IS FULLY REMOTE WORKING OPPORTUNITY We someone who can join in less than 1 month. If you are interested and fulfill the below mentioned criteria then please share below information . 1. EMAIL ID 2. Years of relevant experience 3. CCTC/ECTC 4. Notice period 5. Updated resume mentioning all the mentioned skills. Also, experience in financial domain is a huge plus so if you have that experience then mention that as well in the resume Experience Level: 7–12 yrs Location: Remote, any city in India Required Skills ● * Must-Have * : o Python (Pandas, PySpark) o Data engineering & workflow optimization o Delta Tables, Parquet ● * Good-to-Have * : o Databricks o Apac...

**Job Description** As a Data Engineer at Mindcurv, you will play a crucial role in designing sustainable and accountable solutions for the digital world. Your primary responsibilities will include: - Designing, implementing, and maintaining ETL pipelines to prepare data for graph-based structures. - Developing and optimizing graph database solutions using querying languages such as Cypher, SPARQL, or GQL, with a preference for Neo4J DB experience. - Building and maintaining ontologies and knowledge graphs to ensure efficient and scalable data modeling. - Integrating vector databases and implementing similarity search techniques, focusing on Retrieval-Augmented Generation (RAG) methodologies...

Expedia Group brands power global travel for everyone, everywhere. We design cutting-edge tech to make travel smoother and more memorable, and we create groundbreaking solutions for our partners. Our diverse, vibrant, and welcoming community is essential in driving our success. Why Join Us? To shape the future of travel, people must come first. Guided by our Values and Leadership Agreements, we foster an open culture where everyone belongs, differences are celebrated and know that when one of us wins, we all win. We provide a full benefits package, including exciting travel perks, generous time-off, parental leave, a flexible work model (with some pretty cool offices), and career development...

Job Description At RBHU, we are committed to delivering data-driven solutions that empower decision-making. We work at the intersection of Data, AI, and Analytics, helping clients unlock the value of their data. We are now looking for an enthusiastic Data Engineer with hands-on Databricks experience to join our growing team. Key Responsibilities Develop, maintain, and optimize ETL/ELT pipelines using Databricks. Integrate data from multiple sources into scalable and reliable data solutions. Implement data transformations, cleansing, and enrichment processes. Work closely with data analysts, data scientists, and business teams to deliver analytics-ready datasets. Ensure data quality, performa...

As a Senior Data Engineer at Beyond Key, you will play a vital role in designing, developing, and optimizing data solutions that facilitate strategic decision-making. You will leverage your expertise in Power BI, Azure Data Factory (ADF), and SSIS to create scalable data architectures and drive interactive analytics solutions. Your contributions will directly impact the company's ability to deliver cutting-edge services to a diverse range of global clients. **Key Responsibilities:** - Design, develop, and maintain interactive Power BI dashboards & reports with advanced DAX, Power Query, and custom visuals. - Develop and automate ETL/ELT pipelines using Azure Data Factory (ADF) and SSIS. - Ar...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics techniques to help clients optimise their operations and achieve their strategic goals. In business intelligence at PwC, you will focus on leveraging data and analytics to provide strategic insights and drive informed decision-making for clients. You will develop and implement innovative solutions to optimise business performance and enhance competitive advantage. *Why PWC At PwC, you will be pa...

Principal Accountabilities And Responsibilities Responsible for requirements gathering, documentation of solution design, documenting and executing test scenarios and performing a variety of change and implementation management activities. May work across multiple projects and programmes simultaneously May be required to support change management activities spanning from early change planning and audience analysis; through to designing and delivering change interventions (e.g., communications, training, support, organisation alignment); and tracking. Taking actions on change readiness, adoption, and feedback. They are also ultimately responsible for Implementation Management, including plann...

As a Senior Azure Developer at our company, you will be a key player in designing, developing, and implementing robust and scalable data solutions on the Microsoft Azure platform. Your responsibilities will include: - Designing and implementing highly performant data ingestion pipelines from various sources using Azure Databricks, Azure Data Factory, and other Azure services. - Translating complex business requirements into technical specifications and robust data solutions. - Contributing to the architectural design of data platforms and solutions on Azure. You will also be involved in: - Developing, testing, and deploying data transformation and processing jobs primarily using PySpark and ...

The Applications Development Intermediate Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities. Responsibilities: Design, development of BigData applications/ pipelines using Spark, Scala, SQL, Pyspark, Python, Java Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems Appropriately assess risk when business decisions are mad...

Analytics and Information Management (AIM) Citi AIM was established in 2003 and is located across multiple cities in India – Bengaluru, Chennai, Pune and Mumbai. It is a global community that objectively connects and analyzes information, to create actionable intelligence for our business leaders. It identifies fact-based opportunities for revenue growth in partnership with the businesses. The function balances customer needs, business strategy, and profit objectives using best in class and relevant analytic methodologies. What do we do? The North America Consumer bank information management team provides reporting and business Insights support to help the business monitor/size the impact of...

About CITI Citi's mission is to serve as a trusted partner to our clients by responsibly providing financial services that enable growth and economic progress. We have 200 years of experience helping our clients meet the world's toughest challenges and embrace its greatest opportunities. Analytics and Information Management (AIM) Citi AIM was established in 2003 and is located across multiple cities in India – Bengaluru, Chennai, Pune and Mumbai. It is a global community that objectively connects and analyzes information, to create actionable intelligence for our business leaders. It identifies fact-based opportunities for revenue growth in partnership with the businesses. The function balan...

Job Description The Lead Data Engineer is responsible for building Data Engineering Solutions using next generation data techniques. The individual will be working directly with product owners, customers and technologists to deliver data products/solutions in a collaborative and agile environment. Responsibilities: Responsible for design and development of big data solutions. Partner with domain experts, product managers, analyst, and data scientists to develop Big Data pipelines in Hadoop or Snowflake Responsible for delivering data as a service framework Responsible for moving all legacy workloads to cloud platform Work with data scientist to build Client pipelines using heterogeneous sour...

At Citi we’re not just building technology, we’re building the future of banking. Encompassing a broad range of specialties, roles, and cultures, our teams are creating innovations used across the globe. Citi is constantly growing and progressing through our technology, with laser focused on evolving the ways of doing things. As one of the world’s most global banks we’re changing how the world does business. Shape your Career with Citi We’re currently looking for a high caliber professional to join our team as 25900905 Officer, Big Data Engineer -C10- Hybrid based in Chennai, India. Being part of our team means that we’ll provide you with the resources to meet your unique needs, empower you ...

This is a data engineer position - a programmer responsible for the design, development implementation and maintenance of data flow channels and data processing systems that support the collection, storage, batch and real-time processing, and analysis of information in a scalable, repeatable, and secure manner in coordination with the Data & Analytics team. The overall objective is defining optimal solutions to data collection, processing, and warehousing. Must be a Spark Java development expertise in big data processing, Python and Apache spark particularly within banking & finance domain. He/She designs, codes and tests data systems and works on implementing those into the internal infrast...