15802 Pyspark Jobs - Page 2

As an Associate at PwC, you will work as part of a team of problem solvers, helping to solve complex business issues from strategy to execution. Your responsibilities at this management level include but are not limited to: - Use feedback and reflection to develop self-awareness, personal strengths, and address development areas - Be flexible to work in stretch opportunities/assignments - Demonstrate critical thinking and the ability to bring order to unstructured problems - Conduct Ticket Quality and deliverables review, Status Reporting for the project - Adhere to SLAs, have experience in incident management, change management and problem management - Seek and embrace opportunities that pr...

As a Business Analyst in the Global Transformation team, you will be responsible for various key activities across multiple projects and programmes. Your role will involve requirements gathering, solution design documentation, test scenario execution, change management activities, and implementation management. You may work on change planning, audience analysis, change interventions, and implementation readiness to accelerate benefits and minimize risks during deployment. Your responsibilities will also include managing data analysis/migration, process change, and ensuring effective management of internal client expectations. A good understanding of control requirements surrounding data hand...

Role Overview: At PwC, as an Experienced Associate, you will work collaboratively within a team to tackle complex business challenges spanning from strategy to execution. Your responsibilities will include sharing and collaborating effectively with team members, contributing to practice enablement and business development activities, learning new tools and technologies as needed, developing and implementing automation solutions aligned with client requirements, identifying areas for improvement, handling, manipulating, and analyzing data responsibly, staying updated on developments in your area of expertise, communicating clearly both verbally and in written materials, building and maintaini...

As a Palantir Tech Lead located in Hyderabad, you will be responsible for leading data engineering activities on moderate to complex data and analytics-centric problems. Your role will have a broad impact and will require in-depth analysis to achieve desired results. You will be expected to assemble, enhance, maintain, and optimize current data, enabling cost savings and meeting individual project or enterprise maturity objectives. Key Responsibilities: - Demonstrate advanced working knowledge of SQL, Python, and PySpark - Utilize tools like Git/Bitbucket, Jenkins/CodeBuild, and CodePipeline - Have experience with platform monitoring and alerts tools - Collaborate with Subject Matter Experts...

As the Engineering Lead Analyst at our company, you will be responsible for leading various engineering activities to design, acquire, and deploy hardware, software, and network infrastructure in coordination with the Technology team. Your main objective will be to ensure that quality standards are met within the existing and planned framework. **Responsibilities:** - Serve as a technology subject matter expert for internal and external stakeholders - Provide direction for all firm mandated controls and compliance initiatives - Define necessary system enhancements for deploying new products and process enhancements - Recommend product customization for system integration - Identify problem c...

As a part of the KPMG entities in India, you will be contributing to providing rapid, performance-based, industry-focused, and technology-enabled services to national and international clients across various sectors. Leveraging the global network of firms, you will be expected to be conversant with local laws, regulations, markets, and competition in order to deliver high-quality services. KPMG has a wide presence in India with offices located in cities such as Ahmedabad, Bengaluru, Chandigarh, Chennai, Gurugram, Hyderabad, Jaipur, Kochi, Kolkata, Mumbai, Noida, Pune, Vadodara, and Vijayawada. **Key Responsibilities:** - Collaborate with professionals to deliver services to clients in India ...

Role Overview: As a Software Engineer III at JPMorgan Chase within the Corporate Technology, you will be a seasoned member of an agile team responsible for designing and delivering trusted market-leading technology products in a secure, stable, and scalable manner. Your role involves executing software solutions, development, and technical troubleshooting while maintaining high-quality production code and algorithms. You will contribute to the architecture and design of complex applications, ensuring design constraints are met by software code development. Additionally, you will analyze and synthesize data sets to drive continuous improvement of software applications and systems. Your proact...

Technology Lead ETL & Data Engineering (Fandango) Location: Pune / Hybrid Experience: 8 to 12 Years Employment Type: Full-Time Job Summary We are seeking a highly skilled and experienced Technology Lead with 10+ years of expertise in ETL, Data Warehousing, and AWS cloud services. The ideal candidate should have strong hands-on experience with Talend (Data Integration, Big Data, Admin), AWS Glue, PySpark, Airflow (MWAA preferred), and AWS Redshift. You will play a critical role in designing, developing, and leading data integration pipelines, ensuring scalability, performance, and business impact. Key Responsibilities Lead the design, development, and deployment of end-to-end ETL and Data War...

You are invited to join Citi as an Officer, Big Data Developer -C11- Hybrid based in Pune, India. By becoming a part of our team, you will have access to resources tailored to your needs, be empowered to make informed decisions, and manage your financial well-being to plan for your future. **Responsibilities:** - Possess 5 - 9 years of experience in Big Data development, with expertise in Hive & Pyspark development - Demonstrated experience with big data platforms like Hadoop, Hive, or Snowflake for data storage and processing - Strong proficiency in Hive/SQL, PL/SQL - Cloud knowledge (AWS) is a plus - Proficiency in managing cloud-based services - Ability to drive significant culture change...

Data Engineering Manager - Azure & Python Experience: 9 - 15 Years Exp. Salary: Highly Competitive Preferred Notice Period : 30 Days Shift : 10:00 AM to 7:00 PM IST Opportunity Type: Noida (Remote for 6 months, Later Hybrid) Placement Type: Permanent (*Note: This is a requirement for one of Uplers' Clients) Must have skills required : Engineering management, Data Engineering, Azure Data Factory, Python, SQL OR NoSQL OR Azure, Backend OR FullStack Nuaav (One of Uplers' Clients) is Looking for: An Engineering Manager who is passionate about their work, eager to learn and grow, and who is committed to delivering exceptional results. If you are a team player, with a positive attitude and a desir...

As a Data Scientist / MLOps Engineer at our company, you will play a vital role in designing, developing, and deploying scalable machine learning solutions. Your focus will be on operational excellence, data engineering, and GenAI integration. Below are the key responsibilities, qualifications required, and additional details about our company: **Key Responsibilities:** - Build and maintain scalable machine learning pipelines using Python. - Deploy and monitor models using MLFlow and MLOps stacks. - Design and implement data workflows using standard Python libraries such as PySpark. - Utilize standard data science libraries (scikit-learn, pandas, numpy, matplotlib, etc.) for model developmen...

Data Engineering Manager - Azure & Python Experience: 9 - 15 Years Exp. Salary: Highly Competitive Preferred Notice Period : 30 Days Shift : 10:00 AM to 7:00 PM IST Opportunity Type: Noida (Remote for 6 months, Later Hybrid) Placement Type: Permanent (*Note: This is a requirement for one of Uplers' Clients) Must have skills required : Engineering management, Data Engineering, Azure Data Factory, Python, SQL OR NoSQL OR Azure, Backend OR FullStack Nuaav (One of Uplers' Clients) is Looking for: An Engineering Manager who is passionate about their work, eager to learn and grow, and who is committed to delivering exceptional results. If you are a team player, with a positive attitude and a desir...

The Opportunity A data analyst is responsible for organizing data related to sales numbers, market research, logistics, or other behaviors. They utilize technical expertise to ensure data is accurate and high-quality. Data is then analyzed, designed, and presented in a way that assists individuals, businesses, and organizations make better decisions. The Opportunity As a Data Scientist, you will leverage advanced statistical methods and machine learning techniques to analyze complex datasets, generate insights, and solve business problems. You will be responsible for developing and deploying ML models, performing deep-dive analyses, and collaborating with stakeholders to ensure the data stra...

The Opportunity A data analyst is responsible for organizing data related to sales numbers, market research, logistics, or other behaviors. They utilize technical expertise to ensure data is accurate and high-quality. Data is then analyzed, designed, and presented in a way that assists individuals, businesses, and organizations make better decisions. The Opportunity As a Data Scientist, you will leverage advanced statistical methods and machine learning techniques to analyze complex datasets, generate insights, and solve business problems. You will be responsible for developing and deploying ML models, performing deep-dive analyses, and collaborating with stakeholders to ensure the data stra...

Job description: Job Role: AVP, Credit Forecasting & Analytics Experience: 6-13 Years Work Mode :WFH Notice Period : Immediate to 60 days Job Description: Required Skills/Knowledge: Bachelor's degree with quantitative underpinning (i.e., Risk, Accounting, Business, Economics, Finance, Mathematics, Statistics, Engineering) and 5+ years of experience in Risk, Credit, Finance, Accounting, Consumer Lending, or other relevant professional experience Or In lieu of a bachelors degree we need 7+ years of experience in Risk, Credit, Finance, Accounting, Consumer Lending, or other relevant professional experience. 3+ years of experience in performing performance analysis on large and diverse consumer ...

Design and optimize batch ETL pipelines using Python and PySpark, write SQL for data extraction, ensure pipeline performance, collaborate with teams on data needs, and document processes. Experience with Hadoop, Snowflake, or Redshift required.

The Business Analytics Sr Analyst is a seasoned professional role. Applies in-depth disciplinary knowledge, contributing to the development of new techniques and the improvement of processes and work-flow for the area or function. Integrates subject matter and industry expertise within a defined area. Requires in-depth understanding of how areas collectively integrate within the sub-function as well as coordinate and contribute to the objectives of the function and overall business. Evaluates moderately complex and variable issues with substantial potential impact, where development of an approach/taking of an action involves weighing various alternatives and balancing potentially conflictin...

Key Responsibilities Design and implement distributed data pipelines using PySpark and SparkSQL Build LLM-powered applications using LangChain , integrating with vector stores and document loaders Collaborate with ML teams to deploy models and manage embeddings (e.g., FAISS, Chroma) Optimize workflows using Databricks , MLflow , and Unity Catalog. Enable natural language querying over structured data using LangChains SparkSQLToolkit Ensure data quality, lineage, and governance across all systems Required Skills Strong programming skills in Python Hands-on experience with PySpark and distributed data processing Familiarity with LangChain and LLM frameworks (OpenAI, Hugging Face, etc.) Experie...

Job Role: AVP, Credit Forecasting & Analytics Experience: 6-13 Years Work Mode :WFH Notice Period : Immediate to 60 Job Description: Required Skills/Knowledge: Bachelor's degree with quantitative underpinning (i.e., Risk, Accounting, Business, Economics, Finance, Mathematics, Statistics, Engineering) and 5+ years of experience in Risk, Credit, Finance, Accounting, Consumer Lending, or other relevant professional experience Or In lieu of a bachelors degree we need 7+ years of experience in Risk, Credit, Finance, Accounting, Consumer Lending, or other relevant professional experience. 3+ years of experience in performing performance analysis on large and diverse consumer credit portfolios, inc...

Who We Are With Citi’s Analytics & Information Management (AIM) group, you will do meaningful work from Day 1. Our collaborative and respectful culture lets people grow and make a difference in one of the world’s leading Financial Services Organizations. The purpose of the group is to use Citi’s data assets to analyze information and create actionable intelligence for our business leaders. We value what makes you unique so that you have opportunity to shine. You also get the opportunity to work with the best minds and top leaders in the analytics space. What The Role Is The role of Assistant Vice President – Data/Information Mgt Sr Analyst will be part of AIM team based out of Chennai, India...

Required Qualifications 3+ Years professional experience in a data Engineer/analyst role or similar. At least 5+ year of Development experience in ADF V2 . At least 1 years of Experience with Spark (PySpark and other python data libraries), Spark Scala is also fine. At least 1 years of experience in T-SQL, creating complex store procedures, triggers etc. Should have used Azure DevOps extensively as part of projects Should have worked on at least 1 project involving hybrid cloud implementation. Should have worked on Azure Data Bricks, SQL Database, Azure SQL Database, Azure Datawarehouse and should be comfortable with data warehousing concepts. Should have worked on Azure Logic Apps , Azure F...

Description Key Responsibilities Technical Delivery Develop robust ETL/ELT workflows to ingest, transform, and load data into our data warehouse, Azure Synapse Analytics using Informatica Contribute to the data ecosystem by performing exploratory data analysis (EDA) to validate pipeline outputs and ensure data accuracy. Take ownership of data quality by implementing proactive checks and monitoring to maintain data integrity and reliability. Write and optimize complex SQL queries to support the data needs of our analytical and reporting teams. Collaborate with data analysts and business users to understand their requirements and translate them into effective data models. Technical Leadership ...

We are looking for an experienced PySpark AWS Cloud Designer/Developer with a strong background in data integration and ETL. The ideal candidate will have: - Over 5 years’ experience designing and developing ETL integration patterns using Python and Spark. - 3+ years working with PySpark for data processing (Databricks or Apache Spark experience is a plus). - Proven ability to create and maintain data integration pipelines, including migrating data (DB2 to Amazon S3). - Experience handling structured, semi-structured, and unstructured data formats (CSV, XML, HTML, SQL, JSON). - Strong analytical and database skills (complex queries, query optimization, debugging, indexes). - Familiarity with...

Job Description Alimentation Couche-Tard Inc., (ACT) is a global Fortune 200 company. A leader in the convenience store and fuel space with over 17,000 stores in 31 countries, serving more than 6 million customers each day It is an exciting time to be a part of the growing Data Engineering team at Circle K. We are driving a well-supported cloud-first strategy to unlock the power of data across the company and help teams to discover, value and act on insights from data across the globe. With our strong data pipeline, this position will play a key role partnering with our Technical Development stakeholders to enable analytics for long term success. About The Role We are looking for a Data Engi...

Job Description Circle K (Part of Alimentation Couche-Tard group) is a global leader in the convenience store and fuel space, it has a footprint across 31 countries and territories. At the Circle K Business Centre in India, we are #OneTeam using the power of data analytics to drive our decisions and strengthen Circle K’s global capabilities. We make it easy for our customers all over the world – we partner with the business to empower the right decisions and deliver effectively, while rapidly unlocking value for our customers across the enterprise. Our team in India is an integral part of our talent ecosystem that helps advance us on our journey to becoming a data-centric company. The future...