14 Py Spark Jobs

The ideal candidate will have experience in developing and implementing data integration solutions using Azure Databricks, PySpark, and Azure Data Factory. The role requires strong technical expertise in Azure Cloud, Spark SQL, and ADLS. Location Kochi Responsibilities Design, develop, and implement data integration solutions using Azure Databricks, PySpark, and Azure Data Factory. Collaborate with cross-functional teams to identify business requirements and develop data integration solutions. Develop and maintain high-quality code, ensuring scalability, performance, and reliability. Troubleshoot and resolve technical issues related to data integration and Azure Databricks. Stay up-to-date w...

Role Overview: You will be required to work dedicated shifts between 12 Noon IST to 12 AM IST and should have a minimum of 6 years of experience in the Data Science Domain focused on Analytics and Reporting. Your main responsibilities will include writing, studying, and correcting Python and SQL code, working with Big Data, articulating Value Propositions and Enhancement opportunities, utilizing Visualization Tools like Power BI and Tableau, having exposure to AWS Services, Machine Learning Operations, and Py Spark. Key Responsibilities: - Work dedicated shifts between 12 Noon IST to 12 AM IST - Possess a minimum of 6 years experience in the Data Science Domain - Write, study, and correct Py...

Role Overview: At PwC, the focus in data and analytics is on leveraging data to drive insights and make informed business decisions. As a Data Analyst at PwC, you will utilize advanced analytics techniques to extract insights from large datasets and support clients in solving complex business problems through data-driven decision-making. Your role will involve skills in data manipulation, visualization, and statistical modeling to optimize client operations and strategic goals. Key Responsibilities: - Develop, validate, audit, and maintain AI/ML/NLP models for Fraud/AML/Credit risk - Support financial institutions in meeting regulatory requirements and risk management initiatives - Utilize m...

As a Software Engineer III at JPMorgan Chase within the Corporate Data Services, you will be a crucial part of an agile team that designs and delivers trusted market-leading technology products. Your role involves executing software solutions, design, development, and technical troubleshooting with the ability to think innovatively. You will be accountable for creating secure and high-quality production code, maintaining algorithms, and producing architecture and design artifacts for complex applications. Additionally, you will gather, analyze, and synthesize data sets to drive continuous improvement and contribute to software engineering communities of practice. Key Responsibilities: - Exec...

As an Applications Development Technology Lead Analyst at Citigroup, your role involves establishing and implementing new or revised application systems and programs in coordination with the Technology team. Your main objective is to lead applications systems analysis and programming activities. Key Responsibilities: - Architect Data solutions for Big Data Platform - Provide solutions for business data use cases and convert them into technical implementations - Ensure application design adheres to the overall architecture blueprint - Develop standards for coding, testing, debugging, and implementation - Gain comprehensive knowledge of how different areas of business integrate to achieve busi...

As a Data Science Decision Analyst Assistant Vice President at Barclays, you will embark on a transformative journey to shape the future by providing guidance on coding efficiency and working with Big Data. Your role will involve safeguarding the business and customers from financial risks while also offering competitive benefits and opportunities for career advancement in the banking industry. **Key Responsibilities:** - Ability to work dedicated shifts between 12 Noon IST to 12 AM IST. - Minimum 6 years of experience in Data Science Domain focusing on Analytics and Reporting. - Mandatory proficiency in writing, studying, and correcting Python and SQL code. - Working with Big Data and artic...

Join us as a MI and Reporting Analyst at Barclays, where you will spearhead the evolution of the digital landscape, driving innovation and excellence. You will utilize cutting-edge technology to revolutionize digital offerings, ensuring unparalleled customer experiences. Your responsibilities will include ongoing support and enhancement to Warehouse, Reporting, Information Management, Dashboard Creation, Maintenance, Automation, Data Set Curation, and Data Set Transformation. Given the high exposure to Data, Reporting, Warehouses, and Dashboards, your role will be governed by Service Level Agreements and you will be responsible for adhering to Data Standards and Timelines. You will deliver i...

Job title: Data Engineer ( Python + PySpark + SQL ) Candidate Specification: Minimum 6 to 8 years of experience in Data Engineer Job Description: Data Engineer with strong expertise in Python, PySpark, and SQL Expert in Kafka Design, develop, and maintain robust data pipelines using PySpark and Python Strong understanding of SQL and relational databases (eg, PostgreSQL, MySQL, SQL Server) Proficiency in Python for data engineering tasks and scripting Hands-on experience with PySpark in distributed data processing environments Strong command of SQL for data manipulation and querying large datasets

We are seeking an experienced Data Engineer ;with a strong background in building and managing data solutions. The ideal candidate will have expertise in Power BI, Snowflake, ETL processes,& Data Lakes, and Data Warehouses, along with solid database fundamentals. Knowledge of will be an added advantage. Key Responsibilities Design, develop, and maintain & scalable data pipelines and ETL workflows to support business intelligence and analytics requirements. Manage and optimize Snowflake data warehouse environments, ensuring performance, reliability, and cost efficiency. Implement and maintain data lakes and structured/unstructured data storage solutions. Collaborate with business teams to dev...

Key Responsibilities: Design, build, and maintain scalable data pipelines on Azure cloud. Develop and optimize ETL workflows using Azure Data Factory (ADF). Implement advanced data processing and transformation logic using Databricks and PySpark. Write efficient, scalable, and reusable Python scripts for data ingestion and processing. Manage and optimize complex SQL queries and stored procedures. Integrate data from multiple sources (e.g., APIs, flat files, databases) into centralized repositories. Ensure data quality, security, governance, and compliance best practices. Collaborate with data scientists, analysts, and other stakeholders to support data-driven initiatives. Monitor data workfl...

Urgent Hiring... Microsoft Fabric Cloud Architect 6-8yrs Noida Immediate to 30 days Skills- Azure Cloud, MS Fabric, Py spark, DAX, Python, Azure Synapse, ADF, Data Bricks, MS-Fabric, ETL Pipelines.

Bachelors or master’s degree in computer science, Engineering, or a related field. 10+ years of overall experience and 8+ years of relevant in Data bricks, DLT, Py spark and Data modelling concepts-Dimensional Data Modelling (Star Schema, Snowflake Schema) Proficiency in programming languages such as Python, Py spark, Scala, SQL. Proficiency in DLT Proficiency in SQL Proficiency in Data Modelling concepts - Dimensional Data Modelling (Star Schema, Snowflake Schema) Strong understanding of distributed computing principles and experience with big data technologies such as Apache Spark. Experience with cloud platforms such as AWS, Azure, or GCP, and their associated data services. Proven track ...

Job Purpose: We are seeking an experienced Azure Data Engineer with over 4 to 13 years of proven expertise in Data lakes, Lake house, Synapse Analytic, Data bricks, Tsql, sql server, Synapse Db, Data warehouse and should have work exp in ETL, Data catalogs, Meta data, DWH, mpp systems, OLTP, and OLAP systems with strong communication skills. Requirements: We are seeking an experienced Azure Data Engineer with over 4 to 13 years of proven expertise in Data lakes, Lake house, Synapse Analytic, Data bricks, Tsql, sql server, Synapse Db, Data warehouse and should have work exp in ETL, Data catalogs, Meta data, DWH, mpp systems, OLTP, and OLAP systems with strong communication skills. The ideal c...

Warm Greetings from SP Staffing Services Private Limited!! We have an urgent opening with our CMMI Level 5 client for the below position. Please send your update profile if you are interested. Relevant Experience: 8 Yrs - 18 Yrs Location- Pan India Job Description : - Experience in Synapase with pyspark Knowledge of Big Data pipelinesData Engineering Working Knowledge on MSBI stack on Azure Working Knowledge on Azure Data factory Azure Data Lake and Azure Data lake storage Handson in Visualization like PowerBI Implement endend data pipelines using cosmosAzure Data factory Should have good analytical thinking and Problem solving Good communication and coordination skills Able to work as Indiv...