28509 Pyspark Jobs - Page 8

Role: Azure Data Engineer / Lead Location: Only Pune Experience: 6 to 12 years Working Model: Wok From Office (12.30 pm to 9.30 pm) Notice: Immediate Joiners Azure Databricks(ADB) + Pyspark + SQL Job Description: Min 4 years in Azure Databricks on development projects Should be 100% hands on in Pyspark coding Should have strong SQL expertise in writing advanced/complex SQL queries If Interested, please share your profile with MorasaP@Hexaware.Com

Role & responsibilities Expert in the Kafka Config and 7+ Years on Kafka in AWS/GCP Cloud Environment. Strong in Kafka and capacity planning on AWS/GCP. Proven experience in building, managing, upgrading, and scaling them in a 24x7 customer facing Production environments. Experience with handling complex (production and non-production) incidents and resolving them in the shortest time possible. Hands-on with the ability to provide lead and help fellow engineers. Solid experience with IaC (i.e., Terraform & Helm. Optional: Ansible) Self-organized and motivated.

Having 5-7 yrs of strong experience as Azure Data Engineer with DP203 certification, Experience on Azure Data Lake ,Azure SQL Database, Azure Data Bricks with PySpark, Azure Data Factory, Developed and maintained data pipelines using Azure Data Factory and Azure Data bricks, Strong hands Experience with writing complex queries in SQL server also familiar with troubleshooting query performance issues, Experience in developing applications in Python and their libraries, Python coding for creating scripts to extract data, Experience in Agile ceremonies (user story grooming, sprint planning, sprint retrospective), Deep understanding of IAAS, PAAS and SAAS concepts at Azure, Hands-on experience w...

Having 5-7 yrs of strong experience as Azure Data Engineer with DP203 certification, Experience on Azure Data Lake ,Azure SQL Database, Azure Data Bricks with Pyspark, Azure Data Factory, Developed and maintained data pipelines using Azure Data Factory and Azure Databricks, Strong hands Experience with writing complex queries in SQL server also familiar with troubleshooting query performance issues, Experience in developing applications in Python and their libraries, Python coding for creating scripts to extract data, Experience in Agile ceremonies (user story grooming, sprint planning, sprint retrospective), Deep understanding of IAAS, PAAS and SAAS concepts at Azure, Hands-on experience wi...

At Delphi Consulting Pvt. Ltd. , we foster a thriving environment with a hybrid work model that lets you prioritize what matters most. Interviews and onboarding are conducted virtually, reflecting our digital-first mindset . We specialize in Data, Advanced Analytics, AI, Infrastructure, Cloud Security , and Application Modernization , delivering impactful solutions that drive smarter, efficient futures for our clients. About the Role: The Data Engineer will build and maintain data pipelines, storage layers, data products based on the architecture design and meet organizational requirements. This role involves working closely with end client and team consisting of backend engineers, cloud eng...

Looking for Azure Data Engineer with ADF and Python, Pyspark

Hiring for Azure Data Engineer and also the client is looking for Immediate joiners who can join in 30 days.

Role & responsibilities We are looking for Immediate Joiner who can join in 30 Days.

Job Description Data Engineer Core Technical Skills Snowflake & Spark Building and managing scalable data pipelines. Spark-based transformations and ETL workflows. Expertise in PySpark, including optimization techniques and cost management. Snowflake-specific capabilities: o Performance tuning and query optimization. o Partitioning and clustering strategies. o Cost control and resource management. o Advanced features such as Time Travel, Zero-Copy Cloning, and Streams & Tasks for data engineering workflows. Delta Lake concepts (ACID transactions, Z-Ordering, OPTIMIZE, VACUUM) for hybrid architectures. SQL & Relational Databases o Advanced SQL query writing. o PostgreSQL expertise (window fun...

We are seeking an experienced Senior Generative AI Engineer with a strong background in Databricks and data lake architectures.

We are looking for a Senior Python developer to join our team. The ideal candidate will have experience in developing robust applications, collaborating with cross-functional teams, Strong problem-solving skills and a passion for technology are essential. Join us to drive innovative solutions! What your you'll do: Write reusable, testable, and efficient code Design and implement low-latency, highly-available, and performant applications Implement security and data protection Integrate data storage solutions Design and build scalable REST APIs Work with product team to build robust, and easy-to-use features What you'll need: Excellent analytical and problem-solving skills Proven experience in...

Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : Microsoft Azure Data Services Good to have skills : NA Minimum 3 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education , Roles & Responsibilities: -Develop and Optimize Data Pipelines using PySpark and SQL in Databricks to handle large-scale data transformations and batch/streaming workloads. -Design and Implement ETL Processes by leveraging D...

We are looking for highly skilled Data Engineers to join our team for a long-term offshore position. The ideal candidates will have 5+ years of experience in Data Engineering, with a strong focus on Python and programming. The role requires proficiency in leveraging AWS services to build efficient, cost-effective datasets that support Business Reporting and AI/ML Exploration. Candidates must demonstrate the ability to functionally understand the Client Requirements and deliver Optimized Datasets for multiple Downstream Applications. The selected individuals will work under the guidance of an Lead from Onsite and closely with Client Stakeholders to meet business objectives. Key Responsibiliti...

Immediate Opening!! Skills: AWS, Lambda, Spark, Pyspark,Hive,Python Exp: 4+ years Location: Bangalore, Hyderabad, Pune Notice Period: Immediate-30 days Mode: contract

Are you passionate about data and analytics? Do you want to be a part of a team where your expertise will be leveraged to build Valmet’s next generation of data and analytics solutions? If you answered “Yes”, then keep reading as this might be your next career move! We are looking for a development-oriented data engineer to join our team who can write SQL procedures, build pipelines and integrations in Microsoft Fabric and Azure Synapse while turning business needs into robust data products. As member of our team, you will collaborate with different business stakeholders and functions to fulfill their complex data, analytics, and reporting requirements and help build and maintain our global ...

Job Description Join our AWS Data Engineer Walkin drive on 10th Jan'26 Years of Exp : 5-10 Years Primary Skillset: AWS,Python,SQL,Pyspark, Databricks and Data Modelling -Knowledge. Walkin Drive : 10th Jan'26 Time : 10.30 AM-3.00PM Registration Link For Walkin Drive: https://agilisium.zohorecruit.com/jobs/Careers/589705000033514003/Data-Engineer?source=CareerSite Venue: World Trade Center 1st floor of Tower B, 5/142, Rajiv Gandhi Salai, Perungudi, Chennai, Tamil Nadu 600096 Job Description: Proven experience as a Data Engineer (typically 5-10 years, depending on level). Strong hands-on experience with Python for data engineering tasks. Proficiency in SQL (writing complex queries, performance ...

Immediate Joiner Expertise-designing and developing applications using AWS,Python,SQL, ETL Tools, MySQL, Apache Spark, Cassandra, MongoDB Excellent communication and collaboration skills Must have experience with interacting with customers and users

Job Title: Data Engineer (PySpark) ________________________________________ About the Role We are seeking a highly skilled Data Engineer with deep expertise in PySpark and the Cloudera Data Platform (CDP) to join our data engineering team. As a Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines that ensure high data quality and availability across the organization. This role requires a strong background in big data ecosystems, cloud-native tools, and advanced data processing techniques. The ideal candidate has hands-on experience with data ingestion, transformation, and optimization on the Cloudera Data Platform, along with a proven trac...

About The Role Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client que...

About The Role Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client que...

About The Role Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client que...

Role Description Job Description We are looking for a skilled Big Data QA Engineer to join our team and ensure the quality and reliability of our data processing pipelines. This role involves designing and executing both automated and manual tests for batch workflows, validating data integrity across transformation stages, and maintaining a robust Python-based test automation framework. The ideal candidate will have hands-on experience with AWS services, big data formats, and a strong understanding of testing methodologies in a data-centric environment. Preferred Skills and Experience: Design, develop, and execute automated and manual batch test cases for data processing pipelines. Validate ...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. EY-Advisory - Data and Analytics – Senior Full Stack Consultant – BI/ETL & Data Engineer As part of our EY-GDS D&A (Data and Analytics) team, we help our clients solve complex business challenges with the help of data and technology. We dive deep into data to extract the greatest value and discover opportunities in key business and functions like Banking, Insurance, Manufacturing, Healthcare, Retail, Manufacturing and Auto, Supply Chain, and Finance. Roles and Res...

Pyspark , Databricks , Python , SQL + AWS Cloud Strong programming skills in Python, Java, C++, SQL etc. Deep expertise with cloud platforms like AWS, Azure, or GCP. Hands-on experience with Databricks, Snowflake, AWS RDS, Azure SQL, or GCP Cloud SQL, Apache Spark and Apache Airflow. Strong understanding of Lakehouse architecture, Data Mesh principles, data governance frameworks, and modern data pipelines. Proven ability to deliver high-impact, API-first services at scale. Proficiency with tools like Terraform or AWS CloudFormation is critical for managing cloud infrastructure programmatically, ensuring consistency, and enabling automation. Strong problem-solving and analytical thinking skil...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. EY-Advisory - Data and Analytics – Senior Full Stack Consultant – BI/ETL & Data Engineer As part of our EY-GDS D&A (Data and Analytics) team, we help our clients solve complex business challenges with the help of data and technology. We dive deep into data to extract the greatest value and discover opportunities in key business and functions like Banking, Insurance, Manufacturing, Healthcare, Retail, Manufacturing and Auto, Supply Chain, and Finance. Roles and Res...