12 Pyspark Developer Jobs

Roles and Responsibilities Design, develop, test, deploy, and maintain large-scale data processing pipelines using PySpark. Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs. Develop high-quality code in Python using Spark's APIs (e.g., Dataframe, Dataset) and Hive queries. Troubleshoot complex issues related to data processing, query performance, and system errors. Desired Candidate Profile 4-8 years of experience working with PySpark/Hive technologies.

Senior Big Data Engineer / PySpark Developer with deep expertise in distributed computing, PySpark, and Spark performance tuning for both batch and streaming data processing. Hands-on experience with Hive, open table formats such as Iceberg, and workflow orchestration tools like Airflow or Oozie. Strong coding skills adhering to OOP principles, design patterns, and unit testing, along with proficiency in Git/GitHub, are essential. Experience in designing scalable, reusable, and high-performance solutions, preparing High-Level and Low-Level Designs (HLD/LLD), and working closely with stakeholders to convert requirements into actionable user stories. Experience in CI/CD automation, security sc...

Bachelors degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education At least 5 years of experience in Pyspark, Spark with Hadoop distributed frameworks while handling large amount of big data using Spark and Hadoop Ecosystems in Data Pipeline creation , deployment , Maintenance and debugging Experience in scheduling and monitoring Jobs and creating tools for automation At least 4 years of experience with Scala and Python required. Proficient knowledge of SQL with any RDBMS. Strong communication skills (verbal and written) with ability to communicate across teams, internal ...

Summary: As an Application Developer, you will be responsible for designing, building, and configuring applications to meet business process and application requirements using Python. Your typical day will involve working with Oracle Procedural Language Extensions to SQL (PLSQL) and other related technologies to develop and maintain applications. Key Responsibilities Design and implementation of end to end with Python in AWS environment. Develop node.js and python code in AWS environment. Create an inspiring team environment with an open communication culture.(For Leads) Monitor team performance and report on metrics (For leads) Discover training needs and provide coaching (For leads) Archit...

Primary Skills : Pyspark, Spark and proficient in SQL Education :: btech/bca/bsc/mca/mtech/msc Experience : 5+ Yrs

We are looking for a PySpark Developer with expertise in data ingestion, ETL processing, and big data cloud-based solutions . The ideal candidate will have hands-on experience in building scalable data pipelines and optimizing data processing performance . Key Responsibilities: Develop and implement data ingestion pipelines from various sources such as databases, S3, and files . Build and optimize ETL and Data Warehouse transformation processes . Develop enterprise-level Big Data solutions using PySpark, SparkSQL, and related frameworks . Create scalable, reusable, and self-service frameworks for data ingestion and processing . Ensure end-to-end integration of data pipelines , maintaining da...

1 Role- Java Spark Developer 2 Technical Skill Set- Spark / Java Big Data 3 Experience - 6 to 10 yrs 4 Location- Bengaluru, Mumbai, Hyderabad * Must-Have * Spark programming Java / J2EE. Oracle Database, Microservices, Springboot AWS * Good-to-Have * 1 Experience in writing Spark programming for Bigdata Hadoop. 2 Good and hands-on experienced in Java, , Microservices, Springboot ,AWS and Spark programming. 3 Ability to understand and do shell scripting in Unix. 4 Having Java/J2EE experience is a plus along with working in Agile environment. 5

We at Acxiom Technologies are hiring for Pyspark Developer for Mumbai Location Relevant Experience : 1 to 4 Years Location : Mumbai Mode of Work : Work From Office Notice Period : Upto 20 days. Job Description: Proven experience as a Pyspark Developer . Hands-on expertise with AWS Redshift . Strong proficiency in Pyspark , Spark , Python , and Hive . Solid experience with SQL . Excellent communication skills. Benefits of working at Acxiom: - Statutory Benefits - Paid Leaves - Phenomenal Career Growth - Exposure to Banking Domain About Acxiom Technologies: Acxiom Technologies is a leading software solutions services company that provides consulting services to global firms and has established...

Warm Greetings from SP Staffing!! Role: Pyspark Developer Experience Required :4 to 6 yrs Work Location: Hyderabad/Bangalore/Pune/Chennai/Kochi Required Skills, pyspark/python/spark sql/ETL Interested candidates can send resumes to nandhini.spstaffing@gmail.com

Warm Greetings from SP Staffing!! Role :Pyspark Experience Required :4 to 6 yrs Work Location :Pune/Bangalore/Chennai/Hyderabad Required Skills, Pyspark python Interested candidates can send resumes to nandhini.spstaffing@gmail.com

Warm Greetings from SP Staffing!! Role: Pyspark Developer Experience Required :4 to 6 yrs Work Location :Pune/Hyderbad/Chennai/Bangalore Required Skills, Pyspark Python Interested candidates can send resumes to nandhini.spstaffing@gmail.com

Warm Greetings from SP Staffing!! Role: Pyspark Developer Experience Required :5 to 8 yrs Work Location :Bangalore Required Skills, Pyspark/SQL Interested candidates can send resumes to nandhini.s@spstaffing.in