4 Spark Dataframes Jobs

Setup a job Alert
JobPe aggregates results for easy application access, but you actually apply on the job portal directly.

3.0 - 7.0 years

0 Lacs

maharashtra

On-site

Role Overview: As the Digital Transformation Lead at Godrej Agrovet Limited (GAVL) in Mumbai, you will be instrumental in driving innovation and productivity in the agri-business sector. GAVL is dedicated to improving the livelihood of Indian farmers by creating sustainable solutions that boost crop and livestock yields. With a strong presence in various sectors like Animal Feed, Crop Protection, Oil Palm, Dairy, Poultry, and Processed Foods, GAVL is committed to making a positive impact on the agricultural industry. Key Responsibilities: - Data Cleaning, Preprocessing & Exploration: You will be responsible for preparing and analyzing data, ensuring quality and completeness by handling missi...

Posted 1 week ago

AI Match Score
Apply

5.0 - 10.0 years

5 - 11 Lacs

noida, hyderabad

Work from Office

Job Description: 5+ years of overall IT experience, which includes hands on experience in Big Data technologies. Mandatory - Hands on experience in Python and PySpark. Build pySpark applications using Spark Dataframes in Python . Worked on optimizing spark jobs that processes huge volumes of data. Hands on experience in version control tools like Git . Worked on Amazons Analytics services like Amazon EMR, Amazon Athena, AWS Glue. Worked on Amazons Compute services like Amazon Lambda, Amazon EC2 and Amazon Storage service like S3 and few other services like SNS. Good to have knowledge of data warehousing concepts dimensions, facts, schemas-snowflake, star etc. Have worked with columnar storag...

Posted 1 month ago

AI Match Score
Apply

5.0 - 10.0 years

12 - 18 Lacs

Pune, Bengaluru

Work from Office

Job Description: Designing and implementing highly performant metadata driven data ingestion & transformation pipelines from multiple sources using Databricks and Spark Streaming and Batch processes in Databricks SPARK performance\tuning\optimisation Providing technical guidance for complex geospatial problems and spark dataframes Developing scalable and re-usable frameworks for ingestion and transformation of large data sets Data quality system and process design and implementation. Integrating the end to end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times Working with other members of the pro...

Posted 2 months ago

AI Match Score
Apply

5.0 - 10.0 years

5 - 11 Lacs

noida, hyderabad

Hybrid

Mandatory - Hands on experience in Python and PySpark. Build pySpark applications using Spark Dataframes in Python . Worked on optimizing spark jobs that processes huge volumes of data. Hands on experience in version control tools like Git . Worked on Amazons Analytics services like Amazon EMR, Amazon Athena, AWS Glue. Worked on Amazon’s Compute services like Amazon Lambda, Amazon EC2 and Amazon’s Storage service like S3 and few other services like SNS. Good to have knowledge of datawarehousing concepts – dimensions, facts, schemas- snowflake, star etc. Have worked with columnar storage formats- Parquet,Avro,ORC etc. Well versed with compression techniques – Snappy, Gzip. Good to have knowle...

Posted Date not available

AI Match Score
Apply
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Featured Companies