Databricks

Elfonze Technologies

2 - 5 years

7 - 12 Lacs

bengaluru karnataka india

Posted:12 hours ago| Platform: Foundit logo

Apply

Skills Required

data pipelines

Work Mode

On-site

Job Type

Full Time

Job Description

Roles & Responsibilities:

Develop and maintain data pipelines and workflows using PySpark on Databricks
Write Python scripts for data processing, transformation, and integration with Spark
Utilize PySpark and related libraries (e.g., pyspark-ai) to incorporate AI and machine learning functionalities into Spark workflows
Perform data analysis, transformations, and aggregations on large datasets
Deploy and optimize machine learning models within the Databricks environment
Collaborate with data engineers, data scientists, and business teams to understand requirements and deliver solutions
Use the Databricks platform to manage, monitor, and optimize Spark jobs and workflows
Work with the English SDK for Apache Spark to facilitate natural language interactions with Spark DataFrames
Ensure code quality, performance, and scalability of data pipelines and Spark jobs.

More Jobs at Elfonze Technologies

TypeScript Developer

Bengaluru

2 - 5 yrs

INR 3 - 7 Lacs

RUST Developer

Bengaluru

3 - 7 yrs

INR 3 - 6 Lacs

Product Engineer   - II / Product Engineer   - III

Trivandrum, Kerala, India

3 - 10 yrs

Salary: Not disclosed

Product Engineer -II Fullstack

Thiruvananthapuram

3 - 6 yrs

INR 5 - 8 Lacs

Sr. Talent Acquisition Specialist

Thiruvananthapuram

8 - 10 yrs

INR 25 - 30 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.