Jobs
Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Companies Explore leading companies actively hiring talent

Jobs

Interviews

Home
>
Jobs in pune
>
IBM
>
Data Engineer-Data Platforms-AWS

Data Engineer-Data Platforms-AWS

IBM

4 - 9 years

Pune

Posted:2 weeks ago

Apply

Job Description

Your role and responsibilities

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform

Responsibilities:

Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFS

Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform

Experience in developing streaming pipelines

Experience to work with Hadoop / Azure eco system components to implement scalable solutions to meet the ever-increasing data volumes, using big data/cloud technologies Apache Spark, Kafka, any Cloud computing etc

Required education Bachelor's Degree Required technical and professional expertise

Minimum 4+ years of experience in Big Data technologies with extensive data engineering experience in Spark / Python or Scala;

Minimum 3 years of experience on Cloud Data Platforms on Azure;

Experience in DataBricks / Azure HDInsight / Azure Data Factory, Synapse, SQL Server DB

Good to excellent SQL skills

Exposure to streaming solutions and message brokers like Kafka technologies

Preferred technical and professional experience

Certification in Azure and Data Bricks or Cloudera Spark Certified developers

Skills Required

python big data technologies data engineering sql hadoop hive cloudera scala pyspark microsoft azure azure data factory azure hdinsight azure cloud sql server nosql data bricks apache spark kafka big data aws cloud computing hbase nosql databases

Work Mode

Work from Office

Job Type

Full Time

More Jobs at IBM

Data Scientist-Advanced Analytics

Gurgaon, Haryana, India

Experience: Not specified

Salary: Not disclosed

Package Specialist-Workday Testing

Bengaluru, Karnataka, India

Experience: Not specified

Salary: Not disclosed

System Development Engineer

Bengaluru, Karnataka, India

5.0 - 7.0 yrs

Salary: Not disclosed

Senior Staff System Development Engineer

Bengaluru, Karnataka, India

10.0 - 12.0 yrs

Salary: Not disclosed

Associate Product Manager

Pune, Maharashtra, India

Experience: Not specified

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

IBM

Information Technology

Armonk

Login to

Please Verify Your Phone or Email

Confirm Action

Search

Profile

Upskill and Grow with AI

Data Engineer-Data Platforms-AWS