Home
Jobs
IBM logo

Data Engineer-Data Platforms

5 - 10 years

14 - 17 Lacs

Mumbai

Posted:11 hours ago| Platform: Naukri logo

Apply

Skills Required

hive spark hadoop big data hbase scala pyspark apache pig hadoop spark sql java git postgresql devops jenkins data ingestion mysql etl python oracle dynamo db oozie microsoft azure data engineering lambda expressions kafka sqoop aws unix

Work Mode

Work from Office

Job Type

Full Time

Job Description

As a Big Data Engineer, you wi deveop, maintain, evauate, and test big data soutions. You wi be invoved in data engineering activities ike creating pipeines/workfows for Source to Target and impementing soutions that tacke the cients needs. Your primary responsibiities incude: Design, buid, optimize and support new and existing data modes and ETL processes based on our cients business requirements. Buid, depoy and manage data infrastructure that can adequatey hande the needs of a rapidy growing data driven organization. Coordinate data access and security to enabe data scientists and anaysts to easiy access to data whenever they need too. Required education Bacheor's Degree Preferred education Master's Degree Required technica and professiona expertise Must have 5+ years exp in Big Data -Hadoop Spark -Scaa ,Python Hbase, Hive Good to have Aws -S3, athena ,Dynomo DB, Lambda, Jenkins GIT Deveoped Python and pyspark programs for data anaysis. Good working experience with python to deveop Custom Framework for generating of rues (just ike rues engine). Deveoped Python code to gather the data from HBase and designs the soution to impement using Pyspark. Apache Spark DataFrames/RDD's were used to appy business transformations and utiized Hive Context objects to perform read/write operations. Preferred technica and professiona experience Understanding of Devops. Experience in buiding scaabe end-to-end data ingestion and processing soutions Experience with object-oriented and/or functiona programming anguages, such as Python, Java and Scaa

More Jobs at IBM

Delivery Manager - RISK & Compliance - AML

Bengaluru

3 - 5 yrs
|

INR 5 - 7 Lacs

Delivery Manager-HUMAN Resources Operations

Bengaluru

6 - 10 yrs
|

INR 11 - 16 Lacs

Application Developer-Java & Web Technologies

Hyderabad

2 - 5 yrs
|

INR 7 - 11 Lacs

Deputy Manager Data Engineer - Analytics

Bengaluru

4 - 7 yrs
|

INR 10 - 15 Lacs

Data Scientist-Artificial Intelligence

Bengaluru

3 - 7 yrs
|

INR 14 - 18 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Hive Interview Now
IBM
IBM
www.ibm.com

Information Technology

Armonk

350,000 Employees

5547 Jobs

    Key People

  • Arvind Krishna

    Chairman and Chief Executive Officer

  • Ginni Rometty

    Former Chairman, President and CEO

RecommendedJobs for You

IBM logo

Data Engineer-Data Platforms

IBM

Hyderabad

IBM logo

Data Engineer-Data Platforms

IBM

Mumbai

IBM logo

Data Engineer-Data Platforms

IBM

Navi Mumbai

IBM logo

Data Engineer-Data Platforms

IBM

Hyderabad

IBM logo

Data Engineer-Data Platforms

IBM

Mumbai

IBM logo

Data Engineer-Data Platforms

IBM

Bengaluru

IBM logo

Data Engineer-Data Platforms

IBM

Navi Mumbai, Maharashtra, India

IBM logo

Data Engineer-Data Platforms

IBM

Mysore, Karnataka, India

IBM logo

Data Engineer-Data Platforms

IBM

Navi Mumbai, Maharashtra, India

IBM logo

Data Engineer-Data Platforms

IBM

Pune