Home
Jobs
IBM logo

Data Engineer-Data Platforms

5 - 10 years

14 - 17 Lacs

Pune

Posted:9 hours ago| Platform: Naukri logo

Apply

Skills Required

scala hadoop spark spark big data python hive cloudera pyspark sql java git postgresql devops jenkins data ingestion mysql hadoop etl hbase data analysis dynamo db oozie microsoft azure impala data engineering lambda expressions kafka sqoop aws

Work Mode

Work from Office

Job Type

Full Time

Job Description


  • As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs.

    • Your primary responsibilities include:
  • Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements.
  • Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization.
  • Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too.

    • Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise
  • Must have 5+ years exp in Big Data -Hadoop Spark -Scala ,Python
  • Hbase, Hive Good to have Aws -S3,
  • athena ,Dynomo DB, Lambda, Jenkins GIT
  • Developed Python and pyspark programs for data analysis.
  • Good working experience with python to develop Custom Framework for generating of rules (just like rules engine).
  • Developed Python code to gather the data from HBase and designs the solution to implement using Pyspark. Apache Spark DataFrames/RDD's were used to apply business transformations and utilized Hive Context objects to perform read/write operations.

    • Preferred technical and professional experience
  • Understanding of Devops.
  • Experience in building scalable end-to-end data ingestion and processing solutions
  • Experience with object-oriented and/or functional programming languages, such as Python, Java and Scala

    • More Jobs at IBM

    Delivery Manager - RISK & Compliance - AML

    Bengaluru

    3 - 5 yrs
    |

    INR 5 - 7 Lacs

    Delivery Manager-HUMAN Resources Operations

    Bengaluru

    6 - 10 yrs
    |

    INR 11 - 16 Lacs

    Application Developer-Java & Web Technologies

    Hyderabad

    2 - 5 yrs
    |

    INR 7 - 11 Lacs

    Deputy Manager Data Engineer - Analytics

    Bengaluru

    4 - 7 yrs
    |

    INR 10 - 15 Lacs

    Data Scientist-Artificial Intelligence

    Bengaluru

    3 - 7 yrs
    |

    INR 14 - 18 Lacs

    Mock Interview

    Practice Video Interview with JobPe AI

    Start Scala Interview Now
    cta

    Start Your Job Search Today

    Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

    Job Application AI Bot

    Job Application AI Bot

    Apply to 20+ Portals in one click

    Download Now

    Download the Mobile App

    Instantly access job listings, apply easily, and track applications.

    Google Play App Store
    coding practice

    Enhance Your Python Skills

    Practice Python coding challenges to boost your skills

    Start Practicing Python Now
    IBM
    IBM

    Information Technology

    Armonk

    350,000 Employees

    6284 Jobs

      Key People

    • Arvind Krishna

      Chairman and Chief Executive Officer

    • Ginni Rometty

      Former Chairman, President and CEO

    RecommendedJobs for You

    IBM logo

    Data Engineer-Data Platforms

    IBM

    Pune

    IBM logo

    Data Engineer-Data Platforms

    IBM

    Mumbai

    IBM logo

    Data Engineer-Data Platforms

    IBM

    Navi Mumbai

    IBM logo

    Data Engineer-Data Platforms

    IBM

    Mumbai, Maharashtra, India

    IBM logo

    Data Engineer-Data Platforms

    IBM

    Bengaluru, Karnataka, India

    IBM logo

    Data Engineer-Data Platforms

    IBM

    Navi Mumbai, Maharashtra, India

    IBM logo

    Data Engineer-Data Platforms

    IBM

    Navi Mumbai, Maharashtra, India

    IBM logo

    Data Engineer-Data Platforms

    IBM

    Hyderabad

    IBM logo

    Data Engineer-Data Platforms

    IBM

    Mumbai

    IBM logo

    Data Engineer-Data Platforms

    IBM

    Navi Mumbai