Data Engineer

8 years

0 Lacs

Posted:3 weeks ago| Platform: Linkedin logo

Apply

Work Mode

Remote

Job Type

Full Time

Job Description

Job Title: Data Engineer

Location:

Position Type:

Department:

Work Hours:

Position Overview

Data Engineers

data engineering, software design, and cloud technologies

Key Responsibilities

  • Design, build, test, and deploy

    scalable and reusable systems

    for large-scale data processing
  • Manage and optimize

    data and compute environments

    for efficient use of assets
  • Lead a small team of developers, conduct

    code reviews

    , and mentor junior engineers
  • Collaborate with cross-functional teams to

    integrate data solutions

    into broader applications
  • Stay current with emerging technologies and

    foster continuous learning

    within the team

Required Skills & Experience

  • 8+ years of hands-on experience with

    Linux, Bash, Python, and SQL

  • 4+ years of experience with

    Apache Spark

    and the Hadoop ecosystem
  • 4+ years of experience with

    AWS cloud services

    (EMR, Glue, Athena, Redshift)
  • Proven expertise in designing and managing

    data flows and APIs

    for integration
  • 4+ years of

    team leadership experience

    (mentoring, reviews, delivery oversight)
  • Strong problem-solving mindset with a passion for building

    innovative, real-world solutions

Preferred Qualifications

  • BS/MS/PhD in

    Computer Science, Engineering

    , or equivalent practical experience
  • Strong programming background in

    Python, C++

    , or similar languages
  • Experience working with

    petabyte-scale data infrastructure

  • Deep understanding of:
  • Data organization

    (partitioning, clustering, file sizes, formats)
  • Data cataloging

    (Hive, Hive Metastore, AWS Glue, etc.)
  • Experience with

    relational databases

    and SQL optimization
  • Proficiency in modern data stack tools (e.g.,

    dbt, Airbyte

    )
  • Experience building

    scalable data pipelines

    (Airflow is a plus)
  • Strong exposure to

    AWS and/or GCP ecosystems

  • Track record of independently leading projects

    from concept to launch

Why Join Us?

  • Opportunity to

    lead impactful projects

    in a dynamic engineering environment
  • Work with

    cutting-edge technologies

    in cloud and big data
  • Collaborate with a talented, globally distributed team
  • Play a strategic role in shaping the

    future of data-driven products

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You

hyderabad, bangalore rural, bengaluru