Senior Data Engineer

7 years

0 Lacs

Posted:4 days ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Job Title:

Location:

Experience

Salary Range:


About the Role

Big Data Engineer


Key Responsibilities

  • Design, build, and maintain robust data pipelines (batch and streaming) from diverse data sources.
  • Ensure high data quality, reliability, and availability throughout the pipeline lifecycle.
  • Collaborate with cross-functional teams to define technical strategy and deliver data-driven solutions.
  • Participate in code reviews, testing, and deployment to uphold engineering best practices.
  • Own and manage smaller components of the data platform with end-to-end responsibility.
  • Identify and resolve performance bottlenecks to optimize data pipelines.
  • Proactively explore and adopt new technologies, contributing as a senior individual contributor across multiple products and features.


Required Qualifications

  • 5–7 years of experience in Big Data or Data Engineering roles.
  • Strong programming skills in

    Java or Scala

    (Python acceptable with solid Big Data experience).
  • Hands-on experience with distributed processing and streaming frameworks such as

    Apache Spark, Kafka, Flink

    .
  • Experience with orchestration tools like

    Airflow

    (or equivalent).
  • Familiarity with cloud platforms (

    AWS, GCP, Azure

    ) and services such as

    S3, Glue, BigQuery, EMR

    .
  • Solid understanding of data structures, algorithms, and object-oriented programming.
  • Proven ability to write clean, efficient, and maintainable code.


Tooling & Ecosystem

  • Proficiency with version control (e.g., Git) and CI/CD tools.
  • Experience with data orchestration frameworks (Airflow, Dagster, etc.).
  • Understanding of common file formats:

    Parquet, Avro, ORC, JSON

    .
  • Basic exposure to containerization (

    Docker

    ) and infrastructure-as-code (

    Terraform

    a plus).

Mock Interview

Practice Video Interview with JobPe AI

Start Java Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Java Skills

Practice Java coding challenges to boost your skills

Start Practicing Java Now
Hireologist logo
Hireologist

Human Resources Technology

San Francisco

RecommendedJobs for You