Big Data Engineer

5 - 9 years

5 - 11 Lacs

Posted:17 hours ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

About the Role:

Big Data Engineer

Key Responsibilities:

1. Big Data Pipeline Development

  • Design, develop, and maintain

    end-to-end data pipelines

    for structured and unstructured data.
  • Implement batch and real-time data processing solutions using

    Hadoop, Spark, Kafka

    , and related technologies.
  • Ensure high performance, scalability, and reliability of data processing workflows.

2. Data Integration & Management

  • Collect, clean, transform, and integrate data from multiple sources including databases, APIs, and streaming platforms.
  • Ensure

    data quality, consistency, and integrity

    across systems.
  • Manage storage solutions such as

    data lakes, data warehouses, and cloud storage

    .

3. Collaboration & Support

  • Work with Data Analysts, Data Scientists, and business stakeholders to understand data requirements.
  • Provide datasets and insights for analytics, reporting, and machine learning initiatives.
  • Troubleshoot and resolve data pipeline and system issues.

4. Architecture & Optimization

  • Design and implement efficient

    data storage and retrieval architectures

    .
  • Optimize workflows, queries, and pipelines for performance and cost efficiency.

Preferred Qualifications:

  • Experience in

    real-time data streaming and processing

    .
  • Knowledge of

    data warehousing concepts and tools

    (Redshift, BigQuery, Snowflake).
  • Familiarity with containerization and orchestration tools (Docker, Kubernetes).

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
ti Steps logo
ti Steps

Staffing and Recruiting

Frankfurt Germany

RecommendedJobs for You

hyderabad, chennai, bengaluru

hyderabad, chennai, bengaluru

hyderabad, bengaluru