0 years

8 - 24 Lacs

Posted:5 days ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Big Data Engineer
Industry: IT Services & Consulting — Big Data & Analytics sector. We deliver large-scale data platforms, ETL and streaming solutions to help enterprises operationalize analytics and drive data-led decisions. This on-site role is based in India and seeks hands-on engineers to build, tune and support production-grade data pipelines.Role & Responsibilities
  • Design, build and maintain scalable batch and real-time data pipelines for ingestion, transformation and delivery to data lakes and analytics platforms.
  • Implement ETL/ELT workflows using Spark and Hadoop ecosystems to process structured and unstructured data at scale.
  • Develop and optimise Kafka-based streaming solutions for near real-time event processing and integration with downstream systems.
  • Troubleshoot performance issues, perform query tuning (Hive/Spark SQL), and implement data partitioning/file formats (Parquet/ORC) for cost and latency improvements.
  • Collaborate with data engineers, data scientists and platform teams to define schema, data contracts, and reliable data delivery SLAs.
  • Create operational runbooks, monitoring alerts and CI/CD pipelines to ensure high availability and rapid deployments in on-site environments.

Skills & Qualifications

Must-Have
  • Hadoop
  • Apache Spark
  • Apache Hive
  • Apache Kafka
  • Python
  • SQL

Preferred

  • Apache Airflow
  • Scala
  • AWS EMR
Benefits & Culture Highlights
  • On-site, collaborative engineering environment focused on operational excellence and hands-on ownership.
  • Opportunities for technical growth across data engineering, streaming architectures and cloud migrations.
  • Competitive compensation and clear paths for career progression in a fast-growing analytics practice.
Location: India (On-site). To apply, please submit your resume highlighting relevant Big Data project experience, production deployments and the tools listed above.
Skills: apache spark,hadoop,bid data,sql,apache kafka,python

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You