Big Data Developer

Viraaj HR Solutions Private Limited

0 years

10 - 20 Lacs

hyderabad telangana india

Posted:1 day ago| Platform:

Apply

Skills Required

data developer staffing analytics engineering saas etl design spark hadoop logic python sql scalability kafka latency hive monitoring logging testing apache aws deployment troubleshooting tuning model collaborative mentoring stack compensation certification training scala

Work Mode

On-site

Job Type

Full Time

Job Description

About The Opportunity

A staffing and HR services firm focused on placing talent into Enterprise IT, Analytics, and Big Data engineering projects across Banking, Retail, Telecom, and SaaS sectors. We partner with product and services organisations to deliver scalable data platforms, real-time analytics, and high-throughput ETL solutions.We are hiring an on-site Big Data Engineer in India to design, build, and optimise data pipelines and platform components for mission-critical data applications.Role & Responsibilities

Design and implement end-to-end batch and streaming data pipelines using Spark and Hadoop ecosystem components.
Develop ETL jobs and data transformation logic in Python/SQL, ensuring scalability and maintainability.
Integrate and process real-time data streams using Kafka and related ingestion tools; ensure low-latency delivery to downstream systems.
Author Hive queries and optimize performance for large-scale datasets; tune Spark jobs to reduce cost and improve throughput.
Collaborate with data engineers, analysts, and stakeholders to translate business requirements into robust data models and pipelines.
Implement monitoring, logging, and automated testing for data workflows; troubleshoot production issues and perform root-cause analysis.

Skills & Qualifications

Must-Have

Apache Spark
Hadoop HDFS
Apache Hive
Apache Kafka
SQL
Python

Preferred

Scala
Apache Airflow
AWS EMR

Other Qualifications

Bachelor's degree in Computer Science, Engineering, or related field (or equivalent practical experience).
Proven experience delivering on-site in enterprise Big Data environments; familiarity with production deployment practices and CI/CD for data workflows.
Strong troubleshooting mindset with experience in performance tuning and data quality assurance.

Benefits & Culture Highlights

On-site delivery model with high-impact projects for large enterprise clients and opportunities to work end-to-end on data platforms.
Collaborative engineering culture, technical mentoring, and exposure to modern data stack components.
Competitive compensation and opportunities for certification/training in cloud and Big Data technologies.

Keywords: Big Data Engineer, Hadoop, Spark, Kafka, ETL, data pipelines, on-site India, data platform, Python, Hive.
Skills: spark,apache spark,sql,apache kafka,python,scala,big data

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

Viraaj HR Solutions Private Limited

Login to

Please Verify Your Phone or Email

Confirm Action

Big Data Developer