HNM Systems logo

Big Data Engineer

HNM Systems

5 - 10 years

Hyderabad

Posted:5 hours ago

Apply

Job Description

We are looking for Big Data Engineer's

What Youll Do

  • Design and build scalable ETL and data pipelines using Python, Spark, AWS Glue, and Amazon EMR.
  • Develop large-scale S3 data lakes and lakehouse architectures supporting batch and CDC ingestion.
  • Build solutions using Step Functions, Athena, Redshift/Spectrum, Lambda, SQS, SNS, Kinesis, and MSK.
  • Lead technical design, architecture, and code reviews while partnering closely with engineering teams.
  • Drive production readiness across reliability, observability, data quality, performance, and cost optimization.
  • Optimize distributed data workloads operating at multi-terabyte scale.

What We’re Looking For

  • Expert-level

    Python

    and strong

    SQL

    .
  • Deep hands-on experience with

    Apache Spark/PySpark

    , including Spark internals and performance tuning.
  • Strong AWS experience, particularly

    Glue, EMR, S3, and Step Functions

    .
  • Experience with

    Parquet, ORC, Avro, Iceberg, Hudi, and Delta Lake

    .
  • Strong understanding of

    dimensional modeling, lakehouse, and medallion architectures

    .
  • Experience with

    Terraform, AWS CDK, CloudFormation, CI/CD, Git, and Docker

    .
  • Proven ability to deliver and support complex, production-grade data solutions.

Preferred

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • AWS certifications.
  • Experience leading architecture decisions and mentoring engineering teams.

Skills Required

AWS Big Data SCALA Pyspark EMR Linux Shell scripting Scripting

Learn the skills this job asks for

See your skill gap for Data Engineer →

Free courses, interview questions and practice for each skill.

Work Mode

Hybrid

Job Type

Full Time

Mock Interview

Practice Video Interview with JobPe AI

Start Big Data Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
HNM Systems logo
HNM Systems

RecommendedJobs for You

HNM Systems logo

Hyderabad

Ambiquest Hyderabad logo

Big Data Engineer

Ambiquest Hyderabad

Chennai, Bengaluru

dunnhumby logo

Gurugram

HNM Systems logo

Hyderabad

Ambiquest Hyderabad logo

Big Data Engineer

Ambiquest Hyderabad

Chennai, Bengaluru

dunnhumby logo

Gurugram