Big Data Developer

5 years

0 Lacs

Posted:10 hours ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Full Stack Big Data Engineer


Key Responsibilities:

  • Design, build, and optimize

    big data pipelines

    using Scala, PySpark, Spark SQL, Spark Streaming, and Databricks.
  • Develop and maintain

    real-time data processing

    solutions using Kafka Streams or similar event-driven platforms.
  • Implement

    cloud-based solutions

    on Azure, leveraging services such as Azure Data Factory (ADF) and Azure Functions.
  • Build scalable

    microservices

    with Core Java (8+) and Spring Boot.
  • Collaborate on

    system design

    , including API development and event-driven architecture.
  • Contribute to

    front-end development

    (JavaScript, React) as needed.
  • Ensure application reliability through

    monitoring tools

    such as Grafana, New Relic, or similar.
  • Utilize modern

    CI/CD tools

    (Git, Jenkins, Kubernetes, ArgoCD, etc.) for deployment and version control.
  • Work cross-functionally with data engineers, software developers, and architects to deliver high-quality solutions.


Qualifications:

  • 5+ years of professional experience as a Software/Data Engineer or Full Stack Engineer.
  • Strong programming skills in

    Scala, Python, and Java

    .
  • Experience with

    Databricks, Spark SQL, Spark Streaming

    , and

    PySpark

    .
  • Hands-on experience with

    Azure cloud services

    and data engineering tools.
  • Solid knowledge of

    microservices development

    with Spring Boot.
  • Familiarity with

    event-driven platforms

    such as Kafka.
  • Experience with

    CI/CD pipelines

    and containerization/orchestration tools.
  • Strong problem-solving and communication skills.
  • Bachelor’s or master’s degree in computer science, Engineering, or a related field (preferred).


Nice to Have:

  • Experience with

    API design

    and

    event-driven architecture

    .
  • Frontend development experience with

    React and JavaScript

    .

Mock Interview

Practice Video Interview with JobPe AI

Start DevOps Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Java Skills

Practice Java coding challenges to boost your skills

Start Practicing Java Now
BayOne Solutions logo
BayOne Solutions

IT Services and IT Consulting

Pleasanton CA

RecommendedJobs for You

hyderabad, telangana, india