MLTech Back End Engineer

8 years

0 Lacs

Posted:2 days ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Role Description

This is a full-time on-site role for a Back End Developer, located in Jaipur. We’re hiring a Backend Engineer to build and operate the services that power our ML products. You’ll design event-driven microservices, real-time data pipelines, and low-latency model-serving APIs. You’ll own reliability, performance, and observability, and you’ll partner closely with ML and data teams to ship measurable impact. Our stack includes Kubernetes, Kafka, Postgres/Redis, and model serving with Triton/TorchServe/Ray Serve. You care about clean interfaces, robust testing, and secure, cost-efficient systems.


Core Responsibilities

Service architecture

  • Design REST/gRPC microservices, event-driven workflows, and internal SDKs.
  • Define contracts, schemas, versioning, and backward compatibility.

Model serving & ML infra

  • Package and deploy models (batch + online) via Triton/TorchServe/Ray Serve/FastAPI.
  • Implement feature retrieval, feature stores, and online/offline parity.
  • Add A/B, canary, shadow, traffic mirroring, and model rollback hooks.

Data streaming & queues

  • Build producers/consumers with Kafka/Pulsar/Kinesis or SQS/RabbitMQ.
  • Exactly-once/at-least-once semantics, retries, DLQs, idempotency keys.

Batch & streaming pipelines

  • Orchestrate workflows with Airflow/Argo/Prefect.
  • State management, watermarking, late data handling, compaction.

Performance & reliability

  • Profiling, caching (Redis), rate-limiting, circuit breakers.
  • SLOs/SLIs (latency, p95/p99, availability), autoscaling, capacity planning.

Storage & schemas

  • OLTP (Postgres/MySQL), OLAP (BigQuery/Redshift/Snowflake), object stores.
  • Schema evolution, migrations, CDC, time-series storage.

Security & governance

  • AuthN/Z (OIDC/JWT), secrets management, IAM least privilege.
  • PII handling, audit logs, data retention, encryption in transit/at rest.

Observability

  • Metrics/tracing/logs (Prometheus/OpenTelemetry/Grafana/ELK).
  • Playbooks, runbooks, SRE handoff, on-call rotation readiness.

DevEx & CI/CD

  • Docker/K8s, Helm, GitHub Actions/GitLab CI, artifact registries.
  • Contract tests, e2e tests, load tests, chaos experiments.
  • Collaboration

  • Partner with ML to define interfaces (input validation, schema, SLAs).
  • Work with product to refine requirements; with data eng on pipelines.


Stack

  • Languages:

    Python, Go, or Node.js/TypeScript (pick 1–2 primary)
  • APIs:

    FastAPI/gRPC/Express + OpenAPI/Buf
  • Streaming/Queues:

    Kafka/Pulsar/Kinesis/SQS
  • Serving:

    NVIDIA Triton, TorchServe, Ray Serve, BentoML
  • Orchestration:

    Airflow/Argo/Prefect
  • Stores:

    Postgres, Redis, S3/GCS, feature store (Feast)
  • Infra:

    Docker, Kubernetes, Helm, Terraform
  • Obs:

    Prometheus, Grafana, OpenTelemetry, Loki/ELK


Experience

  • 3–8+ years backend experience designing high-throughput services.
  • Strong with event-driven systems, concurrency, and data modeling.
  • Hands-on with one major queue/stream platform and one SQL DB.
  • Experience packaging and running ML models in production (GPU/CPU).
  • Solid testing discipline (unit, contract, property, and load testing).
  • Vector DBs (FAISS/pgvector/Weaviate), retrieval patterns for RAG.
  • Cost optimization, GPU scheduling, CUDA basics, Triton kernels.
  • Privacy/regulated domains (HIPAA/GxP/PCI), fine-grained access control.

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You