Senior Software Engineer Cloud & Edge Inference

10 - 15 years

16 - 20 Lacs

Posted:3 hours ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

As a Senior Software Engineer Cloud & Edge Inference (NVIDIA Jetson), you will design and implement a unified Docker-based deployment pipeline for cloud and edge environments. You will optimize real-time inference services for GenAI models (LLMs and beyond) running on NVIDIA Jetson devices, while collaborating with AI/ML teams to enable scalable hybrid deployments. This role combines cloud orchestration expertise with edge performance optimization, making it critical to our AI-driven solutions strategy.

Key Responsibilities:

  • Design & implement a Docker-based deployment pipeline for seamless cloud and edge integration.
  • Optimize and adapt Python/FastAPI inference services for real-time GenAI performance on edge devices.
  • Build & maintain Kubernetes deployments for hybrid workloads (cloud + NVIDIA Jetson).
  • Collaborate with AI/ML teams to integrate and deploy inference models to edge environments.
  • Troubleshoot, optimize, and stabilize inference workloads under constrained edge hardware conditions.

Skills & Qualifications:

  • 10+ years of professional software engineering experience.
  • Strong proficiency in Python (FastAPI experience preferred).
  • Proven expertise with Kubernetes and container orchestration at scale.
  • Hands-on experience with real-time AI inference on embedded GPUs (NVIDIA Jetson or similar).
  • Solid knowledge of performance optimization and resource constraints in edge environments.
  • Strong problem-solving ability and collaborative mindset across AI/ML and infrastructure teams.

Preferred Qualifications:

  • Experience with GPU acceleration frameworks (CUDA, TensorRT).
  • Familiarity with CI/CD pipelines for containerized deployments.
  • Knowledge of network optimization for cloud-to-edge communication.
  • Background in distributed systems and scalable architectures.
  • Mock Interview

    Practice Video Interview with JobPe AI

    Start Digital Marketing Interview
    cta

    Start Your Job Search Today

    Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

    Job Application AI Bot

    Job Application AI Bot

    Apply to 20+ Portals in one click

    Download Now

    Download the Mobile App

    Instantly access job listings, apply easily, and track applications.

    coding practice

    Enhance Your Python Skills

    Practice Python coding challenges to boost your skills

    Start Practicing Python Now
    Ours Global logo
    Ours Global

    IT Services and IT Consulting

    Sheridan Wyoming

    RecommendedJobs for You