AI / LLM Architect, Healthcare Private Models

10 years

0 Lacs

Posted:1 week ago| Platform: Linkedin logo

Apply

Work Mode

Remote

Job Type

Full Time

Job Description

Company:

Domain:

Location:

Experience:

Role Overview

Senior AI / LLM Architect

You will work on LLM architecture, fine-tuning pipelines, AI agents, and secure inference systems, tightly integrated into a modern cloud-native healthcare platform.

Key Responsibilities

  • Design and implement a

    private, in-house LLM architecture

    without dependency on public LLM APIs.
  • Build

    fine-tuning and continual learning pipelines

    using proprietary and de-identified healthcare data.
  • Architect

    secure inference, retrieval-augmented generation, and AI agent frameworks

    .
  • Ensure

    HIPAA-aligned data handling

    , audit ability, and AI safety controls.
  • Partner with product, clinical, and engineering teams to convert workflows into

    AI-driven automation and decision support

    .
  • Define

    model governance, evaluation metrics, versioning, and feedback loops

    for continuous improvement.
  • Optimize

    model performance, latency, reliability, and cost

    for production healthcare workloads.
  • Collaborate with cloud and DevOps teams on

    GPU workloads, Kubernetes orchestration, and MLOps pipelines

    .
  • Produce

    clear technical documentation, architecture diagrams, and AI design standards

    .

Required Skills and Experience

  • 6–10+ years

    of experience in

    AI or ML engineering

    , with strong focus on

    LLMs or NLP systems

    .
  • Hands-on experience training, fine-tuning, or adapting

    open-source LLMs

    such as LLaMA, Mistral, Falcon, or similar.
  • Strong understanding of

    RAG architectures, embeddings, vector databases, and prompt-to-pipeline design

    .
  • Proficiency in

    Python

    with

    PyTorch or TensorFlow

    .
  • Experience deploying ML systems on

    AWS

    using services such as EC2 GPU, SageMaker, EKS, and S3.
  • Strong system-design skills for

    scalable, production-grade AI platforms

    .
  • Excellent

    communication and technical documentation

    skills.

Preferred Experience

  • Experience in

    US healthcare platforms

    , RPM, CCM, or regulated data environments.
  • Exposure to

    AI agents, workflow automation, or decision-support systems

    .
  • Experience with

    Kubernetes, Docker, and CI/CD for ML systems

    .
  • Knowledge of

    AI safety, hallucination reduction, explainability, and model evaluation

    .
  • Prior experience building

    long-running AI systems that improve through feedback loops

    .

Why Join Us

  • Build a

    foundational private healthcare LLM

    with real-world impact.
  • Work on

    compliance-first, high-trust AI systems

    .
  • High-ownership role with

    direct leadership visibility and strategic influence

    .
  • Opportunity to define

    AI architecture standards and long-term roadmap

    .
  • Competitive compensation with startup agility and long-term growth potential.
  • Hybrid work model with collaboration across India and US teams.

About AccuData Analytics

secure, scalable, and AI-driven digital health platforms

Mock Interview

Practice Video Interview with JobPe AI

Start DevOps Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now

RecommendedJobs for You