AI Prompt Engineer

Job Title

Location: Fully Remote

Work Hours: 4:00 PM to 1:30 AM IST with daylight savings (Till 3 PM CST)

Experience Required: 2+ Years

As a Prompt Engineer, you will design, evaluate, and refine prompts that drive intelligent behavior in AI-enabled features across our platform. You will work closely with data scientists, engineers, and product leaders to develop prompt frameworks and dialogue flows that power agentic orchestration, helping patients navigate complex health journeys.

Role & responsibilities

• Architect reusable prompt templates for multi-turn conversational flows, including clarification, escalation, human-in-the-loop, and action triggering
• Work with engineers and data scientists to test and optimize RAG-based search prompts
• Create and maintain prompt libraries with robust versioning and testing frameworks
• Collaborate on agentic workflows that help agents act autonomously and intelligently across clinical, scheduling, and care navigation use cases
• Evaluate prompt performance using real-time analytics and partner with the data science team to iterate
• Support safe prompt handling of PHI, bias mitigation, and hallucination reduction
• Develop challenger agents and evaluation agents to confirm agent output and ensure safe and consistent messaging to MyBSWHealth customers

Minimum Qualifications

• Bachelor's degree in Computer Science, Linguistics, Philosophy, Cognitive Science, or comparable experience in industry or a related field
• 2+ years working with LLMs (e.g., GPT, Claude, Mistral, etc.) in production settings
• Experience with prompt engineering, RAG, or agentic AI architectures
• Familiarity with healthcare or other regulated industry - workflows, EHR systems, or clinical terminology is a plus
• Strong understanding of conversational UX and prompt evaluation metrics
• Experience with Pydantic AI python library and n8n workflow automation software suite preferred