Sr Software Engineer

Job Title: Software Engineer - LLM

About ConcertAI

ConcertAI is the leading provider of precision oncology solutions for biopharma and healthcare, leveraging the largest collection of research-grade Real-world Data and the only broadly deployed oncology-specific AI solutions. Our mission is to improve translational sciences; accelerate therapeutic clinical development; and provide new capabilities for post-approval studies to accelerate needed new medical innovations to patients and to improve patient outcomes.

ConcertAI has emerged as one of the highest growth technology companies in Real-world Data and AI, backed by industry leading private equity companies: SymphonyAI, Declaration Partners, Maverick Ventures, and Alliance|Bernstein.

Role Summary

ConcertAI is seeking a hands-on engineer to build and enhance its next-generation Clinical AI agentic platform and analytics products, processing large volumes of real-world healthcare data to generate insights and optimize clinical trial design. The ideal candidate should have experience with LLMs, RAG, and tools like LangChain and LangGraph for developing interactive agents. Serving as the technical point person, they will collaborate closely with product managers, data scientists, and the development team to drive the product's technology and business roadmap forward.

Responsibilities

• In this role, you'll help develop and maintain the conversation layer using a combination of software and prompting skills to enable AI-driven clinical conversations.

• Design complex prompts within the conversation planning layer to support advanced agentic model workflows.

• Collaborate with subject matter experts to define standard outcomes and continuously refine prompt designs for maximum efficiency and effectiveness

• Write, configure, and refine prompts to facilitate engaging, oncology curator-oriented interactions.

• Apply advanced prompting techniques to enhance language model performance, ensuring clinical safety and an improved trial experience.

• Conduct experiments and analyze model outputs to refine and optimize prompt strategies.

• Design and develop scalable, high-performing, and security-compliant APIs, services, and algorithms for production use.

• Maintain high engineering standards by ensuring code consistency, thorough testing, and seamless integration across software components.

Qualification

• Bachelor’s degree in computer science, Computer Engineering, or a related field.

• Proficiency in Python and SQL, with hands-on experience using interactive notebooks (e.g., Jupyter).

• Proven experience in machine learning research and development, particularly with LLMs.

• Professional experience with LLM prompting (e.g., ChatGPT, Claude, LLaMA).

• Experience with LangChain and LangGraph.

• Experience in machine learning R&D, particularly in designing, testing, and optimizing LLM-based solutions.

• Ability to assess model outputs, refine prompt designs, and improve overall system performance.

• Exposure to working with databases and building simple RESTful APIs.

• Knowledge of modern web frameworks (e.g., Flask, Django, or Spring Boot).

• Strong analytical skills and problem-solving mindset.

• Eagerness to learn new technologies and adapt in a fast-paced environment.

• Understanding of healthcare workflows and regulatory requirements.

• Awareness of data privacy and security best practices, especially in regulated environments.