Sr LLM Engineer

The Role

We are seeking an experienced LLM Engineer to drive the development and integration of LLM capabilities within our platform. The ideal candidate will have strong backend expertise in Python, with hands-on experience in building scalable AI-driven applications and integrating LLMs with enterprise systems.

Key Responsibilities

• Design, develop, and maintain backend services for our LLM-based automation platform.

• Integrate LLMs and vector databases into the application workflow.

• Implement secure authentication and authorization mechanisms (OAuth 2.0, RBAC, JWT).

• Build efficient database models and queries for complex data handling.

• Develop and document RESTful APIs following best practices.

• Optimize application performance, scalability, and responsiveness.

• Implement robust error handling, monitoring, and logging mechanisms.

• Collaborate with cross-functional teams (frontend, ML, product) to ensure seamless integration. • Write clean, maintainable, and well-structured code.

Required Skills and Experience

• 5+ years of backend development experience with Python.

• Strong proficiency in Flask or FastAPI.

• Hands-on expertise with SQLAlchemy ORM.

• In-depth understanding of OAuth 2.0, JWT, and RBAC.

• Experience with RESTful API design and implementation.

• Proficiency in PostgreSQL or other relational databases.

• Strong experience with Docker and containerized deployments.

• Knowledge of Git for version control.

• Strong problem-solving and debugging skills with attention to detail.

• Excellent communication and teamwork skills.

Preferred Qualifications

• Experience working with LLMs, NLP, or machine learning technologies.

• Familiarity with vector databases (e.g., Qdrant, Chroma, Faiss).

• Exposure to Azure or AWS cloud platforms.

• Experience with microservices architecture.

• Understanding of Jinja2 templating engine and API documentation tools (Swagger).

Technical Stack

• Language: Python 3.x

• Frameworks: Flask / FastAPI

• ORM: SQLAlchemy

• Authentication: OAuth 2.0, JWT

• API: RESTful, Swagger

• Databases: PostgreSQL, Vector DBs (Qdrant/Chroma/Faiss)

• Version Control: Git

• Containerization: Docker.