Job
Description
Job Description We are seeking a Senior Software Engineer to lead and guide our engineering team in building and enhancing our internal AI Gateway platform. This platform empowers internal organizations to create and deploy AI use cases, integrating with Azure OpenAI, AWS Bedrock, Databricks, and other cloud platforms. You will drive architecture, design, and implementation of scalable data/model management pipelines, agentic AI, RAGs, tracing, and MCP server components. Essential to have hands on Development experience in Python JavaScript, TypeScript, Node JS Essential to have hands on experience in building scalable GenAI applications leveraging LLMs e.g. GPT, Claude, Anthropic using various techniques e.g. RAG, Agentic AI etc. Preferred experience in Developing GenAI Solutions using frameworks e.g. Langchain, LlamaIndex. Preferred experience in building AI pipelines for interaction via Chatbots, User Interface, Autonomous Agents. Must have excellent communication skills to understand complex AI concepts & work with architects to build the solution as well as the ability to explain it to Nontechnical Stakeholders. Preferred experience of deploying solutions on AWS with best, practices. Good to have built capabilities in GenAI backed by evaluation (any existing framework for evaluation or custom built for the specific use case).Contributions to AI research, opensource models or AI hackathons are a plus. Responsib0ilities: Lead the design and development of the AI Gateway platform and its integrations (Azure OpenAI, AWS Bedrock, Databricks, etc.). Architect and implement scalable, secure, and maintainable data/model management pipelines. Guide the team in building agentic AI, RAG (Retrieval-Augmented Generation), tracing, and MCP server solutions. Mentor and upskill team members, conduct code reviews, and enforce best practices. Collaborate with product, DevOps, and data science teams to deliver robust solutions. Drive automation and CI/CD for model and data pipeline deployments. Ensure platform reliability, observability, and security. Requirements: 7+ years of software engineering experience, with at least 2 years in a technical leadership role. Strong Python (FastAPI, asyncio), cloud (Azure, AWS), and data engineering skills. Experience with LLMs, agentic AI, RAGs, and orchestration frameworks. Hands-on with cloud ML services (Azure OpenAI, AWS Bedrock, Databricks). Familiarity with CI/CD, Docker, Kubernetes, and infrastructure-as-code.
