Sr Software Engg (GenAI Intelligence, AI Platform & Model Ops Engineer

Mission:

Responsibilities

• Collaborate with cross-functional teams (Product, Engineering, CloudOps, BI, and internal stakeholders) to define use cases and deliver value. 
• Design, build, and optimize RAG pipelines (document ingestion, embeddings, hybrid retrieval, re-ranking). 
• Implement and orchestrate agentic AI workflows with tool integration. 
• Build evaluation frameworks: golden sets, hallucination testing, red-teaming, prompt injection defense. 
• Develop guardrails: policy checks, PII redaction, safety filters. 
• Manage LLMOps: caching, model routing, cost/latency optimization. 
• Support LLM fine-tuning (LoRA, PEFT) and dataset preparation. 
• Collaborate with AI Product Engineer to deploy reliable prototypes. 
• Harden PoCs into customer-facing systems with CI/CD, monitoring, rollback strategies. 
• Implement security and compliance controls for SOC2, GDPR, HIPAA, and industry-specific standards. 

Desired Skills (High Priority Low Priority)

• Ability to integrate with BI/data pipelines (Snowflake, Tableau, Informatica, or equivalent). 
• RAG Expertise: Document ingestion, chunking, embeddings generation, retrieval metrics (recall@k, nDCG). 
• Agentic AI Orchestration: LangChain, Autogen, CrewAI, function/tool calling. 
• Evaluation & Guardrails: Golden sets, hallucination testing, red-teaming, prompt injection defense. 
• Vector Databases: Pinecone, Weaviate, pgvector, FAISS. 
• LLMOps & Optimization: Model routing (smalllarge), caching, latency/cost SLOs. 
• Applied NLP: Text classification, summarization, sentiment, entity extraction. 
• LLM Training: Instruction fine-tuning (LoRA/PEFT), dataset curation, data skewness and redundancy evaluations. 
• Python Engineering: Strong in orchestration (pydantic/FastAPI), Pandas for data prep. 
• Security/Compliance Awareness: RBAC, data privacy, audit logging. 
• MLOps/Data Pipelines: Airflow, dbt, or lightweight ETL for ingest. 
• Production Monitoring: Prometheus, Grafana, Datadog dashboards for AI workloads. 

Education

Bachelors or Masters degree in Computer Science, Data Science, Machine Learning, Artificial Intelligence, or related field. Advanced degree (MSc, PhD) in NLP, ML, or Information Retrieval is a plus but not mandatory. 

Good-to-Have Qualifications

• Experience fine-tuning or training transformer models (LLMs, BERT, GPT variants). 
• Knowledge of search/retrieval systems (Elasticsearch, OpenSearch, Vespa). 
• Contributions to open-source AI/ML projects (LangChain, LlamaIndex, HuggingFace). 
• Experience with benchmark datasets (SQuAD, GLUE, MS MARCO, or internal corpora). 
• Hands-on with cloud AI services (AWS Bedrock, Azure OpenAI, GCP Vertex AI). 
• Background in data security, compliance, and privacy standards (SOC2, GDPR, HIPAA). 
• Strong math/ML foundation (optimization, statistics, linear algebra).

• HYBRID

   – This role will be based out of 

  The Leela Office

  located on the 4th Floor, Airport Road, Kodihalli, Bangalore- 560008.  Our expectation at this time, is that you would work from our office on Tuesdays, Wednesdays, Thursdays with flexibility to work from home on Mondays and Fridays.