Director - Agentic AI Architect & Lead AI Designer

3 - 8 years

45 - 50 Lacs

Posted:5 days ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

Title and Summary

  • We are seeking a Director-Level Agentic AI Architect who sits at the intersection of massive-scale data engineering and advanced agentic intelligence
  • You will architect the data fabric, the real-time reasoning loops, and the distributed infrastructure required to run AI systems at scalefar beyond prompt engineering
  • This role begins as a hands-on Principal Architect/IC responsible for delivering Phase 0 (PoC) and Phase 1 (MVP)
  • After successful delivery, the role evolves into product engineering leadership, where you will hire and lead a high-impact cross-functional team (AI, Data, Backend, QA) to collaborate with engineering team to scale the platform
  • Core Responsibilities
  • 1. Architecting the AI Operating System Design a multi-agent orchestration layer capable of intelligently routing intent across reasoning, extraction, and decision-making layers
  • Solve for state, memory, and continuitybuild long-running agent processes with episodic, semantic, and working memory so complex investigations never lose context
  • Lead the 0-1 technical execution, owning architecture, design, and implementation from PoC to MVP before the team scales
  • 2. High-Velocity Data & Streaming Infrastructure Build the Data-for-AI backbone: petabyte-scale data pipelines that feed agents with real-time and historical context
  • Implement stateful streaming systems (Flink/Spark Streaming/Kafka Streams) enabling agents to react to events (fraud alerts, settlement breaks, operational exceptions) in milliseconds
  • Architect memory hierarchies:o Short-term (session/working context)o Long-term (knowledge base)o Episodic (state history)o Semantic/Vector memory (search + retrieval) Build high-velocity ingestion layers for PDFs, statements, logs, financial records, and large structured transaction datasets
  • Design a unified data access layer that blends OLTP lookups, OLAP analytics, and vector search into a single access pattern for agents
  • 3. Agentic AI Engineering & Reasoning Logic Build an ecosystem of specialized agentsextraction agents, QA agents, reasoning agents, diagnostic agents, and decision agents
  • Define state machines and execution graphs to support multi-step reasoning patterns:o Chain-of-thoughto Task decompositiono Root-cause investigation Implement grounding, safety, and HITL controls, ensuring agents never hallucinate or generate unsafe operational decisions
  • 4. FinOps, Performance & Security Build intelligent routing systems that balance accuracy vs cost across multiple LLMs
  • Design semantic caching, batching, trace compression, and selective memory persistence to reduce inference cost
  • Architect systems aligned with financial-grade security:o Query sandboxingo PII redactiono Role-based accesso Compliance with PCI-DSS and regulated-data controls
  • 5. Leadership & Team Building (Post-MVP) Lead the transition from PoC - MVP, Production
  • Hire and manage a 10+ person product engineering team across AI, Data, Backend, and QA
  • Define engineering culture, operational practices, and the long-term roadmap to scale the platform globally

Must-Have Technical Skills

  • Agentic Frameworks: Deep expertise in LangGraph (preferred) or LangChain for building multi-agent, stateful orchestration
  • LLM Engineering:o Model routingo RAG-based groundingo Text-to-SQL generation for complex schemas Vector & Memory Systems:o Vector search (Pinecone / Weaviate / Vespa)o Semantic cachingo Conversation and working memory (Redis / custom memory stacks)
  • Data Engineering:o Strong SQL skills
  • Kafka pipelines & event streamingo Data warehouse integration (Snowflake / BigQuery / Redshift) Security & Guardrails:
  • Experience implementing safety layers, guardrails, and restricted tool execution in regulated environments
  • Architecture & Leadership Experience Years in Software/Data Engineering with 3+ years building AI/ML or LLM-based systems
  • Proven experience as the Technical Lead/Architect for at least one 01 enterprise AI product
  • Hands-on experience in FinTech / Banking / Payments, ideally involving settlement, disputes, or reconciliation systems
  • Demonstrated ability to optimize cloud compute, manage LLM token costs, and architect scalable inference workloads
  • Strong ability to evaluate Build vs
  • Buy, design abstraction layers, and enforce architectural governance
  • Preferred Qualifications

  • Experience with PCI-DSS, PII tokenization, or regulated data frameworks
  • Hands-on experience with OpenTelemetry, Datadog, or similar tools for LLM/agent observability
  • Experience designing Human-in-the-Loop systems for high-stakes decision-making
  • Ability to work with distributed engineering teams in multiple time zones

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
Mastercard logo
Mastercard

IT Services and IT Consulting

Purchase NY

RecommendedJobs for You