AI Infrastructure Architect / Engineer

Role summary
Build and run the enterprise AI platform layer: governed access to many kinds of models (open-source, frontier, SaaS, cloud-managed, private), the infrastructure for agentic AI, and the security and cost controls around all of it.

Total IT exp: 4 to 5 years. AI experience: minimum 1 year.
Location: HydreabadClient: HITACHI ENTERPRISESIf interested, send your resume: k.sridhar@bluepillartechnologies.com

Key responsibilities

• Architect and operate enterprise AI inferencing platforms with unified, governed, cost-efficient model access.
• Design and maintain a governed model catalog and model routing framework, with guardrails, access controls, and cost governance.
• Own the infrastructure workstream for agentic AI: cloud account architecture, runtime environments, memory and gateway services, and governance.
• Implement authentication, authorization, and access control for AI platforms (SSO, SAML, SCIM, RBAC).
• Integrate enterprise AI SaaS tools with internal identity, collaboration, and data systems.
• Work with security, compliance, and risk teams on AI-powered security and operational solutions using private AI infrastructure.
• Set up FinOps and consumption governance: dashboards, usage analytics, token governance, cost attribution.
• Give architecture guidance and technical governance to AI and agentic workflow teams.

Required skills

• Cloud architecture (AWS/Azure/GCP), including multi-account setups
• LLM serving and inference (managed APIs and self-hosted open models), API gateways, model routing
• Identity and access: SSO, SAML, SCIM, RBAC, IAM
• Kubernetes, containers, Infrastructure-as-Code (Terraform or similar)
• FinOps, observability, and usage/token monitoring
• Security and compliance fundamentals for AI (data governance, guardrails)

Good to have

• Experience with agentic frameworks and agent runtimes
• Enterprise AI SaaS rollouts (e.g., copilots, chat assistants)
• Vector stores and memory services

Pay: ₹900,000.00 - ₹1,300,000.00 per year

Benefits:

• Provident Fund

Experience:

• Cloud development: 4 years (Preferred)

Work Location: In person