Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Home
>
Jobs in pune
>
APM Terminals
>
Senior Software Engineer

Senior Software Engineer

APM Terminals

8 - 13 years

6 - 10 Lacs

pune bengaluru

Posted:1 month ago| Platform:

Apply

Skills Required

computer science backend orchestration gcp postgresql mcp analytics downstream logistics python

Work Mode

Work from Office

Job Type

Full Time

Job Description

We are seeking a Senior Software Engineer with deep backend expertise to lead the development of scalable infrastructure for LLM inferencing, Model Context Protocol (MCP) integration, Agent-to-Agent (A2A) communication, prompt engineering, and robust API platforms. This role sits at the core of our AI systems stack enabling structured, contextual, and intelligent communication between models, agents, and services. Youll design modular backend services that interface seamlessly with inferencing engines, orchestrate model contexts, and expose capabilities via APIs for downstream products and agents.
What Ill be doing your accountabilities?

Architect and implement backend services that support dynamic model context management via MCP for LLM-based systems.
Build scalable and token-efficient inference pipelines with support for streaming, context merging, memory, and retrieval.
Enable Agent-to-Agent (A2A) messaging and task coordination through contextual protocols, message contracts, and execution chains.
Design and maintain developer-friendly, secure, and versioned APIs for agents, tools, memory, context providers, and prompt libraries.
Lead efforts in prompt engineering workflows including templating, contextual overrides, and programmatic prompt generation.
Collaborate across engineering, ML, and product teams to define and implement context-aware agent systems and inter-agent communication standards to enable closed-loop enterprise AI Services ready for consumption by the enterprise.
Own end-to-end delivery of infrastructure, inferencing, back-end, API and communication management in multi-agent system.
Ensure models are modular, extensible, and easily integrated with external services/platforms (e.g., dashboards, analytics, AI agents).

Foundational / Must Have Skills

Bachelor s, Master s or Phd in Computer Science, Engineering, or related technical field.
8+ years of experience in backend systems design and development ideally in AI/ML or data infrastructure domains.
Strong proficiency in Python (FastAPI preferred); additional experience with Node.js, Go, or Rust is a plus.
Experience with LLM inferencing pipelines, context windowing, and chaining prompts with memory/state persistence.
Familiarity with or active experience implementing Model Context Protocol (MCP) or similar abstraction layers for context-driven model orchestration.
Strong understanding of REST/GraphQL API design, OAuth2/JWT-based auth, and event-driven backend architectures.
Practical knowledge of Redis, PostgreSQL, and one or more vector databases (e.g., Weaviate, Qdrant).
Comfortable working with containerized applications, CI/CD pipelines, and cloud-native deployments (AWS/GCP/Azure).

Preferred to Have

Experience building or contributing to agent frameworks (e.g., LangGraph, CrewAI, AutoGen, Agno etc.).
Background in multi-agent systems , dialogue orchestration, or synthetic workflows.
Familiarity with OpenAI, Anthropic, HuggingFace, or open-weight model APIs and tool-calling protocols.
Strong grasp of software security, observability (OpenTelemetry, Prometheus), and system performance optimization.
Experience designing abstraction layers for LLM orchestration across different provider APIs (OpenAI, Claude, local inference).

What you can expect

Opportunity to lead backend architecture for cutting-edge, LLM-native systems.
High-impact role in shaping the future of context-aware AI agent communication.
Autonomy to drive backend standards, protocols, and platform capabilities across the org.
Collaborative, remote-friendly culture with deep technical peers.

More Jobs at APM Terminals

Team Lead Domestic operations

Jaipur

Experience: Not specified

INR 1 - 6 Lacs

Planning Executive

Mumbai, Maharashtra, India

4.0 - 4.0 yrs

Salary: Not disclosed

Planning Executive

maharashtra

2.0 - 6.0 yrs

Salary: Not disclosed

Head of Procurement - APMT (GPPL)

Ahmedabad, Gujarat, India

15.0 - 15.0 yrs

Salary: Not disclosed

Head of Procurement - APMT (GPPL)

Rajula, Gujarat, India

15.0 - 15.0 yrs

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

APM Terminals

Login to

Please Verify Your Phone or Email

Confirm Action

Senior Software Engineer