Sr. Java Developer with GenAI Integration

1 - 5 years

0 Lacs

Posted:1 day ago| Platform: Shine logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

As a skilled Senior Java Backend Engineer, your role will involve designing APIs, orchestrating AI agents, and integrating Large Language Models (LLMs) into production-ready systems for Generative AI applications. You will play a key role in building and maintaining scalable backend services using Java and the Spring Boot framework. Your responsibilities will also include developing APIs for LLM integration, architecting microservices, optimizing performance, managing connections with multiple LLM providers, implementing real-time streaming features, and ensuring robust system observability. Key Responsibilities: - Design, build, and maintain scalable backend services using Java and the Spring Boot framework - Develop APIs to enable LLM integration and support AI agent orchestration workflows - Architect microservices to power RAG (Retrieval-Augmented Generation) and other LLM-driven systems - Optimize performance through efficient caching strategies and vector database interactions - Integrate and manage connections with multiple LLM providers (e.g., OpenAI, Gemini, Claude), including rate limiting and failover handling - Implement real-time streaming features for conversational AI systems using WebSockets or similar technologies - Ensure robust system observability with logging, monitoring, and tracing Required Skills & Qualifications: - 3+ years of hands-on experience with Java and Spring Boot - Strong grasp of RESTful API design principles and microservices architecture - Proficiency with core Spring modules: Spring Security, Spring Data JPA, Spring Cloud - Experience working with relational and NoSQL databases: PostgreSQL, MongoDB, Redis - Familiarity with message brokers such as RabbitMQ or Apache Kafka - Expertise in caching mechanisms and system performance tuning - Experience integrating LLM APIs into backend services - Knowledge of vector databases and semantic search technologies - Familiarity with AI agent orchestration frameworks - Understanding of RAG systems and implementation - Experience developing streaming responses using WebSockets or server-sent events - Working knowledge of prompt templating and management systems Nice to Have: - Experience in fine-tuning LLMs and managing model deployment pipelines - Knowledge of self-hosted LLM environments and infrastructure management - Exposure to observability tools like LangSmith or custom monitoring setups - Familiarity with natural language to SQL systems or BI applications powered by LLMs If you feel you match the above job description and possess the required skills and qualifications, please fill in your details on the enclosed form.,

Mock Interview

Practice Video Interview with JobPe AI

Start Java Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Java Skills

Practice Java coding challenges to boost your skills

Start Practicing Java Now
Grid Dynamics logo
Grid Dynamics

Information Technology and Services

Los Altos

RecommendedJobs for You