Get alerts for new jobs matching your selected skills, preferred locations, and experience range.
5 - 7 years
22 - 25 Lacs
Chennai, Pune, Noida
Work from Office
1.Design and Development of APIs: Create robust, scalable APIs to interface with large language models (LLMs). Develop endpoints for sending and receiving data from the LLM, ensuring that requests (e.g., text prompts) and responses are efficiently processed and communicated between the front end and back end. 2.Request and Response Handling: Implement systems that properly structure user inputs (e.g., transforming data into LLM-readable formats) and format the model outputs to meet application needs. Design logic to handle various types of responses, including error handling, fallback mechanisms, and retries. 3.Middleware and Pre/Post-Processing: Develop middleware to preprocess inputs before sending them to the LLM (e.g., tokenization, language translation, or contextual enhancements). Post-process responses to improve output readability, filter inappropriate content, or integrate additional functionality, such as summarization or answer extraction. 4.Performance Optimization: Focus on reducing latency in API calls to provide fast responses, especially for real-time applications. Implement strategies such as request batching, caching, and efficient data flow management to minimize delays and maximize throughput. 5.Security and Authentication: Set up secure API access with authentication mechanisms such as API keys, OAuth, or token-based access. Implement rate limiting, request logging, and auditing to prevent abuse and monitor usage. 6.API Versioning and Maintenance: Manage versioning to ensure backward compatibility when updates or changes to the LLM or API occur. Document and implement updates without disrupting existing users, ensuring smooth transitions for new versions. 7.Cost and Usage Optimization: Implement systems that minimize unnecessary API calls to control costs associated with using LLMs. Build mechanisms to track usage, set cost thresholds, and develop strategies like response caching to reduce API call frequency. 9.Collaboration with Other Teams: Work closely with machine learning engineers to ensure the LLMs API integration is seamless. Collaborate with frontend developers to ensure that the LLMs responses fit the applications user interface and experience. Location-Chennai/Noida/Pune/Trichy
Posted 2 months ago
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Accenture
36723 Jobs | Dublin
Wipro
11788 Jobs | Bengaluru
EY
8277 Jobs | London
IBM
6362 Jobs | Armonk
Amazon
6322 Jobs | Seattle,WA
Oracle
5543 Jobs | Redwood City
Capgemini
5131 Jobs | Paris,France
Uplers
4724 Jobs | Ahmedabad
Infosys
4329 Jobs | Bangalore,Karnataka
Accenture in India
4290 Jobs | Dublin 2