10 Llm Deployment Jobs

Responsibilities may include the following and other duties may be assigned: Participate in a global team of Database Architects, Engineers, and Administrators. Utilize Infrastructure as Code (IaC) tools such as Terraform, Ansible, or CloudFormation. Automate the provisioning and management of database infrastructure for Oracle, SQL Server, PostgreSQL, and other database engines. Provide hands-on technical support across various on-premises and cloud-based database offerings. Deploy configurations, database settings, parameters, patching, and tools on multiple instances using Ansible playbooks to manage database configurations, apply patches, and deploy necessary tools. Integrate Service Cat...

Experience 2-3 years in AI/ML engineering or software development Proven track record of deploying LLM applications to production Experience with at least 2 LLM orchestration frameworks Built and deployed RAG systems or similar AI applications Strong Python coding skills with production code experience Must-Have Attributes Deep understanding of transformer architectures Can explain complex AI concepts to non-technical stakeholders Stay current with latest AI research and developments Team player with good communication skills

Automate ML pipelines, deploy and monitor ML/LLM models, integrate code into customer pipelines, manage CI/CD workflows, containerize applications, set up data pipelines, collaborate with architects, and ensure smooth model deployment at scale. Required Candidate profile Strong MLOps background, hands-on with CI/CD, Docker, Kubernetes, Airflow, MLflow, and LLM tools. Skilled in ML deployment, monitoring, and pipeline automation with ability to coordinate

Job description Role : Generative AI Engineer Location - Bangalore Experience - 6+ Years Notice Period : Immediate joiner Core Responsibilities: ? Collaborate with cross-functional teams to translate complex AI concepts into practical business solutions. ? Design systems around open source, enterprise models like Llama, Gemini, GPT to solve innovative problems. ? Build robust evaluation pipelines to assess model performance, safety, and alignment with business objectives. ? Optimize model latency and performance for real-time applications and large-scale deployment ? Architect scalable ML infrastructure for training, inference, and model serving ? Fine-tune Large Language Models (LLMs) and o...

Role Overview: Join a dynamic team working towards creating a thriving ecosystem that delivers accessible, high-quality, and sustainable healthcare for all. As a Principal Member of Technical Staff (PMTS), your expertise in designing, developing, debugging, and maintaining AI-powered applications and data engineering workflows for both local and cloud environments will be crucial. You will be involved in large-scale projects, optimizing AI/ML pipelines, and ensuring scalable data infrastructure. Key Responsibilities: - Develop AI-driven applications, microservices, and automation workflows using FastAPI, Flask, or Django, ensuring cloud-native deployment and performance optimization. - Integ...

As an AI Engineer at our company, your role will involve designing, developing, and deploying an in-house AI assistant powered by LLaMA 3 and integrated with our MS SQL-based ERP system (4QT ERP). You will be responsible for setting up LLM infrastructure, implementing voice input (Whisper), translating natural language to SQL, and ensuring accurate, context-aware responses to ERP-related queries. Key Responsibilities: - Setup and deploy LLaMA 3 (8B/FP16) models using llama-cpp-python or Hugging Face - Integrate the AI model with FastAPI to create secure REST endpoints - Implement prompt engineering or fine-tuning (LoRA) to enhance SQL generation accuracy - Develop a user-facing interface (Re...

Key Responsibilities: LLM Deployment & Optimization Deploy, fine-tune, and optimize open-source LLMs (e.g., LLaMA, Mistral, CodeS, DeepSeek). Implement quantization (e.g., 4-bit, 8-bit) and pruning for efficient inference on commodity hardware. Build and manage inference APIs (REST/gRPC) for production use. Infrastructure Management Set up and manage on-premise GPU servers and VM-based deployments. Build scalable cloud-based LLM infrastructure using AWS (SageMaker, EC2), Azure ML, or GCP Vertex AI. Ensure cost efficiency by choosing appropriate hardware and job scheduling strategies. MLOps & Reliability Engineering Develop CI/CD pipelines for model training, testing, evaluation, and deployme...

As a Senior Data Engineer + AI, you will play a crucial role in designing and optimizing distributed data pipelines using PySpark, Apache Spark, and Databricks to cater to both analytics and AI workloads. Your expertise in PySpark, Apache Spark, and Databricks for batch and streaming data pipelines will be instrumental in contributing to high-impact programs with clients. Your strong SQL skills for data analysis, transformation, and modeling will enable you to drive data-driven decision-making and facilitate rapid insight generation. Your responsibilities will involve supporting RAG pipelines, embedding generation, and data pre-processing for LLM applications, as well as creating and maintai...

Key Responsibilities: LLM Deployment & Optimization Deploy, fine-tune, and optimize open-source LLMs (e.g., LLaMA, Mistral, CodeS, DeepSeek). Implement quantization (e.g., 4-bit, 8-bit) and pruning for efficient inference on commodity hardware. Build and manage inference APIs (REST/gRPC) for production use. Infrastructure Management Set up and manage on-premise GPU servers and VM-based deployments. Build scalable cloud-based LLM infrastructure using AWS (SageMaker, EC2), Azure ML, or GCP Vertex AI. Ensure cost efficiency by choosing appropriate hardware and job scheduling strategies. MLOps & Reliability Engineering Develop CI/CD pipelines for model training, testing, evaluation, and deployme...

We are looking for an experienced Data Scientist with expertise in Generative AI and Large Language Models (LLMs) to join our innovation team. In this role, you will work at the cutting edge of AI technologies, leveraging LLMs to develop intelligent applications that can generate, analyze, and process text data. You will collaborate with data scientists, machine learning engineers, and product teams to build and deploy state-of-the-art AI solutions that solve complex real-world problems. Programming Python GenAI Technologies understanding evaluation LLM-LMM integration, Optimization, Deployment RAG, Knowledge graphs, transformers AWS Bedrock We re hiring Sr. Data Scientist for one of our Lea...