6 Llm Deployment Jobs

Role Overview: Join a dynamic team working towards creating a thriving ecosystem that delivers accessible, high-quality, and sustainable healthcare for all. As a Principal Member of Technical Staff (PMTS), your expertise in designing, developing, debugging, and maintaining AI-powered applications and data engineering workflows for both local and cloud environments will be crucial. You will be involved in large-scale projects, optimizing AI/ML pipelines, and ensuring scalable data infrastructure. Key Responsibilities: - Develop AI-driven applications, microservices, and automation workflows using FastAPI, Flask, or Django, ensuring cloud-native deployment and performance optimization. - Integ...

As an AI Engineer at our company, your role will involve designing, developing, and deploying an in-house AI assistant powered by LLaMA 3 and integrated with our MS SQL-based ERP system (4QT ERP). You will be responsible for setting up LLM infrastructure, implementing voice input (Whisper), translating natural language to SQL, and ensuring accurate, context-aware responses to ERP-related queries. Key Responsibilities: - Setup and deploy LLaMA 3 (8B/FP16) models using llama-cpp-python or Hugging Face - Integrate the AI model with FastAPI to create secure REST endpoints - Implement prompt engineering or fine-tuning (LoRA) to enhance SQL generation accuracy - Develop a user-facing interface (Re...

Key Responsibilities: LLM Deployment & Optimization Deploy, fine-tune, and optimize open-source LLMs (e.g., LLaMA, Mistral, CodeS, DeepSeek). Implement quantization (e.g., 4-bit, 8-bit) and pruning for efficient inference on commodity hardware. Build and manage inference APIs (REST/gRPC) for production use. Infrastructure Management Set up and manage on-premise GPU servers and VM-based deployments. Build scalable cloud-based LLM infrastructure using AWS (SageMaker, EC2), Azure ML, or GCP Vertex AI. Ensure cost efficiency by choosing appropriate hardware and job scheduling strategies. MLOps & Reliability Engineering Develop CI/CD pipelines for model training, testing, evaluation, and deployme...

As a Senior Data Engineer + AI, you will play a crucial role in designing and optimizing distributed data pipelines using PySpark, Apache Spark, and Databricks to cater to both analytics and AI workloads. Your expertise in PySpark, Apache Spark, and Databricks for batch and streaming data pipelines will be instrumental in contributing to high-impact programs with clients. Your strong SQL skills for data analysis, transformation, and modeling will enable you to drive data-driven decision-making and facilitate rapid insight generation. Your responsibilities will involve supporting RAG pipelines, embedding generation, and data pre-processing for LLM applications, as well as creating and maintai...

Key Responsibilities: LLM Deployment & Optimization Deploy, fine-tune, and optimize open-source LLMs (e.g., LLaMA, Mistral, CodeS, DeepSeek). Implement quantization (e.g., 4-bit, 8-bit) and pruning for efficient inference on commodity hardware. Build and manage inference APIs (REST/gRPC) for production use. Infrastructure Management Set up and manage on-premise GPU servers and VM-based deployments. Build scalable cloud-based LLM infrastructure using AWS (SageMaker, EC2), Azure ML, or GCP Vertex AI. Ensure cost efficiency by choosing appropriate hardware and job scheduling strategies. MLOps & Reliability Engineering Develop CI/CD pipelines for model training, testing, evaluation, and deployme...

We are looking for an experienced Data Scientist with expertise in Generative AI and Large Language Models (LLMs) to join our innovation team. In this role, you will work at the cutting edge of AI technologies, leveraging LLMs to develop intelligent applications that can generate, analyze, and process text data. You will collaborate with data scientists, machine learning engineers, and product teams to build and deploy state-of-the-art AI solutions that solve complex real-world problems. Programming Python GenAI Technologies understanding evaluation LLM-LMM integration, Optimization, Deployment RAG, Knowledge graphs, transformers AWS Bedrock We re hiring Sr. Data Scientist for one of our Lea...