AI/ML Engineer

Job Summary

As part of our AI-first strategy at Creatrix Campus, you’ll play a critical role in deploying, optimizing, and maintaining Large Language Models (LLMs) like LLaMA, Mistral, and CodeS across our SaaS platform. This role is not limited to experimentation—it is about operationalizing AI at scale. You’ll ensure our AI services are reliable, secure, cost-effective, and product-ready for higher education institutions in 25+ countries.

You’ll work across infrastructure (cloud and on-prem), MLOps, and performance optimization while collaborating with software engineers, AI developers, and product teams to embed LLMs into real-world applications like accreditation automation, intelligent student forms, and predictive academic advising.

Key Responsibilities:

LLM Deployment & Optimization

● Deploy, fine-tune, and optimize open-source LLMs (e.g., LLaMA, Mistral, CodeS, DeepSeek).

● Implement quantization (e.g., 4-bit, 8-bit) and pruning for efficient inference on commodity hardware.

● Build and manage inference APIs (REST/gRPC) for production use.

Infrastructure Management

● Set up and manage on-premise GPU servers and VM-based deployments.

● Build scalable cloud-based LLM infrastructure using AWS (SageMaker, EC2), Azure ML, or GCP Vertex AI.

● Ensure cost efficiency by choosing appropriate hardware and job scheduling strategies.

MLOps & Reliability Engineering

● Develop CI/CD pipelines for model training, testing, evaluation, and deployment.

● Integrate version control for models, data, and hyperparameters.

● Set up logging, tracing, and monitoring tools (e.g., MLflow, Prometheus, Grafana) for model performance and failure detection.

Security, Compliance & Performance

● Ensure data privacy (FERPA/GDPR) and enforce security best practices across deployments.

● Apply secure coding standards and implement RBAC, encryption, and network hardening for cloud/on-prem.

Cross-functional Integration

● Work closely with AI solution engineers, backend developers, and product owners to integrate LLM services into the platform.

● Support performance benchmarking and A/B testing of AI features across modules.

Documentation & Internal Enablement

● Document LLM pipelines, configuration steps, and infrastructure setup in internal playbooks.

● Create guides and reusable templates for future deployments and models.

Technical Skills:

● Strong Python experience with ML libraries (e.g., PyTorch, Hugging Face Transformers).

● Familiar with LangChain, LlamaIndex, or other RAG frameworks.

● Experience with Docker, Kubernetes, and API gateways (e.g., Kong, NGINX).

● Working knowledge of vector databases (FAISS, Pinecone, Qdrant).

● Familiarity with GPU deployment tools (CUDA, Triton Inference Server, HuggingFace Accelerate).

Experience:

● 4+ years in an AI/MLOps role, including experience in LLM fine-tuning and deployment.

● Hands-on work with model inference in production environments (both cloud and on-prem).

● Exposure to SaaS and modular product environments is a plus.

Required Qualifications

Education:

● Bachelor’s or Master’s in Computer Science, AI/ML, Data Engineering, or related field.

About Company:

Anubavam Technologies, with over 18 years of pioneering experience in the Higher Education IT sector, is a trailblazing innovator dedicated to revolutionizing education with our premier platform, Creatrix Campus. We pride ourselves on delivering customized, cutting-edge solutions that empower institutions worldwide. With a strong geographical presence, our own offices span across India, Malaysia, UAE, and the USA. Our comprehensive services include student lifecycle management, accreditation, learning management systems, mobile solutions, and more. We cater to the unique needs of educational institutions, ensuring they stay ahead with modern technological advancements. Anubavam commitment to technological excellence and customer satisfaction positions us at the forefront of educational transformation. Join us in our mission to shape the future of education through technology and innovation. Be a part of a company that values growth, collaboration, and forward-thinking.