AI Junior Engineer / Intern

AI Junior Engineer / Intern (Onsite Only — Pune, India)

Type:

Duration:

About Crackr.ai

At Crackr.ai, we’re building next-generation, self-hosted AI solutions designed for privacy, scalability, and real-world impact. From education to enterprise, our mission is to combine innovation and agility to make AI practical, secure, and deployable at scale.

AI Intern / Junior Engineer

What You’ll Do

• Explore and benchmark open-source LLMs (Mistral, Phi-2, TinyLlama, Gemma, etc.)
• Fine-tune models for applied tasks such as summarization, Q&A, and classification
• Build proof-of-concept apps using LangChain, Transformers, and vector databases (FAISS, Weaviate)
• Design and optimize RAG pipelines, embedding-based search, and inference APIs
• Work on model efficiency: quantization, cost optimization, latency reduction
• Contribute to datasets, prompt engineering, and evaluation frameworks
• Document results, write reports, and share learnings with the team

What You’ll Need

• Solid understanding of NLP, transformers, and foundation models
• Familiarity with open-source LLMs and hosting (Hugging Face, Ollama, vLLM, LM Studio)
• Strong Python skills (FastAPI, LangChain, PyTorch/TensorFlow)
• Comfort with Linux, Docker, Git, and CLI workflows
• Interest in vector databases and Retrieval-Augmented Generation (RAG) systems
• Curiosity, independence, and a drive to experiment

Bonus Points

• Experience running LLMs locally (Ollama, LM Studio, vLLM)
• Contributions to open-source AI/NLP projects
• Familiarity with embedding models (BGE, Instructor, E5, OpenAI/Bedrock embeddings)
• Knowledge of model optimization (GGUF, GPTQ, quantization techniques)

What You’ll Get

• Hands-on experience with cutting-edge open-source AI in production-like setups
• Mentorship from experienced AI practitioners and engineers
• Real ownership of experiments and proof-of-concept builds
• Opportunity to convert to a full-time role based on performance
• A collaborative, fast-moving, and learning-focused culture

How to Apply:

join@crackr.ai