Principal Software Engineer, Gen-AI Search Relevance

Role Overview: As a Principal Software Engineer at Instant Markets, a venture of Instant Systems Inc., you will have the opportunity to lead innovation in intelligent search systems by addressing lexical gaps, enhancing semantic text understanding, and overcoming data sparsity using Generative AI. You will be responsible for architecting and implementing semantic search and ranking systems, applying advanced NLP techniques, and collaborating with cross-functional teams to translate research into production-grade systems. Your work will involve driving innovations in recommendation systems and improving user satisfaction across products. Key Responsibilities: - Architect and implement semantic search and ranking systems using deep neural models and embeddings - Design robust generalization strategies for sparse data environments using pretrained models and knowledge distillation - Develop and refine query understanding, document retrieval, and ranking pipelines using advanced NLP and LLM techniques - Work on context-aware and intent-based search to enhance user satisfaction - Collaborate with applied scientists, product managers, and engineers to build production-grade systems - Evaluate model performance using offline metrics and online A/B testing for continuous improvement - Build hybrid recommendation models combining collaborative filtering with semantic understanding Qualifications Required: - 3-6 years of experience in Search/NLP/Machine Learning/Recommendation Systems - Strong foundation in ML/DL algorithms, including classification, ranking, embeddings, and transformers - Understanding of challenges like lexical gap, polysemy/synonymy, and semantic matching - Experience working with sparse or long-tail data in production settings - Hands-on experience with vector search technologies like FAISS, Pinecone, Weaviate - Proficiency in Python and exposure to libraries such as PyTorch, TensorFlow, Hugging Face, Scikit-learn, etc. - Knowledge of ranking models, feature engineering, and evaluation techniques - Familiarity with retrieval-augmented generation (RAG) and LLM integration into search pipelines About Instant Systems Inc.: Instant Systems Inc. is a Silicon Valley-based company with offices in Noida, focusing on finding and investing in bright startups to help establish competent product engineering teams. As part of the team, you will collaborate on innovative projects, receive mentorship and training for career growth, and have access to remote work options for better work-life balance. Instant Systems values diversity and inclusivity in its workplace, ensuring that every voice is heard and respected. (Note: The section "More About Instant Systems Inc." has been omitted as it does not directly relate to the job role and responsibilities.),