Job
Description
As an AI Engineer (Backend & NLP) at South Guild Tech, you will be part of a team that builds AI platforms redefining enterprise workflows in industries like healthcare, audit, and industrial automation. Your role involves developing high-performance AI applications, leveraging cutting-edge NLP models, and optimizing retrieval systems for intelligent automation at scale. **Key Responsibilities:** - Design & Develop AI-Driven Retrieval Systems: - Implement modern information retrieval techniques such as BM25, TF-IDF, dense vector search, and hybrid search using tools like FAISS, Pinecone, or Weaviate. - Build retrieval-augmented generation (RAG) pipelines for knowledge-based AI applications. - Natural Language Processing & AI Engineering: - Work with LLMs, transformers, and embedding models for NLP applications. - Optimize text processing, NER, text classification, and summarization tasks. - Implement fine-tuning and prompt engineering strategies for LLM-powered solutions. - Backend & API Development: - Develop scalable backend architectures for AI-driven applications. - Design and maintain APIs, microservices, and data pipelines for AI integration. - Optimize performance, security, and scalability of AI backends. - Data Engineering & Processing: - Build ETL pipelines and real-time data integration workflows. - Work with SQL and NoSQL databases (PostgreSQL, MongoDB, Redis, etc.) to store and manage AI-related data. - AI Agent Development & Orchestration: - Implement AI agentic frameworks like LangChain, AutoGen, or similar. - Build multi-step AI workflows, decision trees, and context-aware agent architectures. - Collaboration & Innovation: - Work closely with data scientists, ML engineers, and backend developers for AI integration. - Stay updated with the latest AI trends in retrieval systems and backend optimizations. **What We're Looking For:** - Strong expertise in retrieval methods, ranging from traditional search techniques (regex, BM25) to vector-based retrieval. - Hands-on experience with LLMs, embeddings, and transformer-based models. - Proficiency in Python and backend development frameworks (FastAPI, Flask, Django). - Experience with AI agentic frameworks like LangChain, AutoGen, or similar. - Solid knowledge of SQL & NoSQL databases (PostgreSQL, MongoDB, Redis). - Understanding of data processing pipelines, ETL workflows, and real-time data integration. - Ability to solve complex AI problems and optimize large-scale AI applications. - Bonus: Research/publications in NLP, AI retrieval, or related fields. As an AI Engineer (Backend & NLP) at South Guild Tech, you will be part of a team that builds AI platforms redefining enterprise workflows in industries like healthcare, audit, and industrial automation. Your role involves developing high-performance AI applications, leveraging cutting-edge NLP models, and optimizing retrieval systems for intelligent automation at scale. **Key Responsibilities:** - Design & Develop AI-Driven Retrieval Systems: - Implement modern information retrieval techniques such as BM25, TF-IDF, dense vector search, and hybrid search using tools like FAISS, Pinecone, or Weaviate. - Build retrieval-augmented generation (RAG) pipelines for knowledge-based AI applications. - Natural Language Processing & AI Engineering: - Work with LLMs, transformers, and embedding models for NLP applications. - Optimize text processing, NER, text classification, and summarization tasks. - Implement fine-tuning and prompt engineering strategies for LLM-powered solutions. - Backend & API Development: - Develop scalable backend architectures for AI-driven applications. - Design and maintain APIs, microservices, and data pipelines for AI integration. - Optimize performance, security, and scalability of AI backends. - Data Engineering & Processing: - Build ETL pipelines and real-time data integration workflows. - Work with SQL and NoSQL databases (PostgreSQL, MongoDB, Redis, etc.) to store and manage AI-related data. - AI Agent Development & Orchestration: - Implement AI agentic frameworks like LangChain, AutoGen, or similar. - Build multi-step AI workflows, decision trees, and context-aware agent architectures. - Collaboration & Innovation: - Work closely with data scientists, ML engineers, and backend developers for AI integration. - Stay updated with the latest AI trends in retrieval systems and backend optimizations. **What We're Looking For:** - Strong expertise in retrieval methods, ranging from traditional search techniques (regex, BM25) to vector-based retrieval. - Hands-on experience with LLMs, embeddings, and transformer-based models. - Proficiency in Python and backend development frameworks (FastAPI, Flask, Django). - Experience with AI agentic frameworks like LangChain, AutoGen, or similar. - Solid knowledge of SQL & NoSQL databases (PostgreSQL, MongoDB, Redis). - Understanding of data processing pipelines, ETL workflow
