Senior Data Scientist

How is this team contributing to vision of Providence?

Ensure a continual and seamless service for customers regardless of which services they access.

What will you be responsible for?

• End-to-end development and quality of solutions and services in conversational & Agentic AI capability
• Understanding and Implementing advanced techniques in Agentic AI & Conversational AI Frameworks.
• Introduce best practices in AI Frameworks.

What would your day look like?

• Lead the design and development of Agentic AI Frameworks, models and systems, ensuring high performance and scalability.
• Good in Python, RestAPI and data structure skills
• Fine-tune and optimize pre-trained large language models (LLMs) such as GPT, LLAMA, Falcon, and Mistral.
• Implement and manage model quantization techniques (e.g., GPTQ, AWQ, 8-bit/4-bit models) to enhance model efficiency.
• Utilize Langchain, Dagster etc for orchestration and memory management in agentic applications.
• Conduct thorough model evaluations using metrics such as BLEU, ROUGE, and perplexity to ensure model quality and performance.
• Develop and maintain systems for intent recognition, entity extraction, and generative dialogue management.
• Stay updated with the latest advancements in NLP and AI technologies and apply them to ongoing projects.
• Mentor and guide junior engineers, fostering a culture of continuous learning and innovation.

Who are we looking for?

• Minimum 6 years of experience in Programming Languages & AI Platforms
• Strong understanding of deep learning fundamentals, including LSTM, RNN, ANN, POS tagging, and Transformer models.
• Strong understanding and proficiency in Agentic AI Frameworks.
• Proven experience in fine-tuning pre-trained LLMs (e.g., GPT, LLAMA, Falcon, Mistral) and Quantization.
• Knowledge of model quantization techniques (GPTQ, AWQ, 8-bit/4-bit models).
• Proficiency in using orchestration frameworks, state and memory management.
• Experience with model evaluation metrics such as BLEU, ROUGE, and perplexity.
• Understanding of intent recognition, entity extraction, and generative dialogue management systems.
• Excellent problem-solving skills and the ability to work in a fast-paced, collaborative environment.
• Strong communication skills and the ability to convey complex technical concepts to non-technical stakeholders.
• Good Understanding with Azure AI Foundary, Azure AI search, Indexing
• Knowledge in Kubernetes is good to have.
• Knowledge of Microsoft Event Hubs or Kafka Technologies
• Experience with load testing and unit testing tools.
• Proficient understanding source control and code versioning tools such as GIT, Azure DevOps etc.
• Familiarity with CICD and DevOps.