4 Llm Evaluation Jobs

About the job: Key responsibilities: 1. Research and experiment with state-of-the-art AI models including GPT, BERT, Stable Diffusion, and other generative architectures 2. Fine-tune, evaluate, and deploy large language models (LLMs) for various AI-driven applications 3. Design and build AI agents capable of autonomous decision-making and task execution 4. Develop and optimize machine learning pipelines and datasets for training AI models 5. Collaborate with software engineers and data scientists to integrate AI models into products 6. Stay updated with the latest AI research, papers, and trends in generative AI and reinforcement learning 7. Participate in code reviews, design discussions, and knowledge sharing sessions within the team 8. Create documentation, tutorials, and reports on AI experiments and project outcomes Required Skills and Knowledge: 1. Demonstrate strong understanding of Artificial Intelligence concepts including machine learning (supervised, unsupervised, reinforcement learning), deep learning fundamentals (neural networks, CNNs, RNNs, transformers), large language models (LLMs) such as GPT, BERT, T5, generative AI techniques (GANs, VAEs, diffusion models), and AI agents and autonomous systems 2. Show proficiency in Python programming; experience with AI/ML frameworks such as TensorFlow, PyTorch, HuggingFace Transformers, or similar 3. Exhibit experience or academic exposure to natural language processing (NLP) and computer vision 4. Familiarity with prompt engineering, fine-tuning models, and evaluation metrics 5. Possess basic understanding of cloud platforms and AI APIs (AWS, Azure, Google Cloud, etc.) 6. Apply analytical mindset and strong problem-solving skills 7. Be self-driven with eagerness to learn new AI technologies and tools 8. Hold a bachelor's or higher degree in computer science, data science, AI/ML, or related technical field 9. Demonstrate proven hands-on experience with AI projects, research, or industry applications 10. Knowledge of ethical AI, bias mitigation, and AI safety considerations 11. Ability to work independently and collaboratively in a remote team environment 12. Exhibit good communication and documentation skills What We Offer: 1. Provide opportunity to work with cutting-edge AI and generative models 2. Collaborate with experienced AI researchers and engineers 3. Gain exposure to AI agents, LLMs, and the latest generative AI technologies 4. Work on real-world AI applications impacting diverse industries 5. Receive competitive salary and potential growth into leadership roles Note: This job is open to serious candidates committed to building a career in AI research and development Who can apply: Only those candidates can apply who: have minimum 1 years of experience can work from 8:00 am - 6:00 pm Indian Standard Time (as the company is based outside of India & their local work timings are 8:00 am - 6:00 pm India Standard Time) are Computer Science Engineering students Salary: ₹ 2,00,000 - 8,00,000 /year Experience: 1 year(s) Deadline: 2025-06-29 23:59:59 Other perks: 5 days a week Skills required: Python, Data Structures, Machine Learning, Data Science, Neural Networks, Natural Language Processing (NLP), Deep Learning, Artificial intelligence, Artificial Intelligence Markup Language (AIML) and LLM evaluation About Company: NetWit.ca is a Vancouver-based software and digital solutions company dedicated to empowering businesses with innovative technology and marketing strategies. We specialize in custom software development, mobile and web applications, CRM systems, and automation tools tailored to meet unique business needs. Alongside our software expertise, we offer data-driven digital marketing services to help clients generate leads, enhance online visibility, and drive growth. Our team combines technical excellence with creative problem-solving to deliver scalable solutions that streamline operations and accelerate success across industries. At NetWit.ca, we build technology that works for your business.

About the job: Key responsibilities: 1. Collaborate with founder and team leads on hiring needs, prepare job descriptions, post openings, screen candidates, conduct interviews, and handle offer rollouts 2. Oversee onboarding processes including offer letters, background checks, and orientation to ensure smooth integration of new hires 3. Build partnerships with academic institutions to source interns 4. Administer the end-to-end intern program including recruitment, training, performance tracking, and offboarding 5. Ensure accurate and timely tracking of timesheets and attendance, resolve discrepancies, and coordinate payroll processing with the finance team 6. Streamline cross-functional processes by monitoring project deadlines, communicating milestones, and providing staff workflow guidance 7. Manage founder's calendar, appointments, and meeting logistics for legal, PR, and internal events 8. Organize travel, logistics, and business documentation for court and PR events 9. Draft correspondence, meeting agendas, minutes, and action points while handling confidential communication professionally 10. Use ChatGPT and other AI tools to create pitch decks, presentations, client proposals, and prepare for meetings 11. Compile data reports and analyses for client briefs and explore AI solutions for workflow optimization 12. Support legal operations by managing case files, coordinating with clients, and assisting in documentation 13. Liaise with media, influencers, and partners for PR activities while maintaining positive client and vendor relationships 14. Maintain employee HR records, ensure compliance, and uphold confidentiality 15. Draft and disseminate HR policies, manage internal communications, and oversee office supplies and facilities 16. Plan company events, trainings, and team-building initiatives 17. Address staff concerns with fairness and confidentiality, promote a positive work culture, support performance reviews, and initiate well-being programs Requirements: 1. Hold a bachelor's degree in HR, Business Administration, or a related field or possess equivalent work experience 2. Have a minimum of 2 years of experience as an HR Generalist, Executive Assistant, or in a similar administrative role with exposure to legal or PR industries being a plus 3. Demonstrate familiarity with HRIS, ATS, and time-tracking systems 4. Be proficient in using MS Office and Google Workspace 5. Be comfortable using AI tools like ChatGPT for content creation, research, and reporting 6. Show strong organizational and multitasking abilities 7. Maintain discretion, integrity, and confidentiality 8. Exhibit excellent written and verbal communication skills 9. Be adaptable, proactive, and detail-oriented 10. Understand basic labor law, HR practices, and legal office procedures 11. Have familiarity with PR agency operations and media coordination 12. Show a willingness to learn and adopt AI-based efficiency tools Location: C-84, 2nd Floor, Sector 2, Noida (Near Sec 15 Metro Gate 3) Who can apply: Only those candidates can apply who: have minimum 1 years of experience Salary: ₹ 2,00,000 /year Experience: 1 year(s) Deadline: 2025-06-29 23:59:59 Other perks: Informal dress code, Free snacks & beverages Skills required: MS-Office, MS-Word, MS-Excel, Legal Research, Human Resources, Legal Drafting, English Proficiency (Spoken), English Proficiency (Written), Legal Writing and LLM evaluation About Company: URE Legal Advocates, founded in 1999, is a law firm specializing in corporate international tax, transfer pricing, GST, customs & trade, insolvency & bankruptcy code, SARFAESI, RDB Act, and MCS Act, with expertise in policy, disputes, and transaction advisory. We provide consulting services on tax litigation, tax investigations, and alternate dispute resolution (APA, MAP, and advance ruling), as well as civil litigation and white-collar crimes, while also acting as expert witnesses on treaty and transfer pricing law. Our senior partners offer strategic insights and legal advice on complex legal and tax matters, including pre-litigation and litigation support, representing clients before authorities such as ITAT, CBDT, CBIC, the Directorate of Revenue Intelligence (DRI), Central Bureau of Investigation (CBI), the Directorate of Enforcement (ED), DRT, and DRAT. Dostartup.in, urehr.com, and Ytpr.in also operate under URE Consulting LLP.

About the job: Voizer.ai is a cutting-edge AI-driven platform specializing in automation, voice technology, and intelligent workflows. We empower businesses with seamless AI integrations to enhance productivity and efficiency. Join our dynamic team to work on innovative automation solutions that redefine how businesses operate. Key responsibilities: 1. Design, develop, and deploy AI-powered automation workflows using n8n, Zapier, Make (Integrate), or similar tools. 2. Integrate AI models (NLP, LLMs, RPA) into business processes for enhanced efficiency. 3. Troubleshoot and optimize existing automations for performance and scalability. 4. Collaborate with developers, product managers, and business teams to identify automation opportunities. 5. Implement API-based integrations between SaaS platforms, databases, and AI services. 6. Monitor automation performance, logs, and error handling for reliability. 7. Stay updated with the latest trends in AI automation, RPA, and workflow orchestration. Requirements: 1. Django Rest Framework (DRF) (must-have). 2. Python & Django - Strong expertise in backend development. 3. PostgreSQL - Database management and optimization, and AWS. 4. Machine learning and strong knowledge of API integrations, webhooks, and cloud-based automation. 5. Experience with Python, JavaScript, or scripting for custom automations (preferred). 6. Ability to debug, optimize, and document automation workflows. 7. Strong problem-solving skills and attention to detail. 8. Excellent communication and teamwork abilities. 9. DevOps (CI/CD, Docker, Kubernetes) - Bonus. 10. Minimum 1 year of hands-on development experience. 11. Passionate about working on AI-driven projects. 12. Graduation in any specialization: B.A, B.Sc, B.P.Ed, B.El.Ed, B.Arch, B.B.A/B.M.S, 13. Diploma, B.Des., B.Tech/B.E., B.Ed, B.Com, or any equivalent degree. Nice-to-Have Skills: 1. Experience with voice-based AI automations (Voizer.ai's domain). 2. Knowledge of low-code/no-code platforms such as Retool, Bubble, or Appian. 3. Understanding of RPA tools like UiPath or Automation Anywhere. 4. Exposure to cloud platforms (AWS, GCP, Azure) and serverless functions. Why Join Voizer.ai? 1. Work on next-gen AI automation projects with real-world impact. 2. Collaborative in-office environment with a talented team. 3. Competitive salary, growth opportunities, and skill development. 4. Flexible work culture with cutting-edge tech stacks. Who can apply: Only those candidates can apply who: have minimum 1 years of experience are Computer Science Engineering students Salary: ₹ 3,25,000 - 4,50,000 /year Experience: 1 year(s) Deadline: 2025-06-19 23:59:59 Other perks: Informal dress code, Free snacks & beverages Skills required: Python, Django, Automation, Artificial intelligence, Django Rest Framework and LLM evaluation About Company: Join Our Team at Voizer.ai! World's First AI-Powered Conversational Caller AI callers can hold a conversation, empathize, and persuade just like our species, sometimes even better. It's comparable to hiring 10,000 sales reps who don't need to be managed, have unlimited memory, and work 24/7.

About the Role We're seeking a skilled Python QA Analyst to join our team focused on AI and agentic systems. In this role, you'll ensure the quality and reliability of our AI products while occasionally supporting agentic development during periods of lower QA workload. Key Responsibilities Design, implement and maintain comprehensive test suites for AI and agentic systems Create automated testing frameworks using Python to validate AI model outputs and behaviors Develop test cases that cover edge scenarios and potential failure modes in AI systems Perform thorough regression testing on new releases and feature updates Validate that AI systems meet functional requirements and performance benchmarks Document bugs with clear reproduction steps and expected behaviors Collaborate with AI engineers to understand model architectures and potential weak points Support the development team in troubleshooting and resolving identified issues Assist with agentic development projects during periods of lower QA workload Requirements Experience in software QA, with a focus on Python Strong Python programming skills and experience with testing frameworks (pytest, unittest) Understanding of AI concepts, machine learning workflows, and LLM evaluation techniques Experience testing complex systems with multiple integrations Familiarity with CI/CD pipelines and test automation Knowledge of version control systems (Git) Experience with bug tracking and project management tools Nice to Have Experience with AI-specific testing methodologies and evaluation metrics Understanding of LLM evaluation techniques (including hallucination detection, bias testing) Background in agentic system development or testing Experience with containerization (Docker) and orchestration tools Knowledge of API testing (Postman, requests) Familiarity with prompt engineering and prompt testing methodologies What You'll Do Develop comprehensive test plans for new AI features and systems Build and maintain automated test suites that validate model outputs against expected benchmarks Create specialized tests for agentic behaviors and decision-making processes Collaborate with cross-functional teams to define quality standards and acceptance criteria Participate in code reviews from a quality assurance perspective Contribute to agentic development projects when QA workload allows Help establish testing best practices for AI and agentic systems This position offers the opportunity to work at the cutting edge of AI quality assurance while developing skills in agentic system development. Join us in building reliable, high-quality AI products that our customers can trust.