28 Evaluation Metrics Jobs

Role: MLOps Engineer Location: Hyderabad Experience: 3 to 5 years Job details: ML pipeline creation, drift monitoring and control Automating CI/CD pipelines to account for data, code, and model changes Develop and deploy CI/CD-based automated ML application pipelines (collection, processing, cleaning, transformation, etc.) along with the CT component for a continuous feedback loop for re-training. Implement model evaluation and model + data validation tools/ techniques such as schema validation, evaluation metrics, etc. Querying and working with databases, testing ML models, Git and version control, and frameworks like Flask, and FastAPI. Develop and maintain schedulers to orchestrate and sc...

In this role, you will lead governance frameworks and drive adoption through communication, enablement, and active marketing campaigns including community building, hackathons, showcases, and enterprise social engagement to ensure safe, compliant, and high-impact use of AI across the organization. - Define, socialize, and maintain AI governance policies, standards, and guardrails aligned with regulatory and internal controls (e.g., model risk, data privacy, security, responsible AI principles). - Establish clear guidance for LLMs, RAG, prompt usage, data handling, and human-in-the-loop. - Operate and optimize AI risk assessment processes, model registers, and approval workflows. - Partner wi...

Are you an Arabic (Levantine) language specialist eager to shape the future of AI Large-scale language models are evolving from clever chatbots into powerful tools for communication, education, and cultural understanding. With high-quality training data, tomorrow's AI can accurately capture Levantine Arabic vocabulary, dialects, grammar, idiomatic expressions, and cultural contexthelping preserve linguistic heritage and support authentic interactions. That training data begins with youwe need your expertise to help power the next generation of AI. We're looking for Arabic (Levantine) language specialists who live and breathe phonetics, morphology, syntax, regional dialects, colloquial expres...

Who You Are You're an ML Research Engineer with 2+ years of experience who bridges the gap between cutting-edge research and production systems. You're passionate about training models that perform exceptionally well not just on benchmarks but in real-world applications. You enjoy diving deep into model architectures, experimenting with training techniques, and building robust evaluation frameworks that ensure model reliability in critical applications. Responsibilities ? Train and fine-tune models for speech recognition and natural language processing in multilingual healthcare contexts ? Develop specialized models through fine-tuning and optimization techniques for domain-specific tasks ? ...

vConstruct's Data Science & Analytics team is expanding its Generative AI capability. We're looking for an AI Developer who can design, build and ship production?ready solutions using large language models (LLMs), multimodal models and classic ML techniques (good to have). You'll join a collaborative group of AI Engineers, Data Scientists and Analysts transforming every stage of the construction lifecyclefrom pre?construction planning to post?handover operationsthrough automation and data?driven insights. What You'll Do Prototyping Frame GenAI use cases with experts; build quick LLM-based tools. Modeling Fine-tune/prompt models; use ML/DS when GenAI isn't ideal. Engineering Deploy models as ...

As an experienced HR professional with an MBA qualification, you will be responsible for various key aspects of the HR department. Your role will include: - Conducting performance and wage reviews. - Developing clear policies and ensuring policy awareness. - Creating clear and concise reports. - Giving helpful and engaging presentations. - Handling workplace investigations, disciplinary, and termination procedures. - Managing day to day operations of the HR dept. - Assisting in statutory filing in compliance with State law. - Managing employee benefits and compensation. - Monitoring employee morale and company culture and designing initiatives to enhance it. - Collaborating with the human re...

Are you an Arabic (Levantine) language expert eager to shape the future of AI Large-scale language models are evolving from clever chatbots into powerful tools for communication, education, and cultural understanding. With high-quality training data, tomorrow's AI can accurately capture Levantine Arabic vocabulary, dialects, grammar, idiomatic expressions, and cultural contexthelping preserve linguistic heritage and support authentic interactions. That training data begins with youwe need your expertise to help power the next generation of AI. We're looking for Arabic (Levantine) language specialists who live and breathe phonetics, morphology, syntax, regional dialects, colloquial expression...

Are you an Arabic (Gulf) language expert eager to shape the future of AI Large-scale language models are evolving from clever chatbots into powerful tools for communication, education, and cultural understanding. With high-quality training data, tomorrow's AI can accurately capture Gulf Arabic vocabulary, dialects, grammar, idiomatic expressions, and cultural contexthelping preserve linguistic heritage and support authentic interactions. That training data begins with youwe need your expertise to help power the next generation of AI. We're looking for Arabic (Gulf) language specialists who live and breathe phonetics, morphology, syntax, regional dialects, colloquial expressions, and cultural...

Are you an Arabic (Iraqi) language expert eager to shape the future of AI Large-scale language models are evolving from clever chatbots into powerful tools for communication, education, and cultural understanding. With high-quality training data, tomorrow's AI can accurately capture Iraqi Arabic vocabulary, dialects, grammar, idiomatic expressions, and cultural contexthelping preserve linguistic heritage and support authentic interactions. That training data begins with youwe need your expertise to help power the next generation of AI. We're looking for Arabic (Iraqi) language specialists who live and breathe phonetics, morphology, syntax, regional dialects, colloquial expressions, and cultu...

Are you a Nahuatl language expert eager to shape the future of AI Large-scale language models are evolving from clever chatbots into powerful tools for communication, education, and cultural preservation. With high-quality training data, tomorrow's AI can accurately capture Nahuatl vocabulary, grammar, dialectical variations, and cultural contexthelping preserve indigenous knowledge and support authentic linguistic interactions. That training data begins with youwe need your expertise to help power the next generation of AI. We're looking for Nahuatl language specialists who live and breathe regional dialects, phonetics, syntax, idiomatic expressions, oral traditions, and cultural references...

Are you an Aymara language expert eager to shape the future of AI Large-scale language models are evolving from clever chatbots into powerful tools for communication, education, and cultural preservation. With high-quality training data, tomorrow's AI can accurately capture Aymara vocabulary, grammar, dialectical variations, and cultural contexthelping preserve indigenous knowledge and support authentic linguistic interactions. That training data begins with youwe need your expertise to help power the next generation of AI. We're looking for Aymara language specialists who live and breathe regional dialects, phonetics, syntax, idiomatic expressions, oral traditions, and cultural references. ...

Are you an Odia language expert eager to shape the future of AI Large?scale language models are evolving from clever chatbots into powerful engines of linguistic discovery. With high?quality training data, tomorrow's AI can democratize world?class education, keep pace with cutting?edge research, and streamline communication and translation for speakers of Odia everywhere. That training data begins with youwe need your expertise to help power the next generation of AI. We're looking for Odia language specialists who live and breathe the complexities of Odia grammar, syntax, morphology, semantics, phonetics, and pragmatics. You'll challenge advanced language models on topics like dialectal var...

This is a 3 month contract role and is 100% remote, based in India. About the Role Pulse Labs is empowering insights and elevating experiences for the world's top technology companies. Backed by investors including Google and Amazon, we're revolutionizing product development delivering human-centered, actionable insights at every stage of the product lifecycle from inception to market release and beyond. We empower top tech companies to create and refine paradigm-shifting mobile, smart home, and AI products. We are seeking a Data Scientist to contribute to a short-term project focused on the evaluation of large language models (LLMs). The role will involve building and managing data pipeline...

As a Data Scientist at Lifease Solutions LLP, your main responsibility will be to develop machine learning and deep learning models for predicting match scores & outcomes, team & player performances, and statistics. You will also be involved in in-depth cricket analytics to analyze player form, team strengths, matchups, and opposition weaknesses. Additionally, you will work on data processing & engineering tasks, model deployment & MLOps, and performance metrics & model explainability. Key Responsibilities: - Develop ML/DL models for predicting match scores & outcomes, team & player performances, and statistics. - Implement time-series forecasting models (LSTMs, Transformers, ARIMA, etc.) fo...

Join Tether and Shape the Future of Digital Finance At Tether, we're not just building products, we're pioneering a global financial revolution. Our cutting-edge solutions empower businessesfrom exchanges and wallets to payment processors and ATMsto seamlessly integrate reserve-backed tokens across blockchains. By harnessing the power of blockchain technology, Tether enables you to store, send, and receive digital tokens instantly, securely, and globally, all at a fraction of the cost. Transparency is the bedrock of everything we do, ensuring trust in every transaction. Innovate with Tether Tether Finance: Our innovative product suite features the world's most trusted stablecoin, USDT , reli...

Interested can share there CVs at [HIDDEN TEXT] Job Summary The Incubation Manager is a dynamic professional responsible for driving the success of our start-up ecosystem by providing comprehensive support to emerging businesses, designing innovative program structures, and facilitating strategic collaborations. Key Responsibilities Program Designing: Develop comprehensive incubation program curricula Design and implement start-up mentorship frameworks Create evaluation metrics for startup progress and potential Research and integrate global best practices in startup incubation Collaborations: Identify and engage potential strategic partners Develop memorandums of understanding (MoUs) with a...

As a Lead DevOps Engineer at GrowExx, you will collaborate with cross-functional teams to define, design, and implement DevOps infrastructure while adhering to best practices of Infrastructure as Code (IAC). Your primary goal will be to ensure a robust and stable CI/CD process that maximizes efficiency and achieves 100% automation. - Analyze system requirements comprehensively to develop effective Test Automation Strategies for applications. - Design infrastructure using cloud platforms such as AWS, GCP, Azure, or others. - Manage Code Repositories like GitHub, GitLab, or BitBucket, and automate software quality gateways using Sonarqube. - Design branching and merging strategies. - Create CI...

Role Overview: You will have the opportunity to contribute to AI research that directly impacts the lives of billions of humans. Your responsibilities will include working on strategic workloads like M365 Copilot App, Outlook, Teams, Copilot Extensibility, and all productivity applications in M365. You will be part of a team that obsesses about powering workloads with AI and innovates on next-generation engineering infrastructure and tooling using AI. As a member of the team of Principal Applied Scientists, you will collaborate with other teams across Microsoft, lead feature crews, and embrace rapidly evolving innovations in the field. Key Responsibilities: - Master a broad area of research,...

You are a strategic thinker passionate about driving solutions in Data Science and LLM developer. You have found the right team. As a Data Science and LLM developer - Sr Associate in our Transformation and Analytics , you will spend each day defining, refining and delivering set goals for our firm. Job Responsibilities Implement various exploratory data analysis techniques . Analyze for Trends and Patterns . Identify key data sourcesthat can make business impacts. Scope, prioritize and co-ordinate activities with the product owners. Partner with product teams to identify strategicsolutions. Design and develop datamining queries from large data sets (Both Structured and Unstructured) . Experi...

Prismforce is a Vertical SaaS company at the forefront of revolutionizing the Talent Supply Chain for global Technology, R&D/Engineering, and IT Services companies. Through our AI-powered product suite, we aim to enhance business performance by facilitating operational flexibility, accelerating decision-making processes, and boosting profitability. Our ultimate mission is to establish ourselves as the premier industry cloud/SaaS platform for tech services and talent organizations worldwide. We are currently seeking a highly experienced Data Scientist to join our team in Bangalore within the AI & ML department. In this role, you will be instrumental in leveraging your expertise in Natural Lan...

As an AI Engineer specializing in Gen AI, NLP, and Python, you will be responsible for developing multiple product features utilizing Deep Learning, NLP, Graph analytics, Cognitive search, Image processing, Process Automation, LangGraph, and LangSmith. With 5 - 12 years of experience, you will leverage your expertise in Python and GenAI to scale the AI model capabilities effectively. Your role will involve working with Python Azure function, SQL DB, Cognitive search, Evaluation Metrics, RAGAS, and Advance RAG to enhance the functionalities and performance of AI models. You will collaborate with a team of professionals to design and implement innovative solutions that meet the requirements of...

You will be joining a European-based MNC that is transitioning its operations to Bangalore in a Hybrid work mode. As part of the team, you will need to demonstrate expertise in Core Machine Learning & Deep Learning. This includes a solid grasp of Transformer architectures such as ViT, CLIP, and BERT, as well as experience with contrastive learning techniques like SimCLR, MoCo, and CLIP. Additionally, knowledge of temporal embeddings and sequence modeling for video, fine-tuning large pre-trained models, and a comprehensive understanding of Deep Learning concepts will be essential for this role. Your technical and engineering skills should include proficiency in Python and deep learning framew...

As a Staff Data Scientist at Uber Eats, you will play a crucial role in enhancing the search experience for millions of users worldwide. Your deep statistical expertise will drive decision-making, improve product performance, and ensure that our evaluations and insights are based on methodological rigor. Your responsibilities will include conducting robust statistical analyses on complex datasets to identify product opportunities, shape roadmap priorities, and optimize user experiences in search. You will design and evaluate A/B tests and quasi-experiments, applying best practices in experimental methodology to ensure high-quality, unbiased insights. Building and maintaining statistical fram...

As a Deep Learning Engineer Intern, you will have the opportunity to work on our core ML stack, focusing on areas such as Computer Vision, Recommendation Systems, and LLM-based Features (optional). Working closely with our senior engineers, you will gain hands-on experience with real data, address edge-case challenges, and rapidly iterate on prototypes that drive our food-robotic machine. You will be an integral part of a focused 2-person full-time ML team, serving as our first intern and reporting directly to the Lead. This small team size ensures significant mentorship opportunities and allows you to make a direct impact on product development. Your responsibilities will include: - Working...

Job Summary: We are seeking a highly motivated and skilled Project Manager to lead and manage AI-driven projects from conception to deployment. The ideal candidate will bridge the gap between business, data science, and engineering teams, ensuring smooth project execution, alignment with business objectives, and timely delivery. This role requires a deep understanding of machine learning (ML) concepts and AI technologies, coupled with strong project management experience. Key Responsibilities: Project Planning & Execution: Lead the planning, execution, and delivery of machine learning and AI projects from ideation through production. Define project scope, goals, deliverables and timelines in...