6 Annotation Workflows Jobs

Role Overview We are looking for AI Evaluation & Data Engineering Specialists to design, curate, and operationalize datasets and evaluation frameworks for AI product performance assessment. This role involves working with large language models (LLMs), human raters, and automation tools to measure model accuracy, correctness, and usability. Key Responsibilities Build and maintain evaluation datasets for AI models across programming languages (Python, Golang, JavaScript, Java). Develop and apply data labeling and scoring guidelines based on Google's evaluation framework. Implement LLM-judge calibration workflows to align automated and human evaluations. Perform error analysis, drift detection,...

About the Company G2i connects subject-matter experts, students, and professionals with flexible, remote AI training work such as annotation, evaluation, fact-checking, and content review. We partner with leading AI teams, and all contributions are paid weekly once approved, ensuring consistent and reliable compensation. About the Role We're hiring a Code Reviewer with deep JavaScript expertise to review evaluations completed by data annotators assessing AI-generated JavaScript code responses. Your role is to ensure that annotators follow strict quality guidelines related to instruction-following, factual correctness, and code functionality. Responsibilities Review and audit annotator evalua...

As an AI/ML Engineer, you will be responsible for leveraging your expertise in AI/ML to develop cutting-edge solutions. Here is a breakdown of what the role entails: **Key Responsibilities:** - Utilize your 6+ years of experience in AI/ML to develop innovative solutions - Demonstrate proficiency in Python and various ML libraries including scikit-learn, XGBoost, pandas, NumPy, matplotlib, and seaborn - Apply a strong understanding of machine learning algorithms and deep learning architectures such as CNNs, RNNs, and Transformers - Hands-on experience with TensorFlow, PyTorch, or Keras - Engage in data preprocessing, feature selection, EDA, and model interpretability - Comfortably develop API...

As a Technical Lead Manager (Applied AI Engineering), you will have the opportunity to lead a team of engineers and researchers while bridging advanced AI research with practical applications. You will be responsible for conducting in-depth studies, running proof-of-concept projects, and applying cutting-edge AI technologies to drive innovation. Your role involves collaborating with product and engineering teams, mentoring the AI team, establishing rapid experimentation processes, and championing a customer-centric approach. Key Responsibilities: - Lead advanced AI research and innovation through in-depth studies and proof-of-concept projects. - Address challenging technical problems and own...

As a VP/AVP AV/ADAS Delivery at iMerit, you will be leading the delivery organization supporting autonomous vehicle and ADAS clients. Your role will involve ensuring delivery excellence across a portfolio of enterprise clients by maintaining consistent quality, scalability, and efficiency of operations. Here is a breakdown of your key responsibilities: - **Delivery Leadership & Client Management:** - Own delivery for a portfolio of enterprise clients in AV/ADAS programs. - Drive robust delivery governance including QBRs, client health reviews, RCA/CPA, and CSAT improvement plans. - Establish SLA frameworks and ensure adherence across clusters. - Act as a strategic escalation point and lead i...

As an AI / ML Engineer, you will be responsible for utilizing your expertise in the field of Artificial Intelligence and Machine Learning to develop innovative solutions. You should hold a Bachelor's or Master's degree in Computer Science, Engineering, Data Science, AI/ML, Mathematics, or a related field. With a minimum of 6 years of experience in AI/ML, you are expected to demonstrate proficiency in Python and various ML libraries such as scikit-learn, XGBoost, pandas, NumPy, matplotlib, and seaborn. In this role, you will need a strong understanding of machine learning algorithms and deep learning architectures including CNNs, RNNs, and Transformers. Hands-on experience with TensorFlow, Py...