evaluation

Crossing Hurdles is seeking a PhD-level mathematician to design and solve challenging mathematical problems that probe the reasoning abilities of large language models. You will create clear, step-by-step solutions with detailed reasoning and develop novel scenarios to evaluate complex pathways. You will also provide annotations to improve model performance...

Anyone AI is seeking skilled software engineers to work as project consultants on a remote, part-time basis. You will design and evaluate realistic coding tasks, including bug fixing, feature implementation, refactoring, and test generation. Contributors will create complex coding scenarios, write clear specifications and reference implementations, and...

Anyone AI is recruiting experienced Software Engineers for a specialized project focused on reviewing and evaluating real-world software engineering tasks derived from open-source repositories. The work involves assessing whether coding tasks based on real GitHub issues and pull requests are technically sound, reproducible, appropriately tested, and...

Location: RemotePosition Type: Contract / Freelance (Subcontractor)Experience: 5+ years About reimagine collective reimagine collective partners with nonprofits, foundations, public agencies, coalitions, and movement leaders to strengthen strategy, evaluation, storytelling, and organizational learning in ways that advance equity and social change. ...

reimagine collective is seeking thoughtful, collaborative evaluators for a remote contract/subcontractor roster. The role emphasizes equity, community learning, and translating findings into accessible insights that help partners share impact. We value experience with nonprofit sectors, participatory approaches, and the ability to work independently within a...

Job Description – Evaluation Specialist (Bilingual)PositionEvaluation SpecialistLocationRemote-Cali ValleScheduleMonday through Friday42 hours per week1-hour lunch breakTwo 10-minute breaksCompensationCOP 2,500,000 per month, plus the opportunity to earn up to COP 500,000 in performance-based bonuses.About the RoleWe are looking for a bilingual...

Job Purpose: CORE (Community Organized Relief Effort) is a global crisis response organization dedicated to delivering immediate aid and supporting long-term recovery in underserved communities. Our mission is to save lives and strengthen communities affected by or at risk of crisis. CORE is seeking a Monitoring & Evaluation Officer to support the CORE...

Prestador de Servicios   Buscamos talentos que amen los retos, que quieran crecer y llevar sus proyectos al siguiente nivel, personas con amplia capacidad de trabajo en equipo, flexibilidad para adaptarse a ambientes dinámicos de trabajo y, especialmente, con la mejor disposición para generar conexiones valiosas. Para este cargo requerimos este...

Help shape the future of AI by evaluating and comparing responses from advanced AI models.Location: RemoteCommitment: up to 3 monthsCompensation: $7-$12/hourAbout the roleAt Anyone AI, we create high-quality training and evaluation data for frontier AI models.We’re looking for English-fluent experts with strong writing skills, critical thinking, and...

Quality Evaluator – English Help shape the future of AI by evaluating and comparing responses from advanced AI models. Location: Remote Type: Independent contractor / Part-time Commitment: up to 3 months Compensation: $7-$12/hour About the role At Anyone AI, we create high-quality training and evaluation data for frontier AI models....

Quality Evaluator – English Help shape the future of AI by evaluating and comparing responses from advanced AI models. Location: Remote Type: Independent contractor / Part-time Commitment: up to 3 months Compensation: $7-$12/hour About the role At Anyone AI, we create high-quality training and evaluation data for frontier AI models. We’re...

Quality Evaluator – English Help shape the future of AI by evaluating and comparing responses from advanced AI models. • Location: Remote • Type: Independent contractor / Part-time • Commitment: up to 3 months • Compensation: $7-$12/hour About The Role At Anyone AI, we create high-quality training and evaluation data for frontier AI...

YO AI Labs seeks experienced Product Manager or Product Owner contractors for an autonomous, remote evaluation project focused on AI-generated content, specifications, and documentation. No prior AI experience is required, and the role emphasizes evaluation quality. Responsibilities include analyzing and commenting on clarity, accuracy, tone, and usefulness...

Electronic Arts' Maxis studio seeks a Development Director I to lead Experiential Quality, guiding how features and gameplay are evaluated from a player perspective. You will establish the operating model turning player-focused evaluation into actionable product insights. The role collaborates with Development, Production, and Quality leaders to translate...

YO AI Labs is seeking experienced AI Evaluation Specialists to assess and improve the quality of AI assistant outputs for an enterprise AI training project. You will evaluate AI-generated responses against detailed rubrics for accuracy, relevance, quality, and guideline adherence, applying consistent judgment across large volumes. This remote contractor...

Quality Evaluator – English Help shape the future of AI by evaluating and comparing responses from advanced AI models. Location: Remote Type: Independent contractor / Part-time Commitment: up to 3 months Compensation: $7-$12/hour About the role At Anyone AI, we create high-quality training and evaluation data for frontier AI models. We’re looking for...

Technical Writer / Editor Role Type: Contractor Location: United States, Canada, United Kingdom We are seeking experienced Technical Writers / Editors to contribute to a customer project focused on evaluating and improving advanced AI systems. You’ll use your expertise in writing, editing, and critical analysis to evaluate AI-generated content and help...

Technical Writer / Editor Role Type: Contractor Location: United States, Canada, United Kingdom We are seeking experienced Technical Writers / Editors to contribute to a customer project focused on evaluating and improving advanced AI systems. You’ll use your expertise in writing, editing, and critical analysis to evaluate AI-generated content and help...

Job Title: Senior AI QA Automation Engineer Key Skills: Python, AI Testing, Test Automation, Playwright, Selenium, API Testing, Azure AI Foundry Evaluations, RAG Evaluation, Prompt Testing, CI/CD, Monitoring Experience: 5+ YOE. Location: Costa Rica, Peru, Colombia, Bolivia. Mode: Remote We at Coforge are hiring Senior AI QA Automation Engineer...

Job Title: Senior AI QA Automation Engineer Key Skills: Python, AI Testing, Test Automation, Playwright, Selenium, API Testing, Azure AI Foundry Evaluations, RAG Evaluation, Prompt Testing, CI/CD, Monitoring Experience: 5+ YOE. Location: Costa Rica, Peru, Colombia, Bolivia. Mode: Remote We at Coforge are hiring Senior AI QA Automation Engineer...