evaluation

Investigate hard-to-find facts and verify information through credible sources. Design challenging research tasks to test AI models. Test AI model outputs and identify failures in search and reasoning. Analyze model search trajectories, source selection, and reasoning failures. Write clear benchmark prompts and accurate, primary-source-backed answer keys. ...

About Gramian Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs. About The Role We are seeking experienced...

YO AI Labs offers a remote contractor role focused on code generation and model evaluation. You will analyze real-world coding tasks, implement features, and provide feedback to improve AI systems. Strong programming skills across Python, Java, Rust, C++, Go, or TypeScript are valued, along with open-source collaboration and excellent problem-solving. You...

Rise Data Labs is seeking advanced Mathematics and Statistics experts to support the training and evaluation of state-of-the-art AI systems. You will apply deep quantitative knowledge to AI evaluation problems and assess AI-generated reasoning. This remote contract role requires a master's degree (PhD preferred) in a quantitative field and strong analytical...

YO AI Labs offers a remote contractor role focused on code generation and model evaluation. You will analyze real-world coding tasks, implement features, and provide feedback to improve AI systems. Strong programming skills across Python, Java, Rust, C++, Go, or TypeScript are valued, along with open-source collaboration and excellent problem-solving. You...

Rise Data Labs is seeking experienced finance professionals for a short-term AI training and evaluation project. We're looking for professionals with strong real-world finance expertise who can apply their knowledge and judgment to develop challenging finance tasks, evaluate AI-generated work, and establish clear criteria for high-quality responses. What...

Propio is seeking an Interpreter Quality Specialist to protect the quality of interpreting and support interpreters in achieving higher performance. You will evaluate performance, provide actionable feedback, and help maintain our quality framework across accuracy, confidentiality, and role boundaries. The role emphasizes strong judgment, attention to...

AI Evaluation SpecialistRole Type: ContractorLocation: Remote — US, Canada, UK, Ireland, Australia, New ZealandWe are seeking experienced AI Evaluation Specialists to assess and improve the quality of AI assistant outputs for an enterprise AI training project.You'll evaluate AI-generated responses using defined quality standards, identify issues, and...

About Gramian Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs. About The Role We are seeking experienced Subject...

Investigate hard-to-find facts and verify information through credible sources.Design challenging research tasks to test AI models.Test AI model outputs and identify failures in search and reasoning.Analyze model search trajectories, source selection, and reasoning failures.Write clear benchmark prompts and accurate, primary-source-backed answer...

YO AI Labs is seeking a Research Engineer to contribute to code generation, software engineering, and AI model evaluation. The role involves developing, reviewing, and evaluating real-world coding tasks to train next-generation AI systems. No prior AI experience is required. The work is remote and contract-based, with emphasis on delivering high-quality code...

YO AI Labs is seeking an AI Evaluation Specialist as a remote contractor to assess and improve the quality of AI assistant outputs for our enterprise training projects. You will evaluate responses against detailed rubrics, identify errors, and provide concise, actionable feedback. This role emphasizes consistency, fairness, and clear documentation while...

Crossing Hurdles is seeking a PhD-level mathematician to design and solve challenging mathematical problems that probe the reasoning abilities of large language models. You will create clear, step-by-step solutions with detailed reasoning and develop novel scenarios to evaluate complex pathways. You will also provide annotations to improve model performance...

Anyone AI is seeking skilled software engineers to work as project consultants on a remote, part-time basis. You will design and evaluate realistic coding tasks, including bug fixing, feature implementation, refactoring, and test generation. Contributors will create complex coding scenarios, write clear specifications and reference implementations, and...

YO AI Labs is seeking an AI Evaluation Specialist as a remote contractor to assess and improve the quality of AI assistant outputs for our enterprise training projects. You will evaluate responses against detailed rubrics, identify errors, and provide concise, actionable feedback. This role emphasizes consistency, fairness, and clear documentation while...

YO AI Labs is seeking a Research Engineer to contribute to code generation, software engineering, and AI model evaluation. The role involves developing, reviewing, and evaluating real-world coding tasks to train next-generation AI systems. No prior AI experience is required. The work is remote and contract-based, with emphasis on delivering high-quality...

Anyone AI is seeking skilled software engineers to work as project consultants on a remote, part-time basis. You will design and evaluate realistic coding tasks, including bug fixing, feature implementation, refactoring, and test generation. Contributors will create complex coding scenarios, write clear specifications and reference implementations, and...

Crossing Hurdles is seeking a diligent Research/QA benchmark analyst to verify information through credible sources and design demanding tasks for testing AI models. You will test outputs, analyze search trajectories, and craft precise benchmark prompts with primary-source-backed keys. The ideal candidate has strong OSINT skills, experience with AI...

Alignerr is seeking Software Engineers to join a fully remote, hourly contract role in the Coffee Region tech community. You will build, evaluate, and improve AI-generated code, reviewing AI outputs and providing expert feedback to enhance safety, reliability, and quality. Flexible, asynchronous work fits writers who code and think clearly. We welcome...

Anyone AI is seeking skilled software engineers to work as project consultants on a remote, part-time basis. You will design and evaluate realistic coding tasks, including bug fixing, feature implementation, refactoring, and test generation. Contributors will create complex coding scenarios, write clear specifications and reference implementations, and...