evaluation

EPAM Systems is seeking a Chief Software Engineer to lead the development of a next-generation AI-powered financial assistant platform. You will guide a small, senior team from design to production, shaping product direction while iterating rapidly with business users. You will design scalable systems, build Python backends with FastAPI, and implement robust...

Agency is seeking a Mathematics Specialist fluent in Spanish (Latin America) to train and evaluate AI models from a remote location. You will challenge models with classroom problems, verify correctness, capture error traces, and help improve prompts and evaluation methods. Ideal candidates hold a master’s or PhD in mathematics or related field and can...

Anyone AI Inc. is seeking mathematical experts to design rigorous, deterministic problems for frontier AI training and evaluation. You will craft questions with a single verifiable answer and provide full, verified solutions, including the reasoning steps. This remote, part-time role requires strong Python skills, mathematical modeling expertise, and precise...

BairesDev is seeking a Senior AI Engineer to contribute to an enterprise-scale AI platform, focusing on agentic architectures and multi-agent orchestration. You will design skill invocation, data retrieval strategies, and evaluation harnesses while collaborating with global engineering teams. The role emphasizes Python, LLM platforms, LangChain and...

EPAM Systems, Inc. seeks an AI Platform Software Engineering Manager to architect and deliver a next‑generation AI-powered financial assistant platform. You will lead a small, capable team and build production Python services and FastAPI APIs for scalable workloads. The role emphasizes end‑to‑end design, AI evaluation, robust security controls, and...

SpaceXAI is seeking a hands-on Leadership Lead for AI Tutors to guide data labeling and evaluation efforts, ensuring high-quality, scalable data production and strong adherence to guidelines. You will review work, coach a team, and collaborate with engineering to translate model needs into clear labeling strategies.The role emphasizes operational excellence,...

mercor is seeking an Internet-Native Bilingual Evaluator Expert (Spanish - Latin America) on a remote contract basis. You will evaluate AI outputs for accuracy in online communication, culture, and multilingual interactions, focusing on Latin American Spanish and English.Responsibilities include analyzing social media content for naturalness and cultural...

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Software Engineer, Quality based in Colombia. This role focuses on building the next generation of quality engineering through AI-powered testing and intelligent automation. You will design, build, and operate agents that...

  Job Title: Senior AI Agent Engineer Key Skills: Generative AI, Azure AI Foundry, Azure OpenAI, Copilot Studio, Python, Semantic Kernel, MCP, RAG, Prompt Engineering, Agent Evaluation, Guardrails Experience: 5+ YOE. Location: Costa Rica, Peru, Colombia, Bolivia Mode: Remote We at Coforge are hiring Senior AI Agent Engineer (#006fu00000bWsOCAA0-1) with the...

UN Information Systems Officer in Bogotá, Colombia, FS-6 grade, location Bogotá. The role oversees major information systems, directs analysis, design, development, testing and implementation of moderately complex systems, and participates in a team handling critical components. It also manages the Field Technology Unit budget, forms allocations,...

EPAM Systems, Inc. seeks a Chief Agentic AI Engineer to architect and run autonomous agent systems at scale with production-grade reliability. You will shape end-to-end agent workflows across runtime, memory, identity, tools, and observability while elevating evaluation, tracing, and guardrails. You will lead adoption of AWS Bedrock AgentCore and Strands...

Brightgrove Ltd. is seeking a Senior Translational AI Scientist/Engineer to design and deploy agentic AI systems for translational biology, spanning retrieval, orchestration, evaluation and deployment. You will partner with scientists to ensure mechanistic hypotheses and experimental designs are scientifically sound and evidence‑backed. The role...

Provectus seeks a senior Forward Deployed AI Engineer to embed with clients, learn their workflow from the inside, and rebuild capabilities from first principles. You will own the implementation of GenAI/LLM systems, co‑author evaluation plans, and drive production deployments on AWS. You will work in a remote-friendly setup, collaborating with executives...

Agency is seeking coding specialists fluent in Spanish (Latin America) to help shape next‑gen AI by testing and improving model reasoning and coding fluency. You will discuss software engineering topics, document errors, and contribute to evaluation prompts in a fully remote setting. The role emphasizes strong background in algorithms, data structures, and...

EPAM Systems is seeking a Senior Agentic AI Engineer to design, build, and operate autonomous agent systems at scale for production deployments. You will drive architecture decisions across runtime, memory, identity, tools, and observability, leading the use of AWS Bedrock AgentCore and Strands SDK across agent harnesses. You will design memory management,...

EPAM Systems is seeking an AI Platform Software Engineering Manager to build a next-generation AI-powered financial assistant platform. You will lead a small, capable team to iterate from problem discovery through design, delivery, and reliability. The role requires 8+ years of Python engineering, strong FastAPI, leadership, system design, and AI evaluation...

BairesDev is hiring a Senior Full-stack Python AI Engineer to own features end to end in an enterprise AI assistant, spanning agent and skill integrations, RAG pipelines, the API services behind them, and the frontend interface built on top. The role leans backend, but you’ll be in the frontend regularly, validating agent behavior against evaluation sets....

Commitment: 40 hours/week, with at least 4 hours overlap during PST business hoursRole ResponsibilitiesDesign and solve challenging Mathematics problems that test the reasoning and problem-solving capabilities of large language models.Create clear, high-quality, step-by-step solutions with detailed and well-structured reasoning.Develop novel mathematical...

Sigma .AI is seeking data annotation professionals to join our global remote team. You will perform categorization, annotation, transcription, evaluation, and other data quality tasks for AI applications.This freelance, contract-based role values attention to detail, fluent Colombian Spanish and English, and reliable internet access. Tablets/iOS not...

Celerity Fiber LLC in Colombia is seeking a Talent Acquisition Analyst to manage the full-cycle recruitment process for specialized roles, including Evaluation Specialist and Immigration Paralegal Agent. The ideal candidate communicates confidently in English and can conduct interviews remotely while based in Bogotá. You will source candidates via...