Test Analyst

hace 5 días


Medellín, Antioquia, Colombia Third Way Health A tiempo completo
About the position

We're looking for a full-time Test Analyst to join our team in Medellín, Colombia. As a Test Analyst, your primary responsibility will be to conduct thorough testing of voice-based applications, assessing usability, functionality, and performance of AI-driven patient engagement tools. You'll be at the forefront of testing innovative AI technology that directly impacts patient care, working with cutting-edge voice AI systems in a supportive, learning-focused environment.

Key Responsibilities
  • Collaborate with product managers, engineers, and analysts to establish targets and processes for continuously improving system reliability, with a focus on voice interactions and AI-generated responses.
  • Design, document, and execute comprehensive test plans for voice-based patient interactions, including system monitoring and data validation to ensure AI responses meet functional and non-functional requirements.
  • Partner with engineers and business owners to identify, triage, and address issues with AI-driven interactions, data quality, and software performance, and then implement improvements to preempt similar defects.
  • Ensure testing processes comply with healthcare data privacy requirements and patient safety standards.
  • Contribute as an integral member of Agile teams, including daily stand-ups, sprint planning, and retrospectives.
  • Learn and apply emerging voice testing methodologies and AI evaluation techniques, with mentorship from our engineering team.
Required Skills and Qualifications
  • Bachelor's degree in technical field (e.g., Computer Science, Information Systems).
  • 3-4 years of software testing experience, including automated testing and API testing.
  • Experience with test management tools (Jira, TestRail) and basic scripting/programming skills.
  • Strong analytical skills, with the ability to evaluate voice-based interactions, identify sources of errors, and implement improvements.
  • Experience testing user interfaces and evaluating user experience quality.
  • Excellent English communication skills for collaborating with distributed teams.
Desired Skills and Qualifications
  • Experience with automated testing for AI-driven applications and voice UI systems.
  • Experience working with voice UI testing tools and platforms, with a focus on evaluating speech generation and response quality.
  • Knowledge of accessibility testing and inclusive design principles
  • Interest in AI/ML testing methodologies and prompt engineering
  • Interest in AI security testing, including methods for jailbreaking guardrails and adversarial testing of AI-generated responses.
  • Understanding of healthcare compliance requirements (HIPAA) and patient data sensitivity.
  • Proficiency in Spanish in addition to English; additional languages are a plus for testing diverse patient interactions.
  • Experience working with distributed teams across time zones.

  • Senior QA Analyst

    hace 1 semana


    Medellín, Antioquia, Colombia HugeInc A tiempo completo

    Location: This position is remote within ColombiaSenior QA AnalystAbout Senior QA Analyst at HugeSenior QA Analyst at Huge is a critical pillar in how we deliver meaningful, reliable, and scalable digital experiences for some of the world's most respected brands. Guided by our belief in designing and building for people, not just users, our QA teams ensure...

  • 1458-QA Analyst

    hace 6 días


    Medellín, Antioquia, Colombia SOFTGIC S.A.S. A tiempo completo

    We are seeking QA Analysts to help ensure the quality and reliability of a financial technology platform. Ideal candidates are detail-oriented, strong communicators, and skilled testers who are eager to work on complex integrations with major payroll systems. This role requires solid problem-solving abilities, a meticulous approach to quality, and a...

  • CX Operations Analyst

    hace 1 semana


    Medellín, Antioquia, Colombia Recurly A tiempo completo

    About Recurly:Recurly, Inc., a SaaS company, provides a versatile subscription management platform to manage the entire subscription lifecycle for market-leading brands worldwide. Subscription businesses such as Sling TV, FabFitFun, Cinemark and depend on Recurly to harness the power of the subscription model and drive recurring revenue growth. Since its...


  • Medellín, Antioquia, Colombia Archie Labs A tiempo completo

    We are looking for aNetwork Operations Analyst (L3) - This position is open only to candidates based in Latin AmericaPerforms more advanced triage and deeper analysis for escalated incidents.Executes more complex or higher‑risk changes during maintenance windows.Coordinates with network engineering teams where needed (while not owning design).The scope of...


  • Medellín, Antioquia, Colombia Archie Labs A tiempo completo

    We are looking for a Network Operations Analyst (L3) - This position is open only to candidates based in Latin America Performs more advanced triage and deeper analysis for escalated incidents. Executes more complex or higher‑risk changes during maintenance windows. Coordinates with network engineering teams where needed (while not owning design). The...

  • QA Analyst

    hace 5 días


    Medellín, Antioquia, Colombia SD Solutions A tiempo completo

    The QA Analyst will evaluate and execute procedures for maintaining high standards of quality and reliability for all software developed. This position is responsible for developing and executing tests on new and existing products to ensure that they meet requisite functional and technical compliance and maintain high overall product quality. Test Engineers...


  • Medellín, Colombia Roca Alliances S.A A tiempo completo

    We are currently seeking an End-to-End Testing Analyst**for our office located in **Medellin, Colombia**. **Location**: Medellin, Colombia **Roca Alliances** is a specialized recruitment firm in the tech sector, connecting top talent with leading global companies. We provide tailored hiring solutions, ensuring the perfect match for each role. Our deep...


  • Medellín, Colombia Viamericas A tiempo completo

    Viamericas is a #1 ranked and licensed money transmitter offering international money transfer, bill payment, check processing and a variety of other services at thousands of agent locations across the United States, and 287,885 locations in 95 countries. At Viamericas, our ultimate objective is to help immigrants succeed and improve their lives by providing...

  • Assistant Analyst

    hace 1 semana


    Medellín, Colombia PRGX Global, Inc A tiempo completo

    **Job Title** **Assistant Analyst I** **Employment Type** Full-time **Work Authorization Requirements** Authorized to work in Medellin without sponsorship **Language Requirements** English **About PRGX** **Job Duties & Responsibilities** - Utilizes appropriate audit concepts and proprietary tools/reports to conduct audit by examining a client’s...

  • Cx Operations Analyst

    hace 1 semana


    Medellín, Colombia Recurly A tiempo completo

    About Recurly: Recurly, Inc., a SaaS company, provides a versatile subscription management platform to manage the entire subscription lifecycle for market-leading brands worldwide. Subscription businesses such as Sling TV, FabFitFun, Cinemark and Fubo.tv depend on Recurly to harness the power of the subscription model and drive recurring revenue growth....


  • Medellín, Colombia Archie Labs A tiempo completo

    We are looking for a Network Operations Analyst (L3) - This position is open only to candidates based in Latin America Performs more advanced triage and deeper analysis for escalated incidents. Executes more complex or higher‑risk changes during maintenance windows. Coordinates with network engineering teams where needed (while not owning design). The...

  • CX Operations Analyst

    hace 5 días


    Medellín, Colombia Recurly A tiempo completo

    About Recurly: Recurly, Inc., a SaaS company, provides a versatile subscription management platform to manage the entire subscription lifecycle for market-leading brands worldwide. Subscription businesses such as Sling TV, FabFitFun, Cinemark and Fubo.tv depend on Recurly to harness the power of the subscription model and drive recurring revenue growth....


  • Medellín, Colombia Archie Labs A tiempo completo

    We are looking for a Network Operations Analyst (L3) - This position is open only to candidates based in Latin America Performs more advanced triage and deeper analysis for escalated incidents. Executes more complex or higher‑risk changes during maintenance windows. Coordinates with network engineering teams where needed (while not owning design). The...

  • Service Desk Analyst

    hace 1 semana


    Medellín, Colombia Talentek By Hubtek A tiempo completo

    **Description**: **Talentek by Hubtek** is a company that believes in young talent and seeks to support the development of its employees on a personal and professional level through learning experiences and growth opportunities. We support companies through our Talent and Technology services. We have been impacting the world **since 2018** and we want to...

  • Commercial Analyst

    hace 5 días


    Medellín, Colombia PRGX Global, Inc A tiempo completo

    **ABOUT PRGX** **PRGX -**Headquartered in Atlanta, Georgia, PRGX Global, Inc. is the world's leading provider of recovery audit services. The Company operates and serves clients in more than 30 countries with over 1,600 employees and provides its services to over 75% of the top 20 global retailers. PRGX provides a unique combination of audit, analytics and...