Senior QA Analyst
Colombiaonsitesenior
via Greenhouse
About this role
Location: This position is remote within Colombia
We are seeking a Senior QA Analyst & AI Evaluation Strategist to plan, design, and execute test strategies for our rapidly expanding suite of agentic and AI-powered product features. This is a unique evolution of the traditional QA role. Instead of focusing solely on predictable, binary (pass/fail) code paths, you will specialize in evaluating probabilistic software. You won’t be building or training AI models from scratch; instead, your focus will be on the integrity, orchestration, and evaluation of the system. You will be responsible for defining how we test multi-agent workflows, curating test data, and validating that our analytical dashboards, APIs, and data lakes process non-deterministic data accurately and safely.…
What we'd score you on
reqspace match rubricFive dimensions, recruiter-grade. Upload your resume and we'll generate a written explanation of where you fit and where the gaps are.
1
Skills match
For this role: javascript, python, sql, bigquery, google cloud…
2
Level fit
This role is senior-level. We check your trajectory against it.
3
Domain experience
Your work in the role's domain matters more than your years total. We weight recent and direct experience.
4
Recency
A skill you used last quarter weighs more than one from five years ago. We grade on recency, not lifetime.
5
Location fit
This role is based in Colombia. We weight your proximity and willingness to relocate.
Score yourself on this role.
Free · no card · written explanation included
Skills in this role
Pulled from the job description. These are the keywords we'll weight when scoring your fit.
javascriptpythonsqlbigquerygoogle cloudclaudejira