Senior AI Backend Engineer - Agent Evaluation & Quality
Makkahremotesenior
Posted 3mo ago · via Workable
About this role
About the role We run production multi-agent systems that handle real work for a large base of users. As those systems grow, our biggest constraint is confidence: we need to know how well the agents perform, catch regressions before they ship, and keep quality steady as we release. This role owns that. You'll build the evaluation systems behind our agents - the judges, test harnesses, and simulators that tell us whether an agent is working and where it's failing. The goal is to let us ship agents faster because we can trust what the evaluation tells us. Evaluation is the focus, but it won't be the boundary.…
What we'd score you on
reqspace match rubricFive dimensions, recruiter-grade. Upload your resume and we'll generate a written explanation of where you fit and where the gaps are.
1
Skills match
For this role: typescript, python, langchain
2
Level fit
This role is senior-level. We check your trajectory against it.
3
Domain experience
Your work in the role's domain matters more than your years total. We weight recent and direct experience.
4
Recency
A skill you used last quarter weighs more than one from five years ago. We grade on recency, not lifetime.
5
Location fit
This role is remote-eligible. We factor in your stated location and time-zone overlap.
Score yourself on this role.
Free · no card · written explanation included
Skills in this role
Pulled from the job description. These are the keywords we'll weight when scoring your fit.
typescriptpythonlangchain
More at Salla
- View →Senior ML Backend Engineer - Search & RecommendationsMakkah, Makkah Province, Saudi Arabia
- View →Senior QA Engineer (Manual & Automation)Makkah, Makkah Province, Saudi Arabia
- View →Product Manager - StorefrontJeddah, Makkah Province, Saudi Arabia
- View →Business Continuity Specialist - PayLinkJeddah, Makkah Province, Saudi Arabia
- View →Data Protection Officer (DPO) - PayLinkMakkah, Makkah Province, Saudi Arabia
- View →Head of Cyber Security - PayLinkAl Khobar, Eastern Province, Saudi Arabia