Agent Evaluation and Self-Improvement Engineer
USonsitemid$224K – $357K
Posted today · via Workday
About this role
Autonomous agents now do real work across NVIDIA, and every piece underneath them keeps changing: models, harnesses, tools, skills, and plugins. Evaluation is how a team knows whether a change made an agent better or quietly made it worse. We're looking for a principal engineer to set evaluation strategy at every layer, from individual skills and MCP servers to whole agents and products, and to design how agents use those results to improve themselves. Agents can already rewrite the skills and plugins they run on, then test whether the change helped. Making that loop trustworthy is the hard part. What does it take for an agent to get better on its own, and prove the improvement is real? We're building a system that answers that question for every agent at NVIDIA.…
What we'd score you on
reqspace match rubricFive dimensions, recruiter-grade. Upload your resume and we'll generate a written explanation of where you fit and where the gaps are.
1
Skills match
For this role: python, go, rust, teams, split
2
Level fit
This role is mid-level. We check your trajectory against it.
3
Domain experience
Your work in the role's domain matters more than your years total. We weight recent and direct experience.
4
Recency
A skill you used last quarter weighs more than one from five years ago. We grade on recency, not lifetime.
5
Location fit
This role is based in US. We weight your proximity and willingness to relocate.
Score yourself on this role.
Free · no card · written explanation included
Skills in this role
Pulled from the job description. These are the keywords we'll weight when scoring your fit.
pythongorustteamssplit
More at NVIDIA
- View →Product Marketing Management MBA Intern - Summer 2027US, CA, Santa Clara
- View →Machine Learning Engineer, GeForce G-AssistUS, CA, Santa Clara
- View →Senior System Software Engineer, Display SecurityUS, CA, Santa Clara
- View →Senior Staff Software Engineer - AI Agent PlatformUS, CA, Santa Clara
- View →Sales Operations AnalystUS, CA, Santa Clara
- View →Senior High Performance AI EngineerUS, CA, Santa Clara
