Research Scientist
mid$150K – $200K
via Ashby
About this role
ABOUT THE ROLE
Develop benchmarks and evaluation methods for assessing advanced language models. This research and engineering role combines hands-on AI research with building practical evaluation systems, helping shape how models are tested before deployment.
WHAT YOU'LL DO
- Evaluate newly released AI models across a range of capabilities and use cases.
- Build benchmarks from the ground up, including dataset creation and coordination with labelers.
- Develop research findings and contribute to publications on evaluation methods.
- Improve automated methods for evaluating generated text.
- Work with engineering teams to implement and scale evaluation approaches in production systems.…
Read the full description on True Talent Solutions Partners's site →
What we'd score you on
reqspace match rubricFive dimensions, recruiter-grade. Upload your resume and we'll generate a written explanation of where you fit and where the gaps are.
1
Skills match
For this role: python, django, flask, pytorch, tensorflow…
2
Level fit
This role is mid-level. We check your trajectory against it.
3
Domain experience
Your work in the role's domain matters more than your years total. We weight recent and direct experience.
4
Recency
A skill you used last quarter weighs more than one from five years ago. We grade on recency, not lifetime.
5
Location fit
This role is based in a specific location. We weight your proximity and willingness to relocate.
Score yourself on this role.
Free · no card · written explanation included
Skills in this role
Pulled from the job description. These are the keywords we'll weight when scoring your fit.
pythondjangoflaskpytorchtensorflowgitteams