Senior Model Evaluation Analyst
Suitlandonsitesenior
Posted 4 days ago · via Workable
About this role
Ignite IT Hub is seeking a senior Model Evaluation Analyst to assess the accuracy and reliability of the U.S. Census Bureau's LLM Autocoder. You will maintain evaluation datasets, run comparisons, investigate coding errors, and produce evidence for Government review. Working with the contract’s Data Scientist and Government subject matter experts (SMEs), you will evaluate enhancements for the American Community Survey (ACS) and expansion to other surveys and fields. Responsibilities • Prepare and maintain versioned evaluation datasets, reference labels, and test cases with documented provenance and representative coverage of coding categories.…
What we'd score you on
reqspace match rubricFive dimensions, recruiter-grade. Upload your resume and we'll generate a written explanation of where you fit and where the gaps are.
1
Skills match
For this role: python, sql
2
Level fit
This role is senior-level. We check your trajectory against it.
3
Domain experience
Your work in the role's domain matters more than your years total. We weight recent and direct experience.
4
Recency
A skill you used last quarter weighs more than one from five years ago. We grade on recency, not lifetime.
5
Location fit
This role is based in Suitland. We weight your proximity and willingness to relocate.
Score yourself on this role.
Free · no card · written explanation included
Skills in this role
Pulled from the job description. These are the keywords we'll weight when scoring your fit.
pythonsql
More at Ignite
- View →Senior Technical LeadSuitland, Maryland, United States
- View →Senior AI/ML EngineerSuitland, Maryland, United States
- View →Senior Data ScientistSuitland, Maryland, United States
- View →Senior MLOps EngineerSuitland, Maryland, United States
- View →Jr. AI Prompt EngineerAshburn, Virginia, United States
- View →Cybersecurity SMEWashington, District of Columbia, United States