A
AmazonMachine Learning Data Operatio

ML Data Associate III, AWS Quick

INonsitejunior

Posted today · via Amazon

About this role

Design and execute linguistic test cases to validate Quick's natural language features across diverse inputs, edge cases, and user scenarios. Evaluate model outputs for accuracy, fluency, and relevance by applying linguistic expertise to identify regressions, hallucinations, and quality gaps. Develop and maintain testing guidelines and rubrics that ensure consistent, repeatable evaluation standards across annotators and test cycles. Analyze test results and report findings using Python and SQL to surface patterns, quantify defect rates, and prioritize issues for engineering teams.…

Read the full description on Amazon's site →

What we'd score you on

reqspace match rubric

Five dimensions, recruiter-grade. Upload your resume and we'll generate a written explanation of where you fit and where the gaps are.

1

Skills match

For this role: python, sql, aws

2

Level fit

This role is junior-level. We check your trajectory against it.

3

Domain experience

Your work in the role's domain matters more than your years total. We weight recent and direct experience.

4

Recency

A skill you used last quarter weighs more than one from five years ago. We grade on recency, not lifetime.

5

Location fit

This role is based in IN. We weight your proximity and willingness to relocate.

Score yourself on this role.
Free · no card · written explanation included
See if I'm a fit →

Skills in this role

Pulled from the job description. These are the keywords we'll weight when scoring your fit.

pythonsqlaws

More at Amazon

See all open jobs at Amazon →