About this role
The team is seeking a skilled ML Data Associate III to join their AWS Quick team. In this role, you will be responsible for designing and executing linguistic test cases to validate Quick's natural language features across diverse inputs, edge cases, and user scenarios.
Key Responsibilities:
- Design and execute comprehensive linguistic test cases.
- Evaluate model outputs for accuracy, fluency, and relevance.
- Apply linguistic expertise to identify regressions, hallucinations, and quality gaps.
- Develop and maintain testing guidelines and rubrics for consistent evaluation standards.
- Analyze test results and report findings using Python and SQL.
Required Skills & Qualifications:
- Proficiency in Python and SQL for data analysis.
- Strong understanding of natural language processing concepts.
- Experience in designing test cases and evaluating linguistic models.
- Excellent analytical skills with attention to detail.
- Ability to work collaboratively in a team environment.
Experience:
- 3-5 years of relevant experience in machine learning or data analysis.
What we offer:
- Opportunity to work on cutting-edge technology in a dynamic environment.
- A collaborative team culture that values innovation and creativity.
- Professional development opportunities to enhance your skills.
Applications are read by our talent team, usually within two working days.
If you look like a fit we will call you, and you will hear from us either way.