Experience: 2+ years
Job Type: Full-time (Contractual / Freelancing)
Location: Remote
Join our team as a Product Validation Expert and play a key role in ensuring that a widely used AI-powered consumer product deliver safe, accurate, and helpful experiences. You will design and implement evaluation processes to understand user perceptions.
Key Responsibilities:
- Design and develop robust rubrics for evaluating AI model outputs from a user experience (UX) perspective.
- Receive, analyze, and execute evaluation tasks focused on identifying potential issues that could lead to a poor user experience of this AI product.
- Collaborate closely with cross-functional teams to define and refine product validation criteria and safety standards.
- Translate user insights into actionable feedback for model improvement, focusing on accuracy, safety, and helpfulness.
- Document findings and recommendations with clarity, ensuring stakeholders understand the impact on end-user satisfaction.
- Continuously monitor evolving AI product usage and proactively identify emerging risks or concerns from a UX point of view.
Required Skills and Qualifications:
- Exceptional written and verbal communication skills, with a strong emphasis on clarity and precision.
- Ability to develop and apply evaluative frameworks that balance user experience, safety, and product performance.
- Strong analytical mindset and attention to detail when assessing user risks or usability issues.
- Comfort collaborating with diverse teams and adapting to fast-changing project requirements.
- Proficiency in documenting complex findings in a user-friendly and actionable manner.
Preferred Qualifications:
- Familiarity with current widely used AI consumer products and their typical user journeys.