- Product / AI Training
- Remote
- Hourly / Part-time
About the Role
Skill Stand In is looking for experienced product managers, product designers, and technical product professionals to review AI-generated web application specifications before they are used in model evaluation.
You will judge whether product requests are realistic, internally consistent, and clearly defined so AI-generated applications can be assessed against high-quality specifications.
What You’ll Do
- Review AI-generated product specifications for web applications.
- Evaluate whether product requests are realistic, complete, and unambiguous.
- Verify that later feature requests stay consistent with the existing product state.
- Check that product requirements line up with associated browser-based test scenarios.
- Identify inconsistencies, missing requirements, and unclear acceptance criteria.
- Provide structured written feedback using the project's review guidelines.
- Work independently and asynchronously to deliver high-quality evaluations.
What We’re Looking For
- Experience in product management, product design, technical product, UX, or a closely related role.
- Understanding of modern web applications and how product requirements turn into buildable, testable work.
- Experience reviewing PRDs, user stories, acceptance criteria, or similar specification documents.
- Ability to spot contradictions, missing constraints, and vague success criteria.
- Strong written communication and attention to detail.
Helpful Backgrounds
Experience in any of these areas is useful but not required.
- Product Management
- Product Design
- PRDs
- User Stories
- UX
- Software Engineering
- QA
Apply as Product Reviewer
Opens the application form in a new tab.