Product Manager/Product Owner

This is a fully remote position, open to applicants in New York.

📋 Description

• Evaluate and analyze AI-generated answers related to product-management and product-ownership inquiries.

• Examine specifications, release notes, user-facing content, stakeholder communications, PRDs, acceptance criteria, decision documents, and other relevant product documentation.

• Rate responses based on clarity, tone, usefulness, adherence to instructions, suitability for the audience, and ability to meet product requirements.

• Detect factual inaccuracies, internal contradictions, absent requirements, unsupported assumptions, and responses that do not address the core issue.

• Utilize professional product judgment to evaluate the quality and practicality of written outputs.

• Compose comprehensive rationales detailing evaluation scores and explaining the successes or failures of responses.

• Differentiate between superficial writing quality and genuine utility for executives, technical stakeholders, and end users.

• Offer precise, actionable feedback aimed at enhancing AI model performance.

• Implement consistent evaluation criteria across extensive amounts of content.

• Operate independently within organized remote evaluation workflows.

• Collaborate asynchronously with project managers, reviewers, and other expert contributors.

• Adhere to project-specific guidelines, rubrics, and quality standards.

• Resolve ambiguous evaluation scenarios through written rationale and professional judgment.

• Assist in maintaining consistency and accuracy within product-focused AI evaluation datasets.

⛳️ Requirements

• Professional experience as a Product Manager, Product Owner, or certified Product Owner.

• Solid background in cross-functional product development.

• In-depth practical knowledge of product management and product ownership.

• Extensive experience in authoring or assessing specifications, PRDs, acceptance criteria, release notes, decision documents, or similar product materials.

• Capability to evaluate content for executives, technical stakeholders, and end users.

• Exceptional written communication skills.

• Native-level proficiency in English.

• Ability to provide clear, detailed, and actionable feedback on technical or user-facing documentation.

• Strong attention to detail, critical analysis skills, and professional judgment.

• Capacity to work independently and reliably in remote, asynchronous project settings.

• Familiarity with AI model evaluation, RLHF, annotation, or structured content review workflows is a plus but not mandatory.

• Primary background should not be in project management, programme management, delivery management, or scrum leadership.

🏝️ Benefits

• Part-time independent contractor engagement.

• Fully remote work environment.

• Flexible project scope, workload, timing, and duration based on project needs.

• Remote, asynchronous project setting.

• No prior experience in AI is necessary.