AI Agent Power User

This is a fully remote position, open to applicants in United States, +6 more locations.

📋 Description

• Execute intricate, multi-step professional scenarios utilizing AI assistants like ChatGPT and Claude.

• Simulate authentic business workflows that encompass analysis, communication, documentation, research, and operational tasks.

• Evaluate AI performance at each stage of a workflow.

• Determine if AI-generated outputs are beneficial, comprehensive, and actionable in practical terms.

• Rate AI-generated outputs based on established rubrics, quality criteria, and assessment standards.

• Examine responses for completeness, relevance, accuracy, clarity, and professional utility.

• Identify quality concerns, inconsistencies, and recurring patterns in model performance.

• Provide clear, constructive, and actionable feedback.

• Document workflow steps to ensure transparency and reproducibility.

• Articulate where and why AI performance excels or falters.

• Maintain thorough written records for AI research and product teams.

• Integrate AI assistants with workplace platforms like Google Drive, Gmail, Slack, and Notion.

• Test connected, multi-tool business processes.

• Evaluate realistic professional AI adoption and pinpoint opportunities to enhance reliability and usability.

⛳️ Requirements

• At least 5 years of professional experience in a business role involving technology-driven problem-solving.

• A completed Bachelor's degree or higher in any field.

• Consistent, hands-on experience with ChatGPT and/or Claude for actual professional tasks.

• Strong understanding of AI-assisted workflows, prompt-based tasks, and practical business applications.

• Experience in applying, creating, or reviewing evaluation rubrics, QA scorecards, grading criteria, or content-review guidelines.

• Experience in academic evaluation, quality assurance, hiring assessment, annotation, or similar structured review is a plus.

• Comfortable with integrating AI tools into workplace software and productivity platforms.

• Excellent proficiency in written English.

• Strong attention to detail, analytical judgment, and skills in process improvement.

• Capability to work independently within structured remote and asynchronous project settings.

• Located in the United States, Canada, United Kingdom, Ireland, Australia, or New Zealand.

• Authorized to perform contract work in the relevant country.

• No previous formal experience in AI research or model training is necessary.

🏝️ Benefits

• Part-time independent contractor arrangement.

• Fully remote position.

• Compensation ranging from $30 to $90 per hour.

• Flexible project scope, workload, timing, and duration based on project needs.