
Prototyping and Tools Developer
Posted 9 hours ago

Posted 9 hours ago
This is a fully remote position, open to applicants in United States.
• Develop and sustain internal tools that assist authors, the content team, and authoring workflows.
• Collaborate with subject matter experts and stakeholders to transform concepts into functional prototypes.
• Work alongside the platform team on tools designed for both instructors and students.
• Enhance and resolve issues in existing software, including tools not initially developed by you.
• Convert user and stakeholder feedback into actionable tasks.
• Make and articulate technical decisions clearly.
• Adhere to platform standards while producing clear, documented prototypes suitable for handoff.
• Utilize AI coding assistants to create tools, ensuring ownership of design, quality, and accuracy.
• Review and assess code generated by AI.
• Share effective AI workflows with the team.
• Integrate LLM APIs, focusing on prompt design, testing, and enhancement.
• Construct and conduct evaluations of prompt and model quality.
• Employ observability and evaluation tools to monitor performance and identify regressions.
• Assess new models, tools, and methodologies.
• Collaborate with Content leads to set priorities and define scope.
• Work together with product, platform, and engineering teams.
• Gather insights and clarify technical trade-offs for non-technical audiences.
• Document tools, decisions, and workflows for handoff, scalability, or maintenance.
• Contribute to the enhancement of processes.
• Proven experience in building web applications, demonstrated through completed projects, repositories, or demos.
• Hands-on experience with LLM APIs, prompt engineering, and a systematic approach to prompt testing (the fundamentals of evaluations).
• Solid understanding of code execution.
• Practical experience with AI coding assistants, including discernment about when to rely on their outputs.
• Exceptional communication abilities.
• Comfort in operating within established platform constraints and standards.
• A curious, iterative, and collaborative mindset, with ease in navigating ambiguity.
• Preferred: Bachelor’s degree in Computer Science or a related discipline.
• Preferred: Experience with AI observability and evaluation platforms (e.g., Braintrust, Langfuse).
• Preferred: Experience in designing evaluations and refining prompts based on outcomes.
• Preferred: Background in edtech or content-tooling environments.
• Preferred: Teaching experience, especially in STEM or related fields.
• Preferred: Experience in developing browser extensions.
• Preferred: Experience collaborating closely with non-technical stakeholders.
• Resume/CV required.
• Links to relevant repositories, live projects, or demos are requested.
• Meeting-free Friday afternoons.
• Opportunities for professional development.
• Comprehensive benefits package.
• Reasonable accommodations for applicants with disabilities.
• Ongoing learning and internal mobility.
• Employee programs that support community, learning, and personal growth.
Talan
Ryder System, Inc.
1Password
Gainwell Technologies
Get handpicked remote jobs straight to your inbox weekly.