
Forward Deployed AI Engineer – AI, Reliability and Trust
Posted 11 hours ago

Posted 11 hours ago
This is a fully remote position, open to applicants in Canada.
• Customize guardrails according to each partner's policies, regulatory requirements, risk tolerance, and languages.
• Develop protective measures for sensitive information and actions, which include data masking, identity verification, and customer consent management.
• Adjust guardrails to effectively mitigate real risks while ensuring legitimate customers are not hindered.
• Conduct red-team assessments prior to launch and following significant modifications.
• Create and manage ongoing automated adversarial testing suites.
• Translate findings into engineering improvements and regression testing protocols.
• Oversee partner security questionnaires, architecture evaluations, and AI/model-risk assessments.
• Maintain documentation of AI data, access, and decision-making processes for regulatory compliance and auditing purposes.
• Take ownership of deployment go-live checklists, testing protocols, sign-off criteria, and rollback strategies.
• Enhance automated testing across products and various model, prompt, and configuration updates.
• Facilitate partner user acceptance testing and address pre-launch challenges.
• Direct security and privacy measures for partner data access and secure integration with partner systems.
• Establish guidelines for partner data handling, storage, separation, and deletion.
• Oversee production deployments to ensure quality, reliability, and to mitigate abuse and safety failures.
• Collaborate with engineering teams to establish dashboards and alert systems.
• Lead responses to safety or security incidents and manage partner communications.
• Work in conjunction with Research, Product, and Security teams to ensure secure launch processes.
• Develop reusable guardrails, testing frameworks, and documentation based on each deployment.
• 5+ years of experience in security engineering, application security, AI safety, quality engineering, or site reliability, with practical experience maintaining secure and operational production systems.
• Hands-on experience in red-teaming LLM applications or agents, including jailbreak techniques, prompt injection, data exfiltration, and abuse of tools and permissions.
• Experience in designing and refining guardrails or safety mechanisms for an LLM-based product.
• Represented a vendor in enterprise security evaluations, including responding to questionnaires, architecture reviews, and managing penetration test remediations.
• Responsible for ensuring testing and release quality for a production system, including automated test suites, release gates, load testing, and rollback processes.
• Proficient in Python with a capability to develop automated test frameworks and tools.
• Experience in securing or managing systems for travel or financial services organizations.
• Knowledge of fraud prevention, account takeover, and payment risk management.
• Willingness to travel for launches and reviews.
• Competitive salary.
• Pre-IPO equity packages.
• Hopper fully covers 100% of the premiums for the group insurance plan.
• Life, short-term, and long-term disability insurance coverage.
• Health Savings Account (HSA) for eligible medical and dental expenses.
• Access to Dialogue telemedicine services for employees and their dependents, available anytime and anywhere.
• RRSP plan with automatic pre-tax payroll deductions.
• Generous parental leave policy.
• Unlimited paid time off (PTO).
• Carrot Cash travel stipend.
• On-demand access to co-working spaces through FlexDesk.
• Work-from-home stipend.
• Entrepreneurial work culture.
• Open lines of communication with management and company leadership.
• Small, agile teams that make a significant impact.
Extend
OhioHealth
Capital One
Software Mind
Get handpicked remote jobs straight to your inbox weekly.