
AI Engineer II
Posted Oct 21

Posted Oct 21
This is a fully remote position, open to applicants in United States.
• Design, test, and sustain components, services, connectors, and internal tools for the AI platform.
• Execute model routing, prompt execution patterns, API integrations, and reusable utilities.
• Enhance the reliability, performance, observability, and usability of AI engineering tools.
• Assist with production operations, troubleshooting, monitoring, issue resolution, and potential on-call incident response.
• Create reusable agents, skills, workflow components, and connectors for engineering teams.
• Develop agent behaviors, tool calls, structured workflows, and integration logic for AI-assisted software development lifecycle (SDLC) use cases.
• Construct and maintain evaluation workflows, automated tests, regression checks, quality benchmarks, and validation methodologies.
• Aid in versioning, release management, rollback readiness, and lifecycle management for AI components.
• Evaluate model and agent behavior concerning quality, cost, latency, security, and reliability issues.
• Integrate logging, access control, data classification, and risk management into AI workflows.
• Collaborate with security and governance partners to ensure compliance with responsible AI requirements.
• Verify compliance with sensitive-data handling and established guardrails.
• Address security, compliance, and audit findings.
• Partner with software engineering teams to discover enhancements for AI-enabled workflows.
• Develop examples, templates, and best practices to expedite adoption.
• Provide support for onboarding, technical guidance, and issue resolution for engineering users.
• Contribute to team standards, documentation, and communities of practice.
• Bachelor’s degree in Computer Science, Software Engineering, Artificial Intelligence, Information Systems, or a related technical discipline, or equivalent professional experience.
• Generally, 5+ years of experience in software engineering, AI engineering, ML engineering, platform engineering, automation, or developer productivity roles.
• Proficient programming abilities, ideally in Python and one or more modern application development languages.
• Experience in building APIs, services, integrations, automated tests, and cloud-based applications.
• Prior experience with LLM application patterns, prompt engineering, RAG, agent frameworks, LLMOps, evaluation techniques, or AI-assisted development tools is highly preferred.
• Strong engineering judgment.
• Excellent collaboration skills.
• Capability to independently deliver reliable technical solutions within a secure environment.
• Applicants must be authorized to work in the United States without the requirement for sponsorship now or in the future.
• Eligibility for incentive awards based on both individual and business performance.
• Comprehensive benefits package.
• Rewarding and challenging career opportunities.
Rapid7
Rapid7
Get handpicked remote jobs straight to your inbox weekly.