Staff Engineer – AI Builder

This is a fully remote position, open to applicants in Canada.

📋 Description

• Create and develop agentic workflows, which encompass reasoning loops, tool/function invocation, and both single- and multi-agent architectures.

• Establish and manage RAG pipelines that incorporate chunking, embeddings, OpenSearch vector search, re-ranking, and refresh handling.

• Integrate AWS Bedrock and Agent Core, involving MCP-based tool design.

• Compose and refine production system prompts.

• Incorporate evaluation and observability into agents utilizing golden datasets, RAGAS-style metrics, LLM-as-judge, and tracing with LangFuse/LangSmith or equivalent tools.

• Develop failure-handling strategies such as retries, circuit breakers, fallback models, and user-facing degradation management.

• Construct backend services using Python and Node.js, along with AWS serverless architectures.

• Design DynamoDB single-table schemas for conversation state, agent memory, and session history.

• Facilitate event-driven orchestration through Step Functions, SQS, and EventBridge.

• Contribute to frontend integration points and produce thoroughly tested full-stack code.

• Assist with deployment, monitoring, and troubleshooting in AWS and Docker environments.

• Engage in architecture discussions and articulate technical trade-offs.

• Collaborate with product, design, and delivery leaders across international teams.

• Mentor engineers on agentic engineering methodologies and AI-assisted development tools.

• Take ownership of features and releases throughout their lifecycle, including debugging, hardening, and ensuring production reliability.

⛳️ Requirements

• Over 6 years of professional software engineering experience, including substantial involvement in deploying GenAI/LLM-powered systems in production.

• In-depth hands-on experience in agentic AI, specifically reasoning loops, tool/function invocation, and multi-agent orchestration.

• Practical expertise in RAG, including chunking techniques, embeddings, and vector databases like OpenSearch, alongside cosine similarity search and re-ranking.

• Experience in developing evaluation and observability frameworks for LLM systems, incorporating golden datasets, LLM-as-judge, RAGAS or similar metrics, and LangFuse/LangSmith tracing.

• Strong proficiency in prompt engineering.

• Hands-on familiarity with the AWS GenAI stack, including Bedrock, Agent Core, Lambda, DynamoDB single-table design, S3, SQS, EventBridge, and Step Functions.

• Proficient in Python and Node.js, with experience in developing full-stack applications and RESTful APIs.

• Understanding of production reliability strategies for LLM-supported systems, including retries/backoff, circuit breakers, and fallback models.

• Experience with Docker and cloud-native deployment practices.

• Capability to tackle ambiguous, integration-intensive challenges.

• Desirable additional skills: Experience with Amazon Bedrock Agent Core, regulated or high-stakes domains, workflow orchestration tools, and production LLM observability solutions.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Comprehensive health, dental, and vision insurance.

• Generous paid time off and flexible working arrangements.

• Opportunities for professional development and continuous learning.

• Collaborative and innovative work environment.