
Senior Software Engineer β AI
Posted Jun 21

Posted Jun 21
This is a fully remote position, open to applicants in Canada.
β’ Design and scale asynchronous REST/WebSocket APIs utilizing Python 3.11+ and FastAPI.
β’ Implement workflows involving multiple agents using Semantic Kernel.
β’ Integrate LLM providers through a provider-agnostic layer to enable A/B testing and cost-aware routing.
β’ Deliver Retrieval-Augmented Generation utilizing vector stores.
β’ Expose tool-using agents via OpenAI Assistants for performing data-analysis and file-manipulation tasks.
β’ Evolve schemas with SQLModel, SQLAlchemy 2, and Alembic; optimize Postgres for high-concurrency asynchronous access.
β’ Maintain a robust CI/CD pipeline that includes linting, type-checking, testing, packaging, and deployment.
β’ Instrument services with structlog JSON logs, OpenTelemetry traces, and metrics related to cost and latency.
β’ Advocate for AI-assisted development and share effective problem-solving practices with the team.
β’ Over 5 years of experience in building production APIs using Python.
β’ More than 2 years of experience with FastAPI or a similar asynchronous technology stack.
β’ In-depth knowledge of asynchronous I/O, Pydantic v2, dependency injection, and observability.
β’ Hands-on experience with Semantic Kernel or similar agent frameworks.
β’ Practical experience with Retrieval-Augmented Generation implementations using Azure AI Search, pgvector, or Chroma.
β’ Strong skills in Postgres, including SQLModel, SQLAlchemy 2, and Alembic migrations.
β’ Proven experience with integrations or side projects involving LLM APIs (such as OpenAI and Gemini) and structured-output design.
β’ Proficient in dependency management utilizing Poetry and virtual environment isolation.
β’ End-to-end ownership of CI/CD processes (building, scanning, testing, and deploying).
β’ Exceptional analytical and problem-solving skills.
β’ Prepared for remote work with daily availability overlapping from 09:00 to 13:00 EST.
β’ Nice to have: Familiarity with event/message queues such as RabbitMQ, Azure Service Bus, or Kafka.
β’ Nice to have: Experience with observability stacks like Grafana or LangFuse for managing LLM costs.
β’ Flexible work arrangements.
EverCommerce
PlanetScale
Slingshot Aerospace
Upstart
Get handpicked remote jobs straight to your inbox weekly.