
Senior Software Engineer II, AI Enablement
Posted 5 days ago

Posted 5 days ago
This is a fully remote position, open to applicants in United States.
• Take ownership and enhance the MCP Gateway and connector platform.
• Develop and strengthen MCP server integrations with various systems, including Glean, Slack, Jira, Snowflake, Salesforce, Monday, Tableau, and Databricks.
• Manage authentication, scopes, tenancy, rate limiting, and enforcement of read/write policies for non-BAA tools.
• Collaborate with Security and platform owners to create safe-by-default access paths.
• Oversee the marketplace publishing pipeline, which includes versioning, CI/CD, plugin PR review, and release hygiene.
• Create and maintain shared plugins, skills, hooks, and Spec-Driven Development tools.
• Provide authorship guidelines that enable other teams to contribute effectively.
• Expand platform observability, model-gateway configuration, and cost attribution.
• Enhance telemetry to ensure that adoption, tool-call health, and inference spending are traceable by team, workload, and model.
• Define model routing and develop benchmarks and evaluation harnesses for informed model selection.
• Construct infrastructure mapping agent outputs into a browsable, searchable, and commentable interface.
• Facilitate discovery, tagging, viewer engagement instrumentation, comments, expiry, and share notifications.
• Conduct office hours and brownbags, mentoring engineers on agentic coding and plugin authorship practices.
• Review and prioritize incoming feature requests.
• Provide on-call support for marketplace-published artifacts and ensure gateway availability.
• Bachelor's degree (BS/BTech) or higher in Computer Science, Engineering, or a related discipline.
• Over 5 years of professional software engineering experience.
• Proven experience in taking ownership of a backend service or developer platform, including its authentication model, release process, and operational health.
• Strong production experience with at least one modern application stack (Python, TypeScript/Node, Go, or similar) and contemporary CI/CD practices.
• Practical experience with authentication and authorization for machine-to-machine communication, including OAuth2, OIDC, M2M credentials, token scoping, and secret management.
• Demonstrated capability in instrumenting a system using metrics, structured logging, tracing, or usage analytics, and leveraging that data to inform decisions.
• Direct hands-on experience with one or more agentic coding tools in a production or near-production environment, such as Claude Code, Cursor, Cody, Copilot agents, or Aider.
• Excellent written communication skills with the ability to create documentation, runbooks, and educational materials.
• Experience in authoring or maintaining MCP servers, Claude Code plugins, skills, hooks, or similar LLM-tooling integrations.
• Familiarity with running an LLM gateway or inference proxy in a production setting, such as LiteLLM, Bedrock, or vLLM.
• Experience in building evaluation harnesses or benchmarks for LLM systems.
• Experience in operating a package registry, plugin ecosystem, or extension marketplace.
• Background in healthcare technology, particularly in HIPAA-regulated environments or PHI-handling systems.
• Knowledge of Python/FastAPI, Vue/TypeScript, Postgres, AWS, Auth0, Datadog, or Sumo Logic is advantageous but not mandatory.
• Comfort working across frontend, backend, and infrastructure domains.
• Experience as an early engineer on a platform serving internal colleagues.
• Remote work arrangement.
• Full-time employment.
Shield AI
Netflix
Travoom
HeroSoftware GmbH - Shopify Apps
Get handpicked remote jobs straight to your inbox weekly.