Senior SRE

This is a fully remote position, open to applicants in United States.

📋 Description

• Lead the initiative for reliability and observability.

• Take ownership of the reliability roadmap from start to finish.

• Establish a repeatable pipeline for defining, emitting, ingesting, dashboarding, and alerting metrics; set SLOs and error budgets, prioritize tasks, and ensure execution.

• Collaborate with engineering teams on what should be monitored, the methods used, and the timing, focusing on user impact rather than low-level infrastructure.

• Strengthen the foundational platform.

• Transform the financial data platform from functional to enterprise-grade, emphasizing availability, performance, and recoverability.

• Enhance deployment paths, streamline processing, and ensure failover so that the monthly close is executed more efficiently as legacy systems are phased out.

• Broaden the scope and depth of observability.

• Extend instrumentation across six target systems — Velocity, Red Panda, MuleSoft, Snowflake, Fabric, and AWS (with D365 ledger to follow) — demonstrating both push (OpenTelemetry) and pull (agent) ingestion.

• Monitor service health (latency, error rates, throughput) and business KPIs (match rate, reconciliation completeness, settlement accuracy, and latency).

• Develop a scalable incident and review process.

• Create the on-call, alerting, and blameless postmortem process that maintains high reliability as systems and teams expand.

• Direct alerts from Datadog to Incident.io with ServiceNow as the record-keeping system, establishing severity standards, escalation protocols, and follow-up mechanisms that ensure closure.

• Increase automation, enhance auditability, and minimize repetitive tasks.

• Develop tools that automate routine operations, self-heal common failures, and highlight significant data over noise.

• Establish data lineage and retention, and validate reliability at scale — ensuring over 5,000 transactions before go-live — through auto-remediation, capacity planning, and actionable dashboards.

• Create specialized SRE agents using Cursor AI.

• Design and deploy AI agents for incident triage, log analysis, and root-cause investigation, among other functions.

• Utilize Cursor as your development environment.

• Treat these agents as products that address specific issues.

• Host SRE agents on the AI fabric.

• Collaborate with the AI platform team to deploy your agents on the organization's AI infrastructure, ensuring they are discoverable, governed, and reusable across various functions.

⛳️ Requirements

• Demonstrated experience in designing, operating, and scaling reliable production systems.

• Extensive hands-on knowledge of modern observability tools — Datadog, Prometheus/Grafana, and OpenTelemetry — including both push and pull ingestion methods.

• Strong background in defining SLIs, SLOs, and error budgets, and translating these into business-level KPIs rather than solely infrastructure metrics.

• Experience managing data platforms (Snowflake, Fabric) and enterprise integration layers (MuleSoft) alongside enterprise SaaS such as D365 (F&O and/or Power Apps).

• Practical incident management experience with tools like Incident.io and ServiceNow, with a proven record of effectively conducting on-call duties and postmortems.

• Hands-on experience with LLMs and AI coding assistants — particularly Cursor; bonus points for having developed and deployed agents.

• Capability to define reliability strategy, targets, and operational metrics, and to advocate for them to engineering leadership and the business.

• Excellent communication skills — able to articulate a root cause to a junior engineer and explain a reliability risk to a product lead.

• Proven inclination for action and the ability to work independently in ambiguous, rapidly changing environments.

🏝️ Benefits

• Competitive salary.

• Flexible working hours.

• Professional development budget.

• Home office setup allowance.

• Global team events.