Staff Software Engineer – Foundations

This is a fully remote position, open to applicants in Canada.

📋 Description

• Spearhead the migration of Vanta’s resource data model from a Mongo-centric framework to a schema-aware Postgres solution, ensuring both versions operate concurrently without disrupting customer integrations.

• Facilitate solutions across teams reliant on the Foundations platform.

• Architect for correctness under eventual consistency, employing idempotent session management, conditional writes, reconciliation, and explicit backpressure.

• Design and enhance data ingestion and pipeline architecture for dependable, high-throughput processing of terabyte-scale data streams within distributed systems.

• Transition the Query API from internal usage to a production-ready platform featuring schema versioning, joins, exports, per-tenant isolation, and predictable latency under load.

• Develop data infrastructure that is externally auditable for SOC 2 or FedRAMP compliance evidence.

• Troubleshoot production failures related to hot partitions, unbounded fan-out, and online rewrites of tables with continuous data writing.

• Establish architectural direction for Kafka and event queuing, Redis caching, Postgres, and MongoDB storage throughout the Foundations stack.

• Mentor senior engineers through design evaluations, architectural insights, and hands-on contributions.

• Advocate for reliability, observability, and operational excellence across core data infrastructure.

• Utilize AI tools and systems to expedite work and enhance the developed systems.

⛳️ Requirements

• Demonstrated success in leading platform migration projects (v1→v2 architecture transitions) while ensuring backward compatibility and system uptime.

• Strong expertise in streaming and queuing infrastructure (Kafka or similar), encompassing partitioning strategies, consumer group semantics, redelivery, and idempotency.

• Extensive industry experience in distributed systems and data pipeline engineering.

• Proven experience in designing and managing systems at an enterprise scale, including terabyte-scale ingestion and high-throughput event processing.

• Proficiency in relational and document data modeling at scale using Postgres and MongoDB.

• Familiarity with query planning, connection pooling, and online schema changes on large, continuously written tables.

• Experience collaborating with engineering leadership to establish multi-quarter technical roadmaps and successfully execute them.

• Strong foundational knowledge of AWS.

• Proficiency in TypeScript and Node.

• Ability to communicate complex system trade-offs to both technical and non-technical stakeholders and engage cross-functional partners in long-term technical decisions.

• Willingness to leverage AI to enhance skills and improve work, coupled with curiosity, a desire to learn, and sound judgment in applying AI responsibly.

🏝️ Benefits

• Competitive salary and equity package.

• Comprehensive medical, dental, and vision coverage, including dependents.

• Pension contributions.

• 16 weeks of paid Parental Leave for all new parents.

• Health & wellness stipend.

• Stipend for remote workspace, internet, and cellphone expenses.

• Flexible work hours and location options.

• 21 days of vacation time and 80 hours of sick leave.

• 11 company-paid holidays.

• Engaging virtual team-building activities, lunch and learns, and various company-wide events.