Principal Rust Engineer

This is a fully remote position, open to applicants in Spain.

📋 Description

• Take charge of the architecture and strategic roadmap for the distributed search and indexing engine developed in Rust.

• Design and create vector, full-text, and graph indexes, including HNSW, quantization, multi-vector, and Tantivy.

• Develop the query and filtering layer that operates above the indexes.

• Advance the methodologies for building, merging, sharding, and replicating indexes on object storage, PostgreSQL, and NATS.

• Lead significant migrations and performance enhancements based on profiling and benchmarking without causing downtime for customers.

• Contribute to Python services, SDKs, and PyO3 bindings while ensuring the stability of public APIs.

• Maintain the system's observability, reliability, and security across Kubernetes deployments and CI/CD processes.

• Draft design proposals, review code, mentor senior engineers, and represent the project within the open-source community.

• Collaborate effectively with ML, product, and platform teams.

⛳️ Requirements

• Significant experience in building and managing high-performance production systems, including providing technical leadership.

• Proficient in Rust: async (Tokio), concurrency, memory-mapped I/O, profiling, and low-level optimizations (e.g., SIMD).

• Comprehensive understanding of search engine architecture: approximate nearest neighbor search, vector quantization, inverted indexes, and ranking methodologies.

• Experience in designing distributed data systems focusing on storage engines, sharding, replication, and consistency trade-offs.

• Strong background with PostgreSQL, object storage solutions (S3, GCS, Azure), and messaging systems (NATS JetStream or Kafka).

• Solid Python proficiency, ideally with experience in PyO3, asyncio, FastAPI, and Pydantic.

• Experience deploying services on Kubernetes with a focus on observability and CI/CD, preferably using GitHub Actions.

• Capability to establish technical direction and implement it incrementally.

• Excellent written and verbal communication skills in English, including the ability to produce design documents.

• Comfortable taking ownership of critical production systems and making decisions under pressure.

• Willingness to mentor others and thrive in a remote-first, global team environment.

🏝️ Benefits

• Competitive remuneration package.

• Enrollment in the Employee Stock Purchase Plan.

• 23 vacation days per year.

• A day off for your birthday.

• Time off for community service activities.

• An official holiday for all employees on International Women's Day — March 8.

• Life and Medical Insurance coverage.