Member of Technical Staff – ML Systems

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Develop CUDA kernels and computational primitives for the training and deployment of graph neural networks (GNNs)

• Enhance Monad, the library for sampling and distributed training, focusing on neighbor sampling and training efficiency

• Define binary data formats (Lance, Arrow, CSR/CSC) and manage materializations and feature backfills for both training and evaluation

• Establish data contracts and consumption criteria with teams that work on customer and proprietary datasets

• Create and maintain infrastructure for experiment tracking, checkpoints, and evaluations, ensuring reproducibility by design

• Oversee the model registry, including lineage tracking, versioning, and compatibility across models, embeddings, and downstream applications

• Set and execute release criteria for managed production, batch, and on-premise model deployments

• Facilitate auditing of data, code, configuration, and proof associated with each release

• Enhance time-to-experiment, time-to-governed-release, GPU training throughput, release documentation, lineage, and reproducibility

⛳️ Requirements

• Proficient in systems engineering and production-level Python programming

• Experience in distributed training frameworks (e.g., Ray, PyTorch distributed) and multi-node GPU environments

• Knowledge of columnar data formats and large-scale data materialization techniques

• Familiarity with machine learning lifecycle tools: experiment tracking, model registries, evaluation, and reproducibility

• A product-oriented approach: view an internal platform as a product serving real users

• Experience in CUDA kernel development or optimizing GPU performance (preferred)

• Understanding of graph neural networks or large-scale graph sampling (preferred)

• Knowledge of Lance, Arrow, or similar columnar/indexed storage formats (preferred)

• Experience with multi-cloud GPU computing solutions (e.g., SkyPilot) (preferred)

• Understanding of model governance or audit requirements, particularly in financial services or other regulated sectors (preferred)

🏝️ Benefits

• Competitive salary and performance-based bonuses

• Comprehensive health, dental, and vision insurance plans

• Flexible working hours and remote work options

• Opportunities for professional development and career advancement

• Supportive and inclusive company culture