Software Engineer III, AI

This is a fully remote position, open to applicants in California.

📋 Description

• Construct the AI infrastructure that operates natively on TrueNAS.

• Develop and enhance essential functionalities, including on-array vectorization pipelines.

• Design and deploy systems that produce embeddings for data residing on TrueNAS.

• Establish the inference pathway utilizing cuVS/CAGRA aimed at NVIDIA L4/A2-class GPUs.

• Create systems for anomaly detection, predictive maintenance, and log analysis.

• Expand the MCP surface to ensure TrueNAS systems are integral components in agent-driven workflows.

⛳️ Requirements

• Solid foundation in backend engineering principles.

• Proficient in Go, Python, or C.

• Practical experience with vector search, embedding models, or RAG pipelines in a production environment.

• Knowledge of GPU programming or GPU-accelerated libraries (CUDA, cuVS, DALI, TensorRT, or similar).

• Comfortable working closely with the storage and filesystem layer.

• Experience with ZFS is a significant advantage.

• Background in Agentic Engineering.

• Experience in time-series anomaly detection or ML-driven observability.

• Contributions to open-source storage, ML infrastructure, or MCP-related initiatives.

• Familiarity with model quantization (4-bit, BitNet) and constraints related to on-device inference.

• An undergraduate or advanced degree in Computer Science, Computer Engineering, or a related field is anticipated.

🏝️ Benefits

• Health insurance

• Dental

• Vision

• Disability

• Life insurance

• Paid time-off

• 401(k)

• Health and flexible spending accounts

• Stock purchase plan and more