
Senior Software Engineer – ModelVault
Posted 13 hours ago

Posted 13 hours ago
This is a fully remote position, open to applicants in Egypt.
• Develop and construct the software framework delivered with ModelVault’s on-premises AI systems.
• Create containerized inference engines, local dashboards, and command-line utilities.
• Integrate contemporary LLMs and vision models, including capabilities for fine-tuning and local implementation.
• Design and sustain CLIs, lightweight GUIs, and APIs for developers and AI teams.
• Make architectural choices concerning system orchestration, hardware interfacing, remote update pipelines, and telemetry.
• Configure GPU drivers, operating system settings, Ubuntu, NVIDIA stack, and optimized inference runtimes.
• Collaborate with the founding team to test and refine solutions with early business customers.
• Contribute to the recruitment and expansion of the engineering team over the coming year.
• Over 5 years of experience in software engineering.
• Proficient in working across the entire stack, from OS-level configuration and deployment to user-facing applications.
• Skilled in containerization, system packaging, deployment tools, and model runtime management.
• Experienced in integrating LLMs and ML models into practical systems, including inference, fine-tuning, or embeddings.
• Capable of independently steering architectural decisions and managing significant components of product infrastructure.
• Experience with GPU computing, NVIDIA drivers, CUDA, or model acceleration tools is advantageous.
• Familiarity with vLLM, Ollama, Triton Inference Server, LangChain, or similar ML tools is a plus.
• Comfort with Linux system internals, SSH, Ansible, or auto-update agents is desirable.
• Previous experience in AI developer tools, embedded systems, or secure local applications is a bonus.
• Fully remote work opportunity.
• Asynchronous-friendly work culture.
• High levels of autonomy and significant ownership.
• Chance to contribute to defining a new category of secure, local AI.
• Engage with shipped hardware and software.
• Participation in the founding engineering team.
Kismet
Kestra
The College Board
Magnet Talent
Get handpicked remote jobs straight to your inbox weekly.