Principal ML System Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Act as the product owner for GenAI features within PointClickCare.

• Collaborate with engineering teams to discover, develop, and support generative AI solutions.

• Design, construct, and sustain the foundational infrastructure for GenAI products, which includes model gateways, prompt/versioning repositories, vector databases, and tools for LLM evaluation.

• Implement secure access controls and authentication protocols within the AI platform components.

• Create and oversee observability, monitoring, and logging for GenAI workloads and infrastructure.

• Integrate GenAI infrastructure with agent frameworks and downstream applications.

• Enhance infrastructure for scalability, high availability, and cost-effectiveness in production environments.

⛳️ Requirements

• Significant experience in constructing and managing AI platform infrastructure.

• Proficient in Kubernetes and container security.

• Knowledgeable in observability and monitoring frameworks aimed at real-time performance.

• Familiar with OpenTelemetry and NLPFlow.

• Experience with AI infrastructure elements such as vector databases, prompt/versioning repositories, and AI IDEs.

• Acquainted with vLLM, SGLang, or comparable frameworks for hosting LLM inference workloads.

• Experience with CI/CD pipelines and automation for AI model deployment and platform management.

• Strong understanding of authentication and authorization frameworks integrated into AI platforms.

🏝️ Benefits

• Bonus

• Benefits

• Total rewards package