Software Engineer, Python, Kubernetes, AI/ML

This is a fully remote position, open to applicants in Cyprus.

📋 Description

• Play a key role in the development of the Everywhere Inference platform, a Kubernetes-based solution that facilitates scalable and portable AI inference across diverse environments.

• Design and develop APIs and developer tools aimed at streamlining the deployment, management, and monitoring of AI applications.

• Concentrate on packaging and integrating new machine learning models into the platform using Python and popular ML frameworks.

• Enhance serverless container workflows for AI workloads, ensuring optimal performance, scalability, and efficient autoscaling.

• Collaborate with customers to refine ML model performance and cater to their specific use cases.

• Partner with cross-functional teams to enhance the AI applications marketplace and ensure smooth onboarding and lifecycle management of models.

• Remain updated with the latest trends in Kubernetes, machine learning, and MLOps, contributing to innovation within the platform.

⛳️ Requirements

• Expertise in Python, particularly in relation to ML tooling or backend development.

• Experience with AI/ML pipelines or the integration of machine learning frameworks such as TensorFlow or PyTorch in production settings.

• Practical experience with vLLM and SGLang.

• Familiarity with cloud-native tools like Docker, Helm, and other related CNCF technologies.

• A problem-solving approach and a genuine enthusiasm for tackling challenges in distributed systems and platform-level development.

• Strong communication abilities and a collaborative spirit, enjoying teamwork to create exceptional solutions.

• Solid experience in Go programming, especially concerning Kubernetes, including building controllers, operators, and working with custom resources (CRDs).

• Comprehensive understanding of Kubernetes architecture, container orchestration, and resource management at scale.

• Knowledge of GPU scheduling and performance optimization within Kubernetes.

• Awareness of Kubernetes security practices, including RBAC and container hardening.

• Contributions to open-source projects or active participation in cloud-native or MLOps communities.

🏝️ Benefits

• Competitive compensation

• Flexible working hours and hybrid or remote arrangements, depending on your role

• Opportunity to work from anywhere in the world for up to 45 days each year

• Private medical insurance for you and your family*

• Additional paid vacation and sick leave days*

• Support for significant life moments and celebrations

• Language courses to foster connection and growth

• Modern, inviting offices equipped with snacks, drinks, and entertainment*

• Team sports and social events*