Senior Software Engineer – Data Platform

This is a fully remote position, open to applicants in United States.

📋 Description

• Create and implement API gateways, design routing layers, and develop service infrastructure that link refined CRE models with production applications.

• Build internal developer tools, including prompt management interfaces, evaluation dashboards, and trace viewers, to enhance the team's efficiency in delivering and iterating on AI features.

• Establish integration patterns for incorporating AI functionalities into LightBox's current workflow applications, ensuring a smooth user experience.

• Develop observability and monitoring systems for AI workloads, focusing on latency tracking, quality metrics, cost attribution, and usage analytics.

• Contribute to the platform's knowledge retrieval and caching systems, optimizing both accuracy and performance at scale.

• Work collaboratively with ML engineers on model serving infrastructure to facilitate the transition from training outputs to production deployment.

• Engage in architectural decisions and technical design reviews, offering a practical full-stack viewpoint to the team's initiatives.

⛳️ Requirements

• Over 6 years of software engineering experience with a robust full-stack background, preferably with a backend focus.

• Hands-on experience in developing APIs, microservices, and platform infrastructure using Python and/or TypeScript/Node.js.

• Strong comprehension of cloud infrastructure (AWS or GCP), containerization (Docker, Kubernetes), and CI/CD pipelines.

• Proven experience in creating developer-oriented tools, SDKs, or internal platforms utilized by other engineers.

• Knowledge of LLM integration techniques, including API-based model consumption, prompt engineering, retrieval-augmented generation, and tool/function calling.

• Solid foundation in distributed systems, data modeling, and API design principles.

• Ability to thrive in a small team environment with a high degree of autonomy, managing a feature from design through deployment and monitoring.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Comprehensive health, dental, and vision insurance.

• Flexible work hours and remote work options.

• Opportunities for professional development and continuous learning.

• Collaborative and inclusive company culture.