Senior Software Engineer – Data Platform

This is a fully remote position, open to applicants in United States.

📋 Description

• Design and develop API gateways, routing layers, and service infrastructure that link optimized CRE models with production applications.

• Create internal developer tools - including prompt management interfaces, evaluation dashboards, and trace viewers - that enhance the team's efficiency in delivering and iterating on AI features.

• Execute integration patterns for incorporating AI functionalities into LightBox's existing workflow applications, ensuring a smooth user experience.

• Establish observability and monitoring frameworks for AI workloads: tracking latency, assessing quality metrics, attributing costs, and analyzing usage data.

• Contribute to the platform's knowledge retrieval and caching systems, focusing on optimizing both accuracy and performance at scale.

• Collaborate with ML engineers on model serving infrastructure, assisting in bridging the gap between training outputs and production deployment.

• Engage in architectural decisions and technical design reviews, offering a practical full-stack perspective to the team's initiatives.

⛳️ Requirements

• Over 6 years of software engineering experience with a robust full-stack background (backend-focused preferred).

• Hands-on experience in building APIs, microservices, and platform infrastructure using Python and/or TypeScript/Node.js.

• Strong knowledge of cloud infrastructure (AWS or GCP), containerization techniques (Docker, Kubernetes), and CI/CD processes.

• Experience in creating developer-oriented tools, SDKs, or internal platforms that are utilized by other engineers.

• Familiarity with LLM integration patterns: API-based model consumption, prompt engineering, retrieval-augmented generation, and tool/function calling.

• Solid foundation in distributed systems, data modeling, and API design.

• Ability to thrive in a small team environment with significant autonomy - capable of owning a feature from design through to deployment and monitoring.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Comprehensive health, dental, and vision insurance.

• Flexible working hours and remote work options.

• Opportunities for professional development and growth.

• Collaborative and inclusive company culture.