Senior Software Engineer – Data Platform

This is a fully remote position, open to applicants in United States.

📋 Description

• Design and create API gateways, model routing layers, and service infrastructure that connect finely-tuned CRE models with production applications.

• Develop internal tools for developers, which include prompt management interfaces, evaluation dashboards, and trace viewers.

• Implement integration patterns that embed AI capabilities into LightBox's current workflow applications.

• Establish observability and monitoring infrastructure for AI workloads, covering latency tracking, quality metrics, cost attribution, and usage analytics.

• Contribute to knowledge retrieval and caching layers, enhancing accuracy and performance at scale.

• Collaborate with ML engineers on infrastructure for model serving and deployment in production.

• Engage in architectural decisions and technical design reviews.

⛳️ Requirements

• Over 6 years of software engineering experience with a robust full-stack foundation (backend-leaning preferred).

• Hands-on experience in building APIs, microservices, and platform infrastructure in Python and/or TypeScript/Node.js.

• Comprehensive understanding of cloud infrastructure (AWS or GCP), containerization (Docker, Kubernetes), and CI/CD pipelines.

• Experience in developing tools for developers, SDKs, or internal platforms utilized by other engineers.

• Knowledge of LLM integration patterns, including API-based model consumption, prompt engineering, retrieval-augmented generation, and tool/function calling.

• Strong foundational knowledge in distributed systems, data modeling, and API design.

• Comfortable working in a small team with considerable autonomy, taking ownership of a feature from design to deployment and monitoring.

• Preferred: Experience with Model Context Protocol (MCP) or similar structured AI integration standards.

• Preferred: Background in data-intensive platforms, especially in property data, geospatial systems, or document processing pipelines.

• Preferred: Familiarity with model serving frameworks (LiteLLM, OpenRoute, AWS BedRock) and optimization for inference.

• Preferred: Experience in real estate technology, financial services, or other regulated/document-heavy industries.

• Preferred: Previous experience in building observability or evaluation tools for ML/AI systems.

🏝️ Benefits

• Competitive salary and performance bonuses.

• Comprehensive health, dental, and vision insurance.

• Flexible work hours and remote work opportunities.

• Professional development and continuous learning initiatives.

• Collaborative and dynamic work environment.