Senior Software Engineer – Data Platform

This is a fully remote position, open to applicants in United States.

📋 Description

• Design and create API gateways, model routing layers, and service infrastructure that connect finely tuned CRE models with production applications.

• Develop internal developer tools, such as prompt management interfaces, evaluation dashboards, and trace viewers.

• Implement integration patterns to embed AI capabilities within LightBox's current workflow applications.

• Establish observability and monitoring infrastructure for AI workloads, focusing on latency tracking, quality metrics, cost attribution, and usage analytics.

• Contribute to knowledge retrieval and caching layers, enhancing accuracy and performance at scale.

• Collaborate with ML engineers on model serving infrastructure, linking training outputs to production deployment.

• Engage in architecture decisions and technical design reviews.

• Develop self-service infrastructure and developer-facing tools to ensure LightBox's AI capabilities are accessible and reliable.

• Enable internal teams and external partners to compose, deploy, and utilize AI models and agents.

⛳️ Requirements

• 6+ years of software engineering experience with a strong full-stack foundation, preferably backend-leaning.

• Hands-on experience in building APIs, microservices, and platform infrastructure in Python and/or TypeScript/Node.js.

• Strong understanding of cloud infrastructure (AWS or GCP), containerization (Docker, Kubernetes), and CI/CD pipelines.

• Experience in creating developer-facing tools, SDKs, or internal platforms utilized by other engineers.

• Knowledge of LLM integration patterns, including API-based model consumption, prompt engineering, retrieval-augmented generation, and tool/function calling.

• Solid grounding in distributed systems, data modeling, and API design.

• Ability to work effectively in a small team with significant autonomy, taking ownership of features from design to deployment and monitoring.

• Preferred: Experience with Model Context Protocol (MCP) or similar structured AI integration standards.

• Preferred: Background in data-intensive platforms, especially those related to property data, geospatial systems, or document processing pipelines.

• Preferred: Familiarity with model serving frameworks (LiteLLM, OpenRouter, AWS Bedrock) and inference optimization.

• Preferred: Experience in real estate technology, financial services, or other regulated/document-heavy sectors.

• Preferred: Prior experience in developing observability or evaluation tools for ML/AI systems.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Comprehensive health, dental, and vision insurance.

• Flexible work hours and remote work options.

• Opportunities for professional development and continuous learning.

• Supportive and collaborative work environment.