Lead Software Engineer, Search – Semantic Platform

This is a fully remote position, open to applicants in United States.

📋 Description

• Spearhead the design and execution of semantic search functionalities utilizing OpenSearch.

• Develop hybrid BM25 and vector search capabilities from scratch.

• Assess, benchmark, and optimize search relevance, ranking models, and k-NN/neural search setups.

• Oversee, enhance, and advance data ingestion and indexing pipelines leveraging MySQL, Kafka/RabbitMQ, and backend microservices.

• Facilitate dense vector ingestion along with de-duplicated, resilient synchronization.

• Direct the Search team’s technical roadmap and establish engineering best practices.

• Guide and mentor senior and mid-level engineers through intricate architectural decisions.

• Ensure ultra-low latency and high-availability service level agreements (SLAs) under substantial concurrent traffic loads.

• Take part in the team’s on-call rotation.

⛳️ Requirements

• Over 7 years of professional software development experience.

• Demonstrated success in a technical leadership or staff-level role.

• Extensive hands-on experience constructing, scaling, and optimizing OpenSearch or Elasticsearch clusters at scale.

• Proven expertise in implementing semantic search, working with text embeddings, vector databases, and hybrid search scoring methodologies.

• High proficiency in a strongly typed programming language such as GoLang, Scala, or Java.

• Experience with programming languages such as PHP.

• Strong background in MySQL, schema design, and Kafka or RabbitMQ.

• Familiarity with the OpenSearch Neural Search plugin, k-NN search, or Learning to Rank (LTR).

• Experience transitioning large-scale search infrastructure from traditional Elasticsearch configurations to sophisticated OpenSearch semantic implementations.

• Experience establishing automated search quality measurement frameworks like NDCG and MRR.

• Familiarity with Docker and Kubernetes in a cloud environment.

🏝️ Benefits

• Variable compensation options such as bonuses or commissions, where applicable.

• Equity opportunities, where applicable.

• Benefits aligned with local policies.

• An inclusive and accessible hiring process.

• Identity verification and secure processing in compliance with relevant privacy regulations.