Senior Software Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Design and develop scalable distributed systems and backend platforms that are compatible with AI/ML infrastructures for applications in search, retrieval, ranking, recommendation, and personalization.

• Oversee scalable ML pipelines utilizing Vertex AI Pipelines for the training, evaluation, and deployment to support personalization in ranking, retrieval, and recommendation use cases.

• Create and sustain data pipelines that facilitate feature generation, model training, and analytics workflows.

• Take ownership of vector generation via Milvus, along with storage and retrieval workflows.

• Implement model serving solutions using KServe and construct APIs with FastAPI to ensure low latency inference.

• Establish observability and monitoring for models and pipelines.

• Monitor performance, drift, failures, and data quality issues.

• Collaborate with data scientists, product managers, and platform teams to define and deliver ML-driven features.

• Investigate production issues across data pipelines, models, and services.

• Identify bottlenecks and enhance reliability and performance.

• Create and maintain comprehensive documentation for pipelines, models, APIs, and operational processes.

• Develop internal tools and dashboards to enhance visibility into data processing and model behavior for stakeholders.

• Contribute to engineering standards, code quality, and best practices across Python-based services and ML systems.

• Stay updated with ML infrastructure, MLOps practices, and relevant tools.

• Implement improvements that provide clear value.

• Work collaboratively with product, data science, and frontend teams to deliver high-quality search and feed experiences.

• Manage production systems and troubleshoot issues across indexing, retrieval, ranking, and serving layers.

• Produce clear documentation for pipelines, models, APIs, and system architecture.

⛳️ Requirements

• Bachelor’s degree in Computer Science, Engineering, or a related discipline.

• Over 6 years of experience in building scalable backend systems and services.

• More than 5 years of software development experience using object-oriented languages, with a strong command of Python, Node.js, and TypeScript.

• Practical experience with Elasticsearch for search, indexing, and relevance tuning.

• Experience with event-driven systems utilizing Apache Kafka for real-time data pipelines and processing.

• Solid understanding of version control systems, including Git and platforms like Bitbucket.

• Familiarity with observability and monitoring tools such as Grafana, Kibana, and APM.

• Knowledge of cloud platforms, including AWS and GCP, as well as containerization with Docker and orchestration using Kubernetes.

• Proficient in deploying, versioning, and monitoring models in production.

• Eagerness to learn new technologies, particularly in AI, LLMs, and contemporary search and recommendation systems, with an emphasis on applying them in real-world production situations.

• Experience in designing and implementing data pipelines using Apache Beam and Apache Airflow for ingestion, transformation, and feature pipelines.

• Familiarity with experimentation and analytics tools such as Jupyter Notebook and Apache Spark for tracking and reproducing experiments.

• Strong proficiency in designing and utilizing RESTful and GraphQL APIs, including versioning, documentation, and security practices like OAuth and JWT.

• Good understanding of machine learning concepts, including supervised learning, unsupervised learning, deep learning, and natural language processing, with practical experience in ranking, retrieval, and personalization.

• Beginner-level experience in managing ML pipelines with Vertex AI Pipelines for training, evaluation, and deployment workflows.

• Ability to review code, provide constructive feedback, and enhance overall engineering quality.

• Excellent communication skills.

🏝️ Benefits

• Medical, dental, vision, and prescription drug coverage.

• Unlimited paid time off (PTO).

• Adoption or surrogate assistance.

• Donation matching.

• Tuition reimbursement.

• Basic life insurance.

• Basic accidental death & dismemberment coverage.

• Supplemental life insurance.

• Supplemental accident insurance.

• Commuter benefits.

• Short-term and long-term disability coverage.

• Health savings and flexible spending accounts.

• Family care benefits.

• A generous 401K savings plan with a company matching program.

• 10-12 paid holidays each year.

• Generous paid parental leave for both birthing and non-birthing parents.

• Voluntary benefits such as pet insurance.

• Accident, critical, and hospital indemnity health insurance coverage.

• Life and disability insurance.