Senior Software Engineer

This is a fully remote position, open to applicants in New York.

📋 Description

• Design and construct systems, oversee scalable ML pipelines utilizing Vertex AI Pipelines for training, evaluation, and deployment.

• Create and manage data pipelines that facilitate feature generation, model training, and analytics workflows.

• Take ownership of vector generation through Milvus, along with storage and retrieval processes.

• Implement model serving solutions with KServe and develop APIs using FastAPI for low-latency inference.

• Establish observability and monitoring for models and pipelines, tracking performance, drift, failures, and data quality concerns.

• Collaborate with data scientists, product managers, and platform teams to define and deliver features driven by machine learning.

• Investigate issues in production related to data pipelines, models, and services.

• Identify bottlenecks and enhance reliability and performance.

• Create and maintain comprehensive documentation for pipelines, models, APIs, and operational workflows.

• Develop internal tools and dashboards to offer visibility into data processing and model behavior for stakeholders.

• Contribute to engineering standards, code quality, and best practices across Python-based services and machine learning systems.

• Keep abreast of advancements in ML infrastructure, MLOps practices, and relevant tools.

⛳️ Requirements

• Bachelor’s degree in Computer Science, Engineering, or a related discipline.

• Over 6 years of experience in building scalable backend systems and services.

• More than 5 years of experience in software development using object-oriented languages, with strong proficiency in Python, Node.js, and TypeScript.

• Practical experience with Elasticsearch for search, indexing, and relevance tuning.

• Experience with event-driven systems utilizing Apache Kafka for real-time data pipelines and processing.

• Solid understanding of version control systems, including Git and platforms like Bitbucket.

• Familiarity with observability and monitoring tools such as Grafana, Kibana, and APM.

• Experience with cloud platforms such as AWS and GCP, along with containerization using Docker and orchestration with Kubernetes.

• Comfortable with deploying, versioning, and monitoring models in a production environment.

• A keen interest in learning new technologies, particularly in AI, LLMs, and modern search and recommendation systems.

• Experience in designing and constructing data pipelines using Apache Beam and Apache Airflow for ingestion, transformation, and feature pipelines.

• Familiarity with experimentation and analytics tools like Jupyter Notebook and Apache Spark to track and replicate experiments.

• Strong experience in designing and utilizing RESTful and GraphQL APIs, including versioning, documentation, and security practices such as OAuth and JWT.

• Good understanding of machine learning concepts including supervised learning, unsupervised learning, deep learning, and natural language processing, with practical applications in ranking, retrieval, and personalization.

• Basic experience managing ML pipelines using Vertex AI Pipelines for training, evaluation, and deployment workflows.

• Ability to review code, provide constructive feedback, and enhance overall engineering quality.

• Strong communication skills, capable of clearly explaining technical concepts to both technical and non-technical stakeholders.

• Excellent problem-solving skills with a data-driven approach.

🏝️ Benefits

• Medical, dental, vision, and prescription drug coverage.

• Unlimited paid time off (PTO).

• Adoption or surrogate assistance.

• Donation matching.

• Tuition reimbursement.

• Basic life insurance.

• Basic accidental death & dismemberment insurance.

• Supplemental life insurance.

• Supplemental accident insurance.

• Commuter benefits.

• Short-term and long-term disability.

• Health savings and flexible spending accounts.

• Family care benefits.

• A generous 401K savings plan with a company match program.

• 10-12 paid holidays annually.

• Generous paid parental leave for both birthing and non-birthing parents.

• Voluntary benefits such as pet insurance, accident, critical and hospital indemnity health insurance coverage, life, and disability insurance.