Senior Machine Learning Engineer, Ads

This is a fully remote position, open to applicants in United States.

📋 Description

• Create and enhance advertising ranking models, focusing on prediction objectives, feature interactions, user history modeling, and calibration.

• Manage machine learning systems comprehensively, encompassing data pipelines, feature engineering, training data creation, model evaluation, model training, and integration into production.

• Assess and implement advancements in deep learning and recommendation modeling while adhering to production latency, reliability, and cost constraints.

• Work in collaboration with ML platform and product engineers to develop scalable and efficient production machine learning systems.

• Team up with product, data science, and engineering teams to establish ranking objectives, design A/B tests, and evaluate advertiser performance, revenue, and user relevance.

• Identify potential applications of machine learning within the Ads product.

• Enhance CTR and CVR predictions, model calibration, user and ad representations, and user-sequence modeling.

• Convert improvements in ranking quality into increased advertiser value, revenue, and enhanced user experiences.

⛳️ Requirements

• Must be available for meetings and spontaneous communication during Quora's coordination hours (Monday to Friday: 9am-3pm Pacific Time).

• Over 4 years of professional software development experience in machine learning.

• Practical experience in developing and deploying ads ranking models at scale, specifically for CTR or CVR prediction and calibration.

• Proven track record of ownership over production enhancements.

• Experience in evaluating ranking models through both offline analyses and online experiments.

• Familiarity with investigating discrepancies between model metrics and actual business outcomes.

• Proficient in using AI-assisted development tools for coding, testing, debugging, or data analysis.

• Strong judgment in validating generated code and conclusions.

• Hands-on experience in building and deploying deep learning models using PyTorch or TensorFlow.

• Good understanding of the mathematical foundations underlying machine learning algorithms.

• Strong skills in Python programming.

• Experience in writing maintainable production ML code.

• BS, MS, or PhD in Computer Science, Engineering, or a related technical field.

• Preferred: experience with contemporary ranking architectures, feature interaction networks, attention-based user-sequence models, and multi-task learning.

• Preferred: knowledge of ranking predictions and calibration in relation to bidding and auctions.

• Preferred: experience working on large-scale multi-engineer projects.

• Preferred: experience in addressing issues such as sparse or delayed conversion labels, sampling and exposure bias, cold-start users, and training-serving inconsistencies.

• Preferred: experience with generative recommender systems.

🏝️ Benefits

• Medical coverage.

• Dental coverage.

• Vision coverage.

• Equity refreshers.

• Remote work reimbursement.

• Paid time off.

• Employee assistance programs.

• Equity.

• Benefits may vary by country.