Software Engineer 6 – Feature Infrastructure

This is a fully remote position, open to applicants in United States.

📋 Description

• Develop an advanced machine learning data and feature platform aimed at enhancing productivity for ML practitioners.

• Empower ML practitioners to define and evaluate ML features and labels while the platform manages computation, storage, and serving.

• Create a centralized feature and embedding store to facilitate sharing across various ML domains.

• Collaborate with ML practitioners and domain experts to guarantee high-quality features and labels.

• Partner with the broader AI Platform organization to provide a seamless end-user experience.

• Design and implement a near-real-time feature computation engine.

• Manage and oversee feature computation pipelines and infrastructure for serving features.

• Develop and scale systems for efficient data loading, transformation, and writing processes.

• Establish frameworks to accelerate the availability of new data for training and serving.

• Create feature stores that support feature discovery and sharing.

• Enhance the productivity of ML practitioners by streamlining feature and label definition and accessibility.

⛳️ Requirements

• Proven experience in developing ML or data infrastructure.

• Strong empathy and dedication to delivering an outstanding user experience for ML practitioners.

• Experience in designing and maintaining 24/7 high-traffic and low-latency online applications.

• Familiarity with large-scale data processing frameworks such as Spark, Flink, and Kafka.

• Knowledge of data storage and serving technologies, including Iceberg and Cassandra.

• Proficiency in optimizing Java and/or Python codebases.

• Experience working with public cloud services, particularly AWS.

• Self-motivated and highly collaborative team player.

• Preferred: Experience in developing and managing ML feature stores, such as Chronon.

• Preferred: Experience in creating embedding-based retrieval systems.

• Preferred: Experience with Notebooks like Jupyter or Polynote.

🏝️ Benefits

• Health Plans

• Mental Health support

• 401(k) Retirement Plan with employer match

• Stock Option Program

• Disability Programs

• Health Savings and Flexible Spending Accounts

• Family-forming benefits

• Life and Serious Injury Benefits

• Paid leave of absence programs

• Full-time hourly employees accrue 35 days annually for paid time off to be used for vacation, holidays, and sick leave.

• Full-time salaried employees are immediately entitled to flexible time off.