Software Engineer, Data Infrastructure

This is a fully remote position, open to applicants in New York.

📋 Description

• Develop and uphold a high-performance data layer that our Modeling teams depend on for their training and evaluation tasks.

• Engage directly with petabyte-scale storage systems, along with the networking and performance challenges associated with them.

• Collaborate on a daily basis with top-tier researchers and engineers who excel in their respective fields.

⛳️ Requirements

• Over 4 years of experience in data storage infrastructure.

• Proficient in Python programming.

• Experience with Kubernetes, particularly in storage aspects (Persistent Volumes, CSI drivers, etc.).

• Ability to convert unstructured data into efficient datasets across various storage backends, including S3, GCS, and POSIX.

• Familiarity with distributed data processing frameworks such as Apache Beam, Spark, or Flink.

• [Nice-to-have] Knowledge of modern analytics tools like BigQuery, Airflow, or dbt.

• A genuine enthusiasm for AI.

• Comfort in navigating the unknown, coupled with a desire to create something truly innovative rather than just refining existing solutions.

🏝️ Benefits

• An open and inclusive culture and work environment.

• Collaborate closely with a team at the forefront of AI research.

• Weekly lunch stipend, along with in-office lunches and snacks.

• Comprehensive health and dental benefits, including a dedicated budget for mental health support.

• 100% Parental Leave top-up for a maximum of 6 months.

• Personal enrichment benefits for arts and culture, fitness and well-being, quality time, and workspace enhancements.

• Flexible remote work options, with offices located in Toronto, New York, San Francisco, London, and Paris, as well as a co-working stipend.

• 6 weeks of vacation (30 working days!).