Software Engineer, Data Infrastructure

📋 Description

• Develop and sustain the high-performance data layer essential for our Modeling teams' training and evaluation tasks.

• Engage directly with petabyte-scale storage infrastructure and tackle the networking and performance challenges associated with it.

• Collaborate on a daily basis with researchers and engineers who are among the best in their respective fields.

⛳️ Requirements

• Over 4 years of experience in data storage infrastructure.

• Proficient in Python programming.

• Experience with Kubernetes, particularly on the storage side (Persistent Volumes, CSI drivers, etc.).

• Ability to convert unstructured data into efficient datasets across various storage backends, including S3, GCS, and POSIX.

• Familiarity with distributed data processing frameworks such as Apache Beam, Spark, or Flink.

• [Nice-to-have] Knowledge of modern analytics tools like BigQuery, Airflow, or dbt.

• A genuine enthusiasm for AI.

• Comfortable working at the forefront of innovation, with a passion for creating something new rather than merely optimizing existing solutions.

🏝️ Benefits

• A welcoming and inclusive culture and work environment.

• Collaborate closely with a team engaged in cutting-edge AI research.

• Weekly lunch stipend, along with in-office lunches and snacks.

• Comprehensive health and dental benefits, including a dedicated budget for mental health care.

• 100% Parental Leave top-up for up to 6 months.

• Personal enrichment benefits for arts and culture, fitness and well-being, quality time, and workspace enhancements.

• Remote-flexible options, with offices located in Toronto, New York, San Francisco, London, and Paris, in addition to a co-working stipend.

• Generous vacation policy offering 6 weeks of time off (equivalent to 30 working days!).