Senior Software Engineer, Storage

This is a fully remote position, open to applicants in New York.

📋 Description

• **About the Role**

• Positions at Hugging Face are highly adaptable and dynamic -- we seek an individual who is willing to embrace various challenges that evolve over time. This position is part of the Xet Storage team, which is responsible for the storage framework supporting all of Hugging Face. Currently, we manage over 200PB (and rapidly increasing!) of the world's most crucial ML & AI assets. Xet serves as the foundational storage architecture for the entire Hugging Face platform and community -- encompassing the largest model repositories, as well as datasets and Spaces that millions of users create daily.

• In this role, you will engage with two closely linked areas. You will contribute to xet-core, our open-source initiative developed in Rust that powers hf-xet -- the Python library that underlies the Hugging Face Hub client and the broader ecosystem of open-source tools used by the community. Additionally, you will design, construct, and manage significant and challenging features in the Xet Storage backend, contributing to the wider Infrastructure organization at Hugging Face. We are a small team creating and managing remarkable solutions at an immense scale, in a high-trust, low-process, asynchronous, and remote setting -- and we heavily utilize the latest AI tools to accelerate our progress.

• If you have a passion for crafting low-level, high-performance code and are invigorated by the challenges of large-scale, scalable services, this is the team for you. This typically requires demonstrated experience in developing and managing production systems software, although we evaluate each candidate on an individual basis.

⛳️ Requirements

• **What we're looking for**

• - Over 8 years of experience in building and scaling distributed systems, storage, or networking infrastructure.

• - Expertise in a low-level systems programming language, with a strong preference for Rust (we also utilize Python, Typescript, Go, and C++ throughout the stack).

• - A proven history of working autonomously in a high-trust, low-process environment -- you're at ease with ambiguity and take full ownership of projects.

• - Comfort in operating within a fast-paced, asynchronous, and fully remote setting.

• - A strong enthusiasm for developing simple, robust, and scalable systems that are relied upon by engineering and scientific teams globally.

• **Bonus points if you have**

• - Experience in designing efficient, high-performance, fault-tolerant data storage and retrieval systems.

• - Experience managing production systems -- including monitoring, alerting, and distributed debugging and recovery.

• - Familiarity with git internals, cloud infrastructure (AWS, Azure, GCP, Kubernetes), databases (both relational and non-relational), or networking.

🏝️ Benefits

• **More about Hugging Face**

• **We are actively working to cultivate a culture that prioritizes diversity, equity, and inclusivity**. We are intentionally creating a workplace where individuals feel valued and supported—regardless of their identity or background. We believe this is essential to building a great company and community. Hugging Face is an equal opportunity employer and does not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

• **We value professional development.** You will collaborate with some of the brightest minds in our industry. We are an organization that emphasizes impact and constantly challenges ourselves to evolve. We offer all employees reimbursement for relevant conferences, training, and educational opportunities.

• **We prioritize your well-being.** We provide flexible working hours and remote options. Health, dental, and vision benefits are available for employees and their dependents. Additionally, we offer parental leave and flexible paid time off.

• **We support our employees regardless of their location**. While we have office spaces in NYC and Paris, we are highly distributed, and all remote employees have the opportunity to visit our offices. If necessary, we will also equip your workstation to ensure your success.

• **We want our team members to be shareholders**. All employees receive company equity as part of their compensation package. Should we succeed in establishing ourselves as a category-defining platform in machine learning and artificial intelligence, everyone will benefit from the rewards.

• **We support the community**. We believe that significant scientific advancements stem from collaboration across the field. Join a community that champions the ML/AI domain.