Staff Software Engineer, Data

This is a fully remote position, open to applicants in United States.

📋 Description

• Take full ownership of the company's data platform from start to finish, which includes the S3/Athena/Glue lake, dbt project, integrations, and the Postgres serving layer.

• Create and manage integrations between billing, CRM, ERP, identity, and telemetry systems.

• Design and sustain dimensional models, data contracts, quality tests, lineage, and a data catalog.

• Implement PII tiering through access grants in cooperation with Security and Legal teams.

• Process billions of telemetry rows, large log streams, and Iceberg tables at scale.

• Manage orchestration and infrastructure on EKS, including Helm, Terraform, CI/CD, monitoring, and alerting.

• Participate in the on-call rotation during business hours for daily pipeline operations.

• Provide operational reporting to Finance and leadership regarding revenue, credits, prepaid liabilities, and cloud costs.

• Assist research teams in audio, video, image, and 3D by sourcing, checking licenses, ingesting, and versioning training datasets.

• Develop generation, filtering, deduplication, and captioning pipelines for both raw and synthetic media.

• Execute training data workloads at scale using the SLURM cluster and cloud object storage.

• Maintain lineage, quality metrics, and documentation for datasets to ensure reproducible training sets.

• Lead design reviews, mentor team members, and produce runbooks.

• Collaborate with Finance, Marketing, SRE, Security, Product, and Research on organization-wide data initiatives.

⛳️ Requirements

• Over 6 years of experience in building and managing production data platforms, including architectural ownership.

• Proficient in integrating SaaS business systems like Stripe, HubSpot, an ERP, and an identity provider into a data warehouse.

• Practical experience in preparing large multimodal training datasets and executing batch workloads on HPC or cloud schedulers, such as SLURM or Kubernetes.

• Ability to work independently within a small team while taking real ownership.

• Expert in SQL and Python, with strong software engineering practices such as testing, code review, and continuous integration.

• Experience with data warehouses and lakes utilizing Iceberg or Delta on S3, Athena/Trino, Snowflake or BigQuery, and dbt.

• Hands-on experience with orchestrators like dbt, Airflow, or Argo.

• Experience in distributed processing using Spark or similar technologies.

• Familiarity with AWS, Kubernetes (EKS), Helm, and Terraform.

• Ability to troubleshoot failing Glue jobs and address issues with broken Helm releases.

• Previous experience with 0-to-1 platform ownership in a startup environment is a plus.

• Experience collaborating with research teams on generative models or hands-on work with audio, video, image, or 3D data is an added advantage.

• Knowledge of FinOps and cloud cost reporting is an additional strength.

• Understanding of SOC 2 or similar compliance requirements for data access is a further advantage.

🏝️ Benefits

• Health coverage for you and your family, featuring PPO and HMO plans, including options where Stability AI covers 100% of premiums for you and your eligible dependents.

• Access to HSA and FSA accounts.

• Company-funded life insurance, with optional voluntary coverage available for yourself, your spouse, and your children.

• Coverage for short- and long-term disabilities.

• 401(k) plan with company matching up to 4%.

• Paid parental leave.

• Flexible paid time off policy.

• Company-paid holidays.

• Equipment provided by Stability AI.

• Eligible employees can participate in the equity program.