Staff Data Engineer, Tech Foundations

This is a fully remote position, open to applicants in United States.

📋 Description

• Spearhead the architecture, implementation, and management of impactful data pipelines related to AI utilization, costs, Unit Economics, enterprise applications, and essential financial metrics.

• Establish metrics for AI adoption, usage, and expenditure while creating consistent data models.

• Advance Unit Economics datasets that link revenue with various cost drivers.

• Develop ingestion and transformation pipelines for Jira and other BizTech enterprise applications.

• Convert unclear requirements into source contracts, reusable fact and dimension models, and technical designs.

• Create configurable pipelines and shared components for onboarding data sources, products, and business requirements.

• Implement automated testing, reconciliation, anomaly detection, and monitoring processes.

• Oversee migrations and historical backfills through dependency analysis, validation, controlled cutovers, and recovery planning.

• Enhance distributed processing, storage, and query performance.

• Ensure production reliability through on-call participation, incident response, and improvements to runbooks.

• Define the technical roadmap, lead design reviews, mentor engineers, and enhance Airbnb’s Data Engineering Paved Path.

⛳️ Requirements

• 9+ years of relevant industry experience with a Bachelor’s or Master’s degree in Computer Science, Electrical Engineering, or a related field, or equivalent practical experience; or 6+ years of relevant experience with a PhD.

• Proven history of leading complex data engineering projects from ambiguous requirements through architecture, delivery, and ongoing production ownership.

• In-depth expertise in SQL and strong programming skills in Python or Scala.

• Extensive experience with Apache Spark and large-scale analytical storage systems.

• Strong data modeling abilities, including fact and dimension design, slowly changing dimensions, incremental processing, and historical data management.

• Experience in integrating diverse sources, including APIs, enterprise applications, event data, and transactional systems.

• Proven capability to build reliable pipelines and carry out migrations and backfills.

• Experience in establishing data quality controls, observability, lineage, governance, and incident recovery practices.

• Strong performance engineering skills in distributed computation, storage, and query execution.

• Ability to align stakeholders across engineering and business functions while communicating architectural trade-offs.

• Demonstrated technical leadership through mentorship and architectural guidance.

• Familiarity with AI utilization or cost measurement, cloud cost attribution, Unit Economics, enterprise application data, or financial and payments datasets is advantageous.

• Knowledge of workflow orchestration, SQL transformation frameworks, and Apache Iceberg is beneficial.

• Must reside in a state where Airbnb, Inc. has a registered entity.

🏝️ Benefits

• Opportunities for occasional work at an Airbnb office or participation in offsite events, as agreed upon with your manager.

• Reasonable accommodations available throughout the recruitment process for applicants with disabilities.