Staff Software Engineer, Data Catalog

This is a fully remote position, open to applicants in United States.

📋 Description

• Spearhead initiatives to develop Data Catalog infrastructure products within Airbnb’s Data Ecosystem.

• Create and execute data catalog products that facilitate data discovery, metadata management, data quality, and data lineage.

• Design and implement metadata infrastructure for ownership management, data classification, data privacy, access control, and data retention.

• Construct a comprehensive data lineage product that encompasses online, offline, machine learning, metrics, visualizations, and third-party datasets.

• Collaborate with cross-functional teams to catalog and manage Airbnb datasets while adhering to business and regulatory objectives.

• Establish and uphold metadata quality and governance standards.

• Design and create metadata integrations with data infrastructure framework teams.

• Develop scalable metadata onboarding and integration infrastructure and processes.

• Formulate metadata-driven data policies and procedures that align with data governance requirements.

⛳️ Requirements

• BS/MS/PhD in Computer Science or a related discipline, or equivalent professional experience.

• Over 9 years of experience in software engineering, concentrating on data infrastructure.

• Proficient in data storage and distributed processing technologies such as Hive, Spark, Trino, Flink, or SQL databases.

• Strong programming capabilities in Java, Python, or Scala.

• Familiarity with data catalog products, encompassing metadata infrastructure, metadata management, metadata integration framework and tools, and metadata-driven data management.

• Experience with workflow orchestration solutions like Apache Airflow, Prefect, or Kubeflow.

• Solid understanding of data governance frameworks, policies, and processes, including data classification, data lineage, data quality, data privacy, and retention.

• Outstanding communication and collaboration skills across various functions.

• Willingness to step outside of the conventional comfort zone.

• Exceptional analytical and problem-solving abilities.

• Must reside in a state where Airbnb, Inc. has a registered entity.

🏝️ Benefits

• Bonus eligibility.

• Equity eligibility.

• Comprehensive benefits.

• Employee Travel Credits.

• Eligibility for remote work.

• Occasional work at an Airbnb office or participation in offsite events, as mutually agreed with the manager.

• Disability accommodations during the application and interview process.