Senior Data Engineer, Guest & Host

This is a fully remote position, open to applicants in India.

📋 Description

• Design, develop, and maintain robust and efficient data pipelines that gather, process, and store information from various sources, including user interactions, listing details, and external data feeds.

• Create data models that facilitate effective analysis and manipulation of data for merchandising optimization, ensuring data quality, consistency, and accuracy.

• Construct scalable data pipelines utilizing SparkSQL and Scala in conjunction with the Airflow scheduler/executor framework.

• Collaborate with cross-functional teams, including Data Scientists, Product Managers, and Software Engineers, to establish data requirements and deliver data solutions that enhance merchandising and sales outcomes.

• Contribute to the wider Data Engineering community at Airbnb to influence tools and standards that enhance culture and productivity.

• Enhance code and data quality by utilizing and contributing to internal tools that automatically identify and resolve issues.

⛳️ Requirements

• A minimum of 6 years of relevant industry experience.

• Bachelor’s degree in computer science or a related technical field.

• Extensive experience in designing, building, and maintaining robust distributed data platforms (e.g., Spark, Kafka, Flink, HBase) and managing data at the petabyte scale.

• Proficient in Java, Scala, or Python, with expertise in data processing technologies and query authoring (SQL).

• Proven ability to analyze large data sets to identify gaps and inconsistencies, provide data insights, and develop effective product solutions.

• Expertise in ETL schedulers such as Apache Airflow, Luigi, Oozie, AWS Glue, or similar frameworks.

• Strong understanding of data warehousing concepts, along with practical experience with relational databases (e.g., PostgreSQL, MySQL) and columnar databases (e.g., Redshift, BigQuery, HBase, ClickHouse).

• Exceptional written and verbal communication skills.

🏝️ Benefits

• Bonuses

• Employee Travel Credits