Senior Data Engineer – Payments

This is a fully remote position, open to applicants in India.

📋 Description

• Design, develop, and maintain robust and efficient data pipelines that gather, process, and store data from various sources, including user interactions, listing information, and external data feeds.

• Create data models that facilitate the effective analysis and manipulation of data for merchandising optimization, ensuring quality, consistency, and accuracy.

• Produce high-quality data assets for product-related use cases by collaborating with Product, AI/ML, and Data Science teams.

• Construct scalable data pipelines (SparkSQL & Scala) utilizing the Airflow scheduler/executor framework.

• Work in partnership with cross-functional teams, including Data Scientists, Product Managers, and Software Engineers, to define data requirements and deliver data solutions that enhance merchandising and sales.

• Contribute to the wider Data Engineering community at Airbnb to influence tools and standards that improve culture and productivity.

• Enhance code and data quality by leveraging and contributing to internal tools that automatically identify and resolve issues.

⛳️ Requirements

• Over 6 years of relevant industry experience.

• Bachelor's or equivalent technical degree in computer science or a related field.

• Practical experience in DSA coding - Data Structures and Algorithms.

• Extensive experience in designing, building, and managing robust distributed data platforms (e.g., Spark, Kafka, Flink, HBase) and handling data at the petabyte scale.

• Strong proficiency in Scala or Python, along with expertise in data processing technologies and query authoring (SQL).

• Proven ability to analyze large data sets to identify gaps and discrepancies, provide data insights, and develop effective product solutions.

• Expertise in ETL schedulers such as Apache Airflow, Luigi, Oozie, AWS Glue, or similar frameworks.

• Solid understanding of data warehousing concepts and hands-on experience with relational databases (e.g., PostgreSQL, MySQL) and columnar databases (e.g., Redshift, BigQuery, HBase, ClickHouse).

• Exceptional written and verbal communication skills.

🏝️ Benefits

• Our Commitment To Inclusion & Belonging: Airbnb is dedicated to collaborating with the most diverse talent pool possible. We believe that diverse ideas inspire innovation and engagement, enabling us to attract creatively-driven individuals and develop the best products, services, and solutions. All qualified individuals are encouraged to apply.