Senior Data Engineer

This is a fully remote position, open to applicants in Asia.

📋 Description

• Construct and uphold batch and streaming data pipelines utilizing Python, SQL, Kafka, and Spark.

• Create and manage Airflow workflows, encompassing scheduling, dependency oversight, retries, and recovery processes.

• Design and maintain data models and datasets for analytics and reporting within the data warehouse.

• Enhance data quality and freshness through validation, monitoring, and investigating upstream and downstream issues.

• Optimize the performance of pipelines and queries, while managing processing and storage expenses.

• Collaborate with data users to define datasets and metrics, and document data flows, transformations, and dependencies.

• Sustain and evolve WOO X’s data platform.

• Partner with engineering and business teams to comprehend data production and usage, tackle quality challenges, and enhance platform maintainability.

⛳️ Requirements

• Experience in data engineering within the crypto or Web3 sector, including oversight of production pipelines or a data platform.

• Proficient in Python and SQL, with experience in constructing maintainable data processing workflows.

• Practical experience with Airflow, Kafka, and Spark.

• Familiarity with data warehouses, ETL/ELT pipelines, and data modeling.

• Capability to investigate data inconsistencies, troubleshoot pipeline failures, and address root causes.

• Ability to work autonomously and convey technical details and business requirements clearly in Mandarin.

• Nice to have: Experience at a centralized crypto exchange, particularly related to trading, order, or account data.

• Nice to have: Business Intelligence experience, including supporting dashboards, defining metrics, or preparing datasets for business users.

• Nice to have: Strong English communication skills.

🏝️ Benefits

• Fully remote within the APAC region.

• Mandarin as the primary working language for the team.

• Opportunity to engage with a data platform that is integral to the daily operations of a crypto exchange.