Senior Data Engineer, Data Platform

This is a fully remote position, open to applicants in United States.

📋 Description

• Create highly dependable data services to connect with numerous blockchains.

• Construct intricate ETL pipelines that convert and handle petabytes of both structured and unstructured data in real-time.

• Design and structure complex data models for optimal storage and retrieval, ensuring sub-second latency when querying blockchain data.

• Manage the deployment and oversight of substantial database clusters, maintaining a strong emphasis on performance and high availability.

• Collaborate across various departments, working with data scientists, backend engineers, and product managers to develop and implement innovative data models that improve TRM’s products.

⛳️ Requirements

• A Bachelor’s degree (or equivalent) in Computer Science or a related discipline.

• A demonstrated history of 5+ years of practical experience in designing distributed system architecture, successfully guiding projects from initial conception to production deployment.

• Outstanding programming abilities in Python, along with proficiency in SQL or SparkSQL.

• Extensive experience with data storage solutions such as Iceberg, Trino, BigQuery, StarRocks, and Citus.

• Skilled in data pipeline and workflow orchestration tools such as Airflow, DBT, etc.

• Expertise in data processing technologies and streaming workflows, including Spark, Kafka, and Flink.

• Capability in deploying and monitoring infrastructure on public cloud platforms, utilizing tools like Docker, Terraform, Kubernetes, and Datadog.

• Proven skills in loading, querying, and transforming large datasets.

🏝️ Benefits

• Health insurance

• Flexible working hours

• Professional development opportunities

• Wellness programs