Senior Software Engineer, Data Platform

This is a fully remote position, open to applicants in Canada.

📋 Description

• Develop robust and dependable data services that integrate with multiple blockchains.

• Create intricate ETL pipelines capable of processing petabytes of both structured and unstructured data in real-time.

• Design and structure data models that are optimized for storage, retrieval, and achieving sub-second query latency for blockchain data.

• Manage the deployment and monitoring of large database clusters, emphasizing performance and high availability.

• Work closely with data scientists, backend engineers, and product managers to design and implement data models that enhance TRM products.

• Establish scalable self-service automation for database and cluster scaling and maintenance.

• Identify opportunities to streamline delivery timelines and prioritize essential functionalities.

• Create initial “skateboard” versions, such as observability dashboards, and refine them based on stakeholder feedback.

⛳️ Requirements

• Bachelor's degree (or equivalent) in Computer Science or a related discipline.

• Over 5 years of practical experience in architecting distributed system architectures and guiding projects from conception to production deployment.

• Excellent programming capabilities in Python.

• Strong proficiency in SQL or SparkSQL.

• Familiarity with data stores and engines such as Iceberg, Trino, BigQuery, StarRocks, and Citus.

• Skilled in data pipeline and workflow orchestration tools such as Airflow and DBT.

• In-depth knowledge of data processing and streaming technologies, including Spark, Kafka, and Flink.

• Experience in deploying and monitoring infrastructure on public cloud platforms.

• Proficiency with technologies like Docker, Terraform, Kubernetes, and Datadog.

• Capability to load, query, and transform large datasets.

• Fluency in AI, with a focus on applying AI to enhance workflows, structure and solve problems, improve output quality, and boost speed and efficiency.

🏝️ Benefits

• Competitive benefits package, wellness programs, and time off, tailored to country and local employment regulations.

• Opportunity for remote work.

• A distributed-first company that encourages global collaboration.

• Support for professional growth and onboarding.

• Guidance in interview preparation.

• Reasonable accommodations for applicants with disabilities.