Senior Data Platform Engineer

This is a fully remote position, open to applicants in Poland.

📋 Description

• Actively engage in the development and upkeep of our data pipelines and backend services;

• Integrate blockchain technologies, Automated Market Maker (AMM) protocols, and bridges into Crystal's platform;

• Incorporate new technologies into our tools and processes;

• Design and implement features from start to finish;

• Write, debug, test, and continuously deliver features and enhancements;

• Offer code reviews, support, and constructive feedback to fellow team members.

⛳️ Requirements

• Over 8 years of experience in software engineering, specifically in developing backend services/APIs or data pipelines;

• Proficient in Python with strong expertise;

• Advanced SQL skills, with the ability to write, comprehend, and debug complex queries;

• Solid understanding of database architecture principles;

• Extensive experience with data lakes, data warehouses, and both relational and analytical databases;

• Familiarity with the POSIX/Unix/Linux ecosystem;

• Knowledge of blockchain technology or a willingness to learn;

• Familiarity with Unit Testing principles;

• Experience with Docker containers and a proven track record of migrating existing services;

• Ability to work independently and autonomously;

• Team-oriented mindset with strong communication skills is advantageous;

• Practical experience with big data frameworks such as Kafka, Spark, Dask, Flink, and Data Lakes is a plus;

• Knowledge of Kubernetes and Infrastructure as Code tools like Terraform and Ansible is a plus;

• Experience with API frameworks such as Flask or FastAPI is a plus;

• Familiarity with distributed systems is a plus;

• Experience with open-source solutions is a plus;

• Background in Java or a willingness to learn is a plus.

🏝️ Benefits

• Flexible work arrangements