Senior Data Platform Engineer

This is a fully remote position, open to applicants in Ukraine, +1 more country.

📋 Description

• Design, construct, and enhance the company’s data infrastructure.

• Create intricate, high-volume batch and near-real-time ingestion services while contributing to the advancement of the platform’s streaming capabilities.

• Architect and implement data solutions to meet application requirements in a distributed microservices environment.

• Develop and refine large-scale data pipelines for both batch and streaming scenarios.

• Ensure the integrity, compliance, and governance of data.

• Manage and optimize Kubernetes infrastructure, leveraging KEDA for dynamic resource scaling to accommodate large-scale data processing workloads.

• Oversee the entire lifecycle of the data stack using Terraform and Kubernetes, from provisioning to application-level frameworks.

• Provide technical leadership for the team and promote best practices in infrastructure, CI/CD, testing, and system design.

• Conduct in-depth analysis of memory management and performance tuning to ensure that large-scale distributed systems are both cost-effective and efficient.

⛳️ Requirements

• A minimum of 5 years of experience as a Data Platform/Infrastructure Engineer.

• Demonstrated success in building and operating scalable data infrastructure, particularly within Data Lake architectures.

• Proven expertise in designing and managing large-scale data processing workloads on Kubernetes, including workload autoscaling with KEDA.

• Strong command of Python and SQL.

• Practical experience with Infrastructure as Code, ideally using Terraform.

• Familiarity with managing a data orchestration platform such as Airflow or Prefect.

• Experience with Snowflake.

🏝️ Benefits

• Mobilization reservation available upon successful completion of the probation period (for Ukrainian colleagues).

• 20 days of vacation coverage.

• Access to top-tier equipment.

• Professional bookkeeping services provided by an accountant.

• Assistance and support from our dedicated HR team.