Senior Data Engineer

This is a fully remote position, open to applicants in Cyprus.

📋 Description

• Design, construct, and sustain streaming pipelines.

• Create custom ingestion pipelines utilizing third-party APIs, webhooks, and SDKs.

• Transition existing data ingestion pipelines from SaaS tools to our proprietary infrastructure.

• Deliver data to the raw layer of our Snowflake warehouse, ensuring schema consistency, idempotency, and resilience against malformed or late data.

• Enhance the current AWS streaming stack (Kinesis, SQS, Lambda, API Gateway) to improve cost efficiency, observability, and resilience.

• Maintain infrastructure as code (Terraform) for ingestion and processing resources.

• Monitor pipelines, troubleshoot issues, and resolve incidents.

• Contribute to ongoing initiatives for secure data access for AI agents and tooling.

• Continuously refine ingestion architecture, tooling, and engineering practices.

⛳️ Requirements

• Over 5 years of professional Python experience in a backend or data engineering capacity.

• Strong understanding of distributed systems architecture, including load balancing, sharding, and the trade-offs between synchronous and asynchronous processing.

• Practical experience with cloud services, particularly AWS (Lambda, API Gateway, containers in ECS/EKS).

• Proven experience in building streaming pipelines (Kinesis, SQS, or similar).

• Familiarity with infrastructure as code (Terraform or similar tools).

• Proficient in SQL: capable of reading and writing queries, including joins and window functions.

• Commercial experience with real-world production data: adept at designing systems that effectively manage messy, duplicated, delayed, or malformed input.

• Comprehensive understanding of data flow through production systems, with the ability to foresee and mitigate downstream issues.

• Operational mindset: comfortable taking ownership of production systems and monitoring them.

• Ability to make independent architectural decisions and evaluate the work of colleagues.

• Nice to Have

• Strong SQL and data modeling capabilities.

• Experience with Snowflake and dbt.

• Familiarity with workflow orchestrators (Airflow, Dagster, Prefect, or similar).

• Experience collaborating with analytics and product teams as a data provider.

• Experience handling sensitive or regulated data.

🏝️ Benefits

• Open-minded teams, a welcoming and inclusive company culture, along with the opportunity to significantly impact a game-changing health tech product.

• A competitive salary package reflecting your unique expertise, skill set, and contribution to the product, in addition to stock options.

• Options for in-office, remote, and hybrid work arrangements.

• The necessary equipment to ensure your happiness and productivity.

• A premium SIMPLE subscription.

• 21 days of annual leave plus bank holidays (as observed in your location).

• Flexible working hours. We prioritize your results over the time spent at your desk.