Senior Data Engineer

This is a fully remote position, open to applicants in Switzerland.

📋 Description

• Design and expand high-throughput streaming pipelines utilizing Apache Beam and Dataflow.

• Enhance data flows into BigQuery and Bigtable to ensure speed and reliability.

• Create and manage Python-based data APIs using FastAPI for internal services.

• Optimize data systems to increase their speed, reliability, and user-friendliness.

• Analyze complex data anomalies and address their root causes.

• Collaborate with ML/Product teams to create practical and effective data schemas.

• Oversee production Python code using tools such as Poetry, Ruff, and pytest.

• Guarantee seamless movement of streaming and batch data from ingestion to storage.

• Deliver dependable, high-quality data for crucial security decision-making.

• Transition from addressing pipeline issues and updating documentation to taking ownership of significant fixes, updates, and essential projects.

⛳️ Requirements

• Minimum of 4 years experience in building, operating, and maintaining contemporary data pipelines.

• Proficient in Apache Beam and Dataflow (experience with PySpark is a plus) or similar tools.

• Extensive expertise with BigQuery and Bigtable or equivalent tools.

• Strong skills in FastAPI and asynchronous programming.

• Familiarity with linting and automated testing frameworks, such as Ruff and Pytest.

• Experience with production Python code using Poetry, Ruff, and pytest.

• Capability to investigate intricate data anomalies and pinpoint root causes.

• Ability to collaborate with ML/Product teams to develop practical, usable data schemas.

• Full ownership of the data lifecycle from inception to completion.

• Effective communication skills in a remote work environment.

🏝️ Benefits

• Work with purpose and take ownership in an international team.

• Grow with a company that values your ideas.

• Flexibility to work remotely or at our Zurich headquarters.

• Participate in our annual company-wide event.

• Continue learning with an annual education budget.

• Engage in joint co-working days for remote team members.