Senior Data & AI Platform Engineer

This is a fully remote position, open to applicants in Germany.

📋 Description

• Develop and enhance OrderYOYO’s data platform to serve as a unified source of truth for executive reporting, merchant insights, finance automation, and AI.

• Architect, build, and manage production-level data solutions in Microsoft Fabric, encompassing Lakehouse, Warehouse, notebooks, pipelines, and associated platform functionalities.

• Create and maintain production pipelines utilizing Fabric, Python, and PySpark.

• Design ingestion and transformation patterns across various source systems, databases, and business domains, while managing source impact, concurrency, and platform costs.

• Oversee Fabric capacity and expenses, and phase out redundant legacy components.

• Guide migrations from legacy systems to modern platforms, ensuring metric parity, stakeholder approval, change management, and safe decommissioning.

• Operate the platform in production by implementing monitoring, alerting, incident triage, root-cause analysis, data quality verification, lineage tracking, and runbooks.

• Troubleshoot and resolve production challenges involving SQL, Spark, pipelines, and semantic models.

• Collaborate with analytics and business stakeholders to support and refine governed semantic models and reusable metric definitions.

• Integrate AI capabilities into the platform and delivery using RAG, Azure OpenAI, and agents, managing prompts and versions effectively.

• Deliver applied data science initiatives such as churn prediction, recommendations, personalization, fraud detection, or risk modeling, showcasing the outcomes.

• Partner with executives, Finance, Product, and engineering teams to make informed decisions regarding speed, standardization, automation, and risk management.

⛳️ Requirements

• Over 6 years of relevant data experience, including significant recent hands-on roles in data engineering or data-platform engineering within production environments.

• Proven capability to independently manage a data-engineering project from requirements gathering and technical design to implementation, production deployment, monitoring, and ongoing maintenance.

• Extensive practical experience with Microsoft Fabric, or strong familiarity with Synapse, Databricks, or Delta, with a clear transition path to Fabric.

• In-depth knowledge of lakehouse architecture and Delta-based data engineering, including partitioning, schema evolution, file optimization, and performance factors.

• Expertise in SQL and T-SQL, including complex modeling and tuning.

• Experience in production-grade Python or PySpark development.

• Strong background in designing and implementing incremental data ingestion patterns, such as CDC, change tracking, or watermarks, ensuring reliable merge/upsert, replay, and idempotent processing.

• Familiarity with analytical and semantic data modeling, preferably with Power BI/Fabric semantic models, focusing on performance optimization, governance, and reusable business metrics.

• Basic understanding of Azure platform fundamentals, including Azure SQL, ADLS/OneLake, Entra ID, managed identities, RBAC, and Key Vault.

• A successful history of leading legacy-to-modern migrations.

• Genuine, hands-on experience in AI engineering beyond standard Copilot functionalities.

• Tangible data science or ML models delivered, demonstrating measurable results.

• Proficient in Power BI/Fabric, including Direct Lake, DAX, semantic model performance tuning, incremental refresh, and capacity considerations.

• Experience with Infrastructure-as-Code tools such as Terraform, Bicep, or similar.

• Data platform experience in sectors such as SaaS, marketplace, fintech, payments, e-commerce, or multi-region enterprises.

🏝️ Benefits

• A remote position, with quarterly in-person meetings at one of our global offices.

• Responsibility for a critical business data and AI platform.

• A collaborative and international engineering team environment.