Senior GEN-AI Engineer, Data & Platform

This is a fully remote position, open to applicants in Spain.

📋 Description

• Develop and sustain production-quality GEN-AI services utilizing Python.

• Create clean, maintainable, and efficient code.

• Enhance applications for performance, reliability, and scalability.

• Design systems that can process, enrich, and learn from real-time event streams.

• Collaborate with data pipelines, message queues, retrieval systems, and streaming architectures.

• Construct dependable context and retrieval layers for LLM-powered products.

• Elevate LLM quality through context engineering, evaluation, observability, and feedback loops.

• Design systems considering idempotency, retries, deduplication, backpressure, and recovery from failures.

• Work closely with backend, data, product, and infrastructure teams.

⛳️ Requirements

• Bachelor's degree in Computer Science, Engineering, or a related discipline.

• Over 1 year of experience with GEN-AI initiatives.

• More than 5 years of experience with the Python programming language.

• Demonstrated experience in building data-intensive applications.

• Practical experience in delivering production systems, beyond prototypes or notebooks.

• Familiarity with event-driven systems, message queues, or streaming architectures.

• Knowledge of Kubernetes or cloud-native infrastructure.

• Strong grasp of observability, metrics, logging, alerts, and debugging in production.

• Capacity to reason about reliability topics such as idempotency, retries, duplicate events, backpressure, latency, and failure modes.

• Experience with distributed systems, including design patterns for scalability, fault tolerance, data consistency, and partitioning in large-scale production settings.

• Proficient in data retrieval techniques.

• Familiarity with DSPy, GEPA, or other LLM optimization/evaluation techniques is advantageous.

• Experience with any of the following is a strong plus: RisingWave or other streaming databases.

• Apache Kafka or comparable event-streaming systems.

• Apache Iceberg, data lakes, lakehouse architectures, or Ice Lake-style platforms.

• Airflow or similar workflow orchestration tools.

• PostgreSQL or other relational databases at scale.

• Knowledge of vector databases or hybrid search.

• Expertise in real-time data processing.

• Familiarity with data retrieval systems.

🏝️ Benefits

• Competitive salary based on performance and experience.

• Opportunity to earn Klar stock options.

• 26 days of paid vacation annually.

• Provision of a computer device.

• International work environment with exceptional and highly skilled professionals.

• A world-class team dedicated to helping you develop your skills in areas of interest.

• Wellhub subscription to support mental and physical health.