Data Engineer – Databricks, Unity Catalog

This is a fully remote position, open to applicants in Spain.

📋 Description

• Create software engineering solutions utilizing Python.

• Deploy ML/AI solutions into a production environment.

• Design and manage multi-user platforms.

• Execute and oversee Infrastructure as Code, CI/CD, identity and secrets management, network isolation, and policy as code.

• Utilize Databricks, MLflow, and Unity Catalog in projects.

• Implement traditional machine-learning delivery patterns and agent-based methodologies.

• Develop and manage RAG systems, encompassing chunking, indexing, and retrieval processes.

• Uphold data security and governance standards.

• Collaborate with global teams and disseminate knowledge.

⛳️ Requirements

• Minimum of 5 years of experience in Python development.

• Proven experience in delivering ML/AI solutions in a production setting.

• Proficiency in RAG systems, including chunking, indexing, and retrieval techniques.

• Familiarity or strong technical interest in Databricks, particularly MLflow and Unity Catalog.

• Understanding of traditional machine-learning delivery patterns and agent-based strategies.

• Experience in designing and maintaining multi-user platforms.

• Proficient in Infrastructure as Code (IaC), CI/CD practices, identity and secrets management, network isolation, and policy as code.

• Knowledgeable in data security and governance practices.

• Fluent in English.

• Ability to work collaboratively with international teams.

• Experience transitioning from Kubernetes/Seldon to Mosaic is highly desirable.

🏝️ Benefits

• Permanent employment contract.

• Enhanced professional development opportunities and increased visibility within the tech community.

• Flexible working hours.

• Compressed work schedule every Friday and throughout three summer months.

• 23 vacation days annually.

• December 24th and 31st off.

• Commitment to an equal-opportunity workplace.

• Utilization of AI as a daily assistant to enhance creativity, productivity, and learning.