Data Architect

This is a fully remote position, open to applicants in Spain.

📋 Description

• Design and execute Lakehouse and Delta Lake architectures in cloud and multi-cloud settings.

• Develop and enhance ETL/ELT pipelines leveraging Apache Spark, Structured Streaming, and Lakeflow Declarative Pipelines.

• Establish data governance, security, and lineage frameworks utilizing Unity Catalog.

• Define AI governance strategies through Unity Gateway.

• Create environments that facilitate Machine Learning, Generative AI, and advanced analytics with MLflow and Databricks Genie.

• Enhance the performance and cost-efficiency of the Databricks platform by applying FinOps best practices.

• Engage in data platform modernization and migration initiatives towards Lakehouse architectures.

• Provide guidance to clients on Databricks best practices.

• Collaborate effectively with both technical and business teams.

⛳️ Requirements

• Extensive experience in data architecture and crafting Databricks-based solutions.

• In-depth understanding of Apache Spark, Delta Lake, Unity Catalog, and Photon.

• Proficiency with cloud platforms such as Azure, AWS, or GCP.

• Familiarity with cloud infrastructure, networking, storage, and IAM security measures.

• Experience in designing ETL/ELT pipelines and data processing solutions.

• Knowledge of data governance, performance optimization, and Lakehouse architectures.

• Excellent communication skills, independence, and a customer-centric approach.

• Proficient in both English and Spanish, written and spoken.

• Bachelor’s degree in Computer Science, Information Systems, or equivalent professional background.

• Familiarity with Lakeflow, MLflow, Genie, or Unity Gateway.

• Understanding of Generative AI and Machine Learning concepts.

• Experience in migrating legacy data platforms to Databricks.

• Knowledge of FinOps principles and cloud cost management.

• Databricks Data Engineer Professional certification or Platform Architect credentials.

🏝️ Benefits

• Annual performance bonus tied to individual, team, and company goals.

• Flexible compensation package, encompassing transport, childcare, training, health insurance, and meal benefits.

• Employee discounts.

• Physiotherapy services.

• Complimentary English language classes.

• Opportunities for career development.

• Access to training and certification programs.

• Annual performance evaluations.

• 100% remote working arrangement.