Lead Engineer, Data Platform

This is a fully remote position, open to applicants in Spain.

📋 Description

• Take charge of the complete architecture and development of the enterprise data platform across hybrid settings.

• Define the technical strategy, roadmap, standards, and reusable frameworks for orchestration, scheduling, and data processing.

• Spearhead architectural decisions, proof of concepts, and adoption strategies with a focus on scalability, security, and cost-effectiveness.

• Establish standards for reliability, observability, and operations, including monitoring, alerting, failure recovery, and service level objectives (SLOs).

• Promote automation through infrastructure as code, continuous integration/continuous deployment (CI/CD), and automated testing.

• Perform design and code evaluations.

• Guide team members and foster a culture of engineering excellence.

• Offer a secure, scalable, and reliable foundation for the storage, processing, and distribution of essential enterprise data across both cloud and on-premises environments.

⛳️ Requirements

• Over 12 years of experience in data/platform engineering, specializing in the design and operation of enterprise-scale data platforms.

• Extensive, hands-on expertise with Snowflake (architecture, ingestion, transformation, workload management, cost, governance).

• Experience in production environments with Apache Airflow and Apache Kafka/event-driven architectures.

• Proven capability to integrate both batch and streaming pipelines (Snowflake, Airflow, Kafka).

• Proficient in advanced Python and SQL.

• Familiarity with Terraform, Git, and CI/CD methodologies.

• Experience in regulated environments, focusing on security, data quality, access management, and compliance.

• Demonstrated technical leadership, including team direction, mentoring, and communication with both technical and business stakeholders.

• Proficient in English, both written and spoken.

• Experience with Java for Kafka-based services/connectors is a bonus.

• Familiarity with OpenShift or Kubernetes is an added advantage.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Comprehensive health benefits including medical, dental, and vision.

• Flexible work environment with options for remote work.

• Opportunities for professional development and continuous learning.

• Engaging company culture with team-building activities and events.