Data Platform Engineer – Spark, Kafka, Databricks

This is a fully remote position, open to applicants in Portugal.

📋 Description

• Become a member of a platform engineering team that manages the scalable data infrastructure essential for both product and analytics workloads on a global scale.

• Your work will involve distributed processing, streaming pipelines, orchestration, data quality, and observability, granting you full ownership over the components you develop.

• Engage in close collaboration with Data and ML Engineers while operating within a contemporary lakehouse architecture.

• CI/CD, IaC, and engineering best practices are prioritized as key focal points, not merely goals.

⛳️ Requirements

• 3–8 years of practical experience in data pipelines and cloud data infrastructure (Mid: 3–5 yrs / Senior: 5–8 yrs)

• Proficiency in Python at a production-grade, advanced level—this is engineering, not just scripting.

• Strong SQL skills with a solid grasp of complex queries and performance optimization.

• Practical experience with Apache Spark or Apache Flink for distributed data processing.

• Experience with Kafka or a similar streaming platform in production settings.

• Robust experience with at least one leading cloud data platform: AWS, GCP, or Azure.

• Expertise in data lakehouse or warehouse technologies such as Databricks, Snowflake, BigQuery, or Redshift.

• Familiarity with pipeline orchestration tools like Apache Airflow, Prefect, or Dagster.

• CI/CD experience for data workflows using tools like dbt, Git, and automated testing practices.

• Knowledge of Infrastructure as Code using Terraform or Pulumi.

• Hands-on experience with data quality and observability tools (Great Expectations, Monte Carlo, or equivalents).

• English proficiency: B2 (Upper Intermediate) — required.

• Must be based in Portugal — mandatory. Preference for Portuguese nationals or residents.

🏝️ Benefits

• 15th month salary.

• Health insurance that covers your family.

• Day off for your birthday.

• Mobility program for digital nomads.

• Genuine work-life balance.

• Comprehensive benefits package.