Senior Data Pipeline Engineer – Freelance

This is a fully remote position, open to applicants in Switzerland.

📋 Description

• Take ownership in designing, building, and managing Spark-based data pipelines from the development phase through to production and monitoring.

• Enhance and operationalize machine learning models for AdTech applications, including lookalike modeling and demographic modeling.

• Utilize LLM-powered code assistants, design generators, and test automation tools to boost both speed and quality.

• Collaborate with the team to share workflows that enhance productivity using AI.

• Profile, benchmark, and optimize Spark workloads.

• Implement best practices in orchestration and observability.

• Ensure the technology stack remains future-proof.

⛳️ Requirements

• Bachelor’s, Master’s, or PhD degree in Computer Science, Data Engineering, or a related discipline.

• Over 5 years of professional experience in the field.

• Proficient in Python and experienced with PySpark/Scala Spark.

• Demonstrated ability to create resilient, production-level data pipelines with thorough data quality and validation checks.

• Skills in operating data platforms involving Spark clusters, job schedulers, or orchestration frameworks like Airflow, Dagster, or custom schedulers.

• Familiarity with the machine learning lifecycle and model serving is advantageous.

• Knowledge of audience segmentation or lookalike modeling is a plus.

• Proficiency in Rust is an added advantage.

🏝️ Benefits

• Competitive compensation rates.

• Opportunity for ownership rather than merely executing tasks.

• Join an amazing and fun team distributed across Europe.

• Potential for conversion to a full-time employee after a 6-month freelance engagement.

• No requirement for a formal motivational letter.