Lead Data Engineer, Dataiku

This is a fully remote position, open to applicants in Portugal, +1 more country.

📋 Description

• Design scalable architectures for Dataiku DSS, encompassing projects, zones, Data Collections, and Shared Projects.

• Integrate Dataiku solutions into intricate enterprise IT settings.

• Set up data quality controls, monitoring systems, alerting mechanisms, and production-readiness standards.

• Advocate for strong engineering practices throughout development, testing, and production environments.

• Define coding standards, architectural guidelines, documentation practices, and code review procedures.

• Drive Dataiku governance, including naming conventions, connection management, security measures, and group-based permissions.

• Combine practical development, solution design, and leadership in client delivery.

• Guide and mentor Data Engineers while staying actively involved in technical tasks.

• Engage with both technical and business stakeholders to provide sound technical recommendations.

⛳️ Requirements

• Master's degree in Engineering, Computer Science, Data, Applied Mathematics, or a related field.

• Minimum of 7 years of professional experience in Data Engineering.

• At least 3 years of hands-on experience with Dataiku DSS in production environments.

• Demonstrated experience as a Technical Lead or in a similar technical leadership role.

• Experience with enterprise data platforms and production data settings.

• Proficient in French.

• Professional working proficiency in English.

• Extensive experience in designing and developing intricate Dataiku flows.

• Familiarity with visual, SQL, and Python recipes, scenarios, bundles, and Automation Nodes.

• Knowledge of Dataiku deployment and production architectures.

• Advanced SQL skills.

• Strong Python skills, including experience with pandas and the Dataiku Python API.

• Understanding of data modeling, data quality, and data lineage.

• Hands-on experience with at least one cloud data warehouse or processing platform: Snowflake, Databricks, or BigQuery.

• Experience with at least one cloud ecosystem: AWS, Azure, or GCP.

• Familiarity with Git and CI/CD practices.

• Knowledge of development, UAT, and production environments.

• Understanding of automated testing, monitoring, and observability.

• Capability to lead and mentor Data Engineers while maintaining a hands-on technical role.

• Strong communication abilities and confidence in engaging with technical and business stakeholders.

• A consulting mindset with the capacity to challenge requirements and make well-founded technical recommendations.

🏝️ Benefits

• Competitive salary commensurate with your experience and the data market.

• Meal allowance: €10.20/day.

• Flexible benefits plan.

• Private medical insurance.

• 22 days of annual leave, increasing every 3 years (up to 25 days).

• Continuous learning through KLX – Keyrus Learning Experience.

• A collaborative, international, and human-centered work environment.