Data Engineer

This is a fully remote position, open to applicants in France.

📋 Description

• Create, develop, and enhance a scalable data platform that supports product data solutions.

• Collaborate with product and business teams to devise scalable and agile solutions.

• Establish technical standards and contribute to the architecture and deployment decisions of the data platform based on the strategic product roadmap.

• Develop, deploy, and oversee efficient data platforms and automated data pipelines utilizing both cloud-based and on-premise technologies.

• Design, maintain, and enhance essential data product features concerning quality, certification, accessibility, and integration.

• Analyze and develop data operations and pipelines adhering to enterprise guidelines and best practices.

• Implement data quality processes and manage governance, as well as curate data catalogs and glossaries.

• Sustain and improve existing pipelines by integrating new features and handling change requests through an agile methodology.

• Ensure data quality, lineage, versioning, and observability throughout the stack.

• Support CI/CD and release management processes.

• Oversee the end-to-end onboarding of the existing data platform, encompassing sources, ingestion jobs, warehouse models, orchestration, BI layer, and consumers.

• Conduct audits of the current stack, pinpoint risks and gaps, and estimate their associated costs.

• Deliver quick wins, such as rectifying an unreliable pipeline, addressing a cost anomaly, or ensuring trust in a critical dataset.

• Develop and validate a technical roadmap that outlines the target architecture, technology selections, and migration pathways.

• Enhance data engineering standards regarding repository structure, Git workflows, CI/CD, environments, code reviews, and deployment processes.

• Scale the data platform in alignment with data volume and product growth while managing pipeline costs effectively.

• Minimize incidents and reduce the time-to-detect for critical datasets.

• Implement observability mechanisms that include freshness, volume, and schema checks, as well as alerting, SLAs, and ownership.

• Enable new product analytics, in-product data utilization, and ML/AI applications.

• Act as a data architecture reference point for the C-suite and Product teams.

⛳️ Requirements

• Master's degree in computer science, distributed systems, data engineering, engineering, or a related field.

• Over 5 years of experience with intensive data platforms within the context of Big Data and cloud infrastructures/platforms.

• Strong foundation in Big Data architecture methodologies and DBMS/Data Warehouse modeling, optimization, and management.

• In-depth knowledge of SQL, Python, and Spark-related programming languages.

• Experience with data warehouses and lakes, including BigQuery, Snowflake, Databricks, Storage, and Delta Lake.

• Extensive expertise in data preparation, integration, modeling, and governance processes.

• Proven track record in designing and managing end-to-end production-ready solutions.

• Experience in developing, optimizing, and maintaining scalable data ingestion and transformation pipelines using modern data technologies, including Pub/Sub and Kafka.

• Familiarity with DataOps practices: Git, Docker, CI/CD methodologies such as Jenkins, and deployment workflows in a data engineering context.

• Experience in ensuring data quality, consistency, and performance across data platforms while applying data governance principles.

• Strong analytical skills with the ability to tackle complex data challenges and continuously enhance data solutions.

• Capability to excel in a fast-paced, demanding environment with significant ownership, structure, and execution speed.

• Proficiency in both French and English.

• Nice to have: practical experience with NoSQL, Search DBMS, or OLAP DBMS.

• Nice to have: initial experience in B2B SaaS.

🏝️ Benefits

• Competitive salary along with a company bonus (up to 18K€ per year based on the company's performance).

• 38 days of vacation per year.

• Alan Blue: Comprehensive medical coverage at 100% premium for you and your family.

• Swile Meal Tickets: Daily meal tickets to enhance productivity.

• Navigo Card: Full coverage for seamless commuting with a Navigo card.

• Provision of a laptop, tools, and equipment necessary for the role.

• Team building: Annual company gatherings at various locations worldwide.