Senior Data Engineer

This is a fully remote position, open to applicants in United States, +1 more country.

📋 Description

• Create, develop, and manage the ingestion and transformation pipelines that incorporate labor market, customer, and product data into our data warehouse and product offerings.

• Take ownership of the structure, testing, and documentation of our core data, which includes the skills, occupation, and career taxonomies central to the product.

• Construct the transformation layer and datasets that drive internal analytics, as well as Looker/Quicksight reporting, and the insights we provide to our customers.

• Develop and sustain the pipelines that support our matching and recommendation models, collaborating with Engineering and Data Scientists to ensure models are deployed, monitored, and enhanced in a production environment.

⛳️ Requirements

• Extensive data engineering experience (approximately 4+ years) in designing and managing production ETL/ELT pipelines relied upon by other individuals and systems.

• Proficiency in Python and SQL, with a strong emphasis on SQL — experience in data modeling within a warehouse/data lake, rather than just executing queries.

• Practical experience with a contemporary orchestration and transformation stack (such as Airflow, dbt, or similar) and with cloud-based data warehouses.

• Experience in integrating data from diverse external sources — including third-party data providers, APIs, and flat file feeds — while managing schema changes, unreliable delivery, and varying quality from upstream sources.

• Comfort in handling large, unstructured, and inconsistently formatted data, along with sound judgment regarding when to clean it, when to model around it, and when to challenge the source.

• A proactive approach to reliability: testing, monitoring, and debugging your own pipelines instead of waiting for issues to be reported.

• Strong communication skills: able to articulate a data model and its implications to a non-technical audience.

🏝️ Benefits

• Competitive salary

• Flexible work arrangements

• Professional development opportunities

• Travel for team gatherings and off-sites