Data Engineer

This is a fully remote position, open to applicants in United States, +1 more country.

📋 Description

• Develop and sustain essential data pipelines for Market Intelligence datasets.

• Extract, transform, schedule, and oversee survey responses, pricing series, volume and capacity forecasts, and buyer participation data.

• Automate the end-to-end processes for survey ingestion, cleaning, and joining.

• Enhance the reporting layer and link insights to tools, dashboards, and publications.

• Convert recurring custom research inquiries into standardized queries.

• Validate inputs, document assumptions, maintain version control, and generate reproducible outputs.

• Recognize and promote additional data use cases across various teams.

• Collaborate closely with the Market Intelligence team while engaging with Crux’s Data Team.

⛳️ Requirements

• Over 3 years of experience in developing and managing production data pipelines in dynamic, high-growth settings.

• Proficient in Python and SQL; capable of writing, testing, and debugging production code and complex queries.

• Expertise in cloud data warehousing, encompassing schema design, incremental data loading, query optimization, and cost management.

• Experience in extraction, transformation, loading, scheduling, and monitoring processes.

• Understanding of data-quality practices, including input validation, automated testing, monitoring, documentation, version control, and reproducible outputs.

• Ability to convert business or research requirements into technical specifications, deliverables, and implementation strategies.

• Skill in communicating technical trade-offs, project progress, data limitations, and delivery risks to both technical and non-technical stakeholders.

• Practical experience with AI-enabled tools for software development, data analysis, testing, documentation, or workflow automation.

• Strong technical judgment in evaluating datasets and engineering methodologies.

• Bonus: experience with energy, finance, transaction, or market intelligence data.

• Bonus: exposure to research, forecasting, survey analysis, or data-intensive publications.

• Bonus: experience in developing or supporting analytical or statistical models.

• Bonus: knowledge of model testing and data validation practices.

• Bonus: familiarity with data visualization, business intelligence, or reporting tools.

🏝️ Benefits

• Remote-first operating model: Work from anywhere in the US and Canada.

• Optional offices available in DC and NYC.

• Co-working opportunities available if desired.

• Regular team offsites held three times a year.

• Coverage of 100% of employee healthcare premiums; 70% subsidy for dependents.

• 100% coverage of dental and vision premiums for employees and 50% for dependents.

• 10 company holidays each year.

• 20 days of paid time off annually.

• 401k account available.

• Parental leave: 16 weeks for birthing parents and 12 weeks for non-birthing parents.

• Company-wide bonus linked to revenue objectives.

• Stock options available.

• Equal employment opportunity.