Data Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Develop and sustain ingestion and transformation pipelines utilizing Dagster or Airflow, dbt, Snowflake, Python, Airbyte, and AWS.

• Open and merge pull requests related to Dagster jobs, assets, schedules, sensors, dbt models, tests, and documentation.

• Occasionally write Terraform scripts for managing secrets, environment variables, or job sizing.

• Construct and troubleshoot Python pipelines for REST/API synchronizations, large Postgres extracts, Parquet loads, and Snowflake COPY operations.

• Configure and resolve issues with Airbyte connections.

• Monitor production runs and investigate failures related to IAM, OOM, Spot instances, and watermarks.

• Execute backfills and incremental catch-ups.

• Collaborate with analytics and product teams on dimensional/fact model design, incremental strategies, and ensuring data quality.

• Engage in code reviews and assist in release preparations.

• Create runbooks for operating pipelines.

• Successfully navigate the interview process with PeopleOps, the Principal Data Scientist, key stakeholders, and a company leader.

⛳️ Requirements

• Strong understanding of relational databases and warehouse patterns, including keys, grain, normalization versus star schema, and the encoding of SCD behavior.

• Hands-on experience with Dagster (or Airflow) is essential.

• Proven experience in building and maintaining models, tests, and documentation in dbt.

• Proficient in reading and writing Python that facilitates data movement at scale across extract, transform, and load stages.

• Familiarity with S3, IAM, and ECS/Fargate, at a level sufficient for debugging jobs.

• Experience utilizing Airbyte or similar extract-and-load tools.

• Commitment to writing pull requests that are easily reviewable and providing thorough reviews for others.

• Demonstrated history of maintaining healthy pipelines and ensuring consistent modeling across full refresh and incremental processes.

• Must possess authorization to work in the United States and successfully complete the I-9/E-Verify process.

🏝️ Benefits

• Fully remote position.

• Competitive compensation package that includes an equity incentive plan and company-wide bonus opportunities.

• National healthcare plans for medical, dental, and vision coverage.

• Company-sponsored life insurance policy.

• Optional accidental insurance, FSA, and DCFSA benefits.

• Unlimited paid time off (PTO) policy along with eleven (11) company-observed holidays.

• 401(k) retirement plan.

• Twelve (12) weeks of paid time off available for both birth and non-birth parents.

• A chance to engage in work you are passionate about at a company dedicated to addressing the affordable housing crisis.