Data Engineer II

This is a fully remote position, open to applicants in United States.

📋 Description

• Develop and sustain data models in SQLMesh, incorporating incremental methods, testing protocols, and comprehensive documentation.

• Enhance and advance orchestration and transformation frameworks.

• Upgrade outdated pipeline jobs utilizing Python and SQLMesh.

• Engage in the on-call rotation to address ETL, data availability, and metric-related incidents.

• Set alert thresholds, generate metrics and logs, create dashboards, and define escalation procedures.

• Boost platform observability.

• Oversee pipelines for creator payouts and GAAP-compliant revenue reporting.

• Develop pipeline support for emerging revenue streams.

• Optimize BigQuery query performance and lower compute expenses.

• Contribute to the ingestion platform efforts and the product analytics infrastructure.

• Ensure that validation, documentation, and monitoring are thoroughly completed prior to ticket closure.

⛳️ Requirements

• Over 3 years of practical data engineering experience in a production setting.

• Expertise in SQL, including window functions, CTEs, query optimization, and execution plan analysis.

• Proficiency in Python for developing pipeline logic, data transformation, and testing methodologies.

• Experience with SQLMesh, dbt, or similar tools, with a focus on incremental models, testing, and documentation.

• Hands-on experience with a cloud data warehouse, covering partitioning, clustering, and cost management.

• Familiarity with Dagster, Airflow, Prefect, or comparable workflow orchestration tools.

• Capability to construct observable and reliable data systems equipped with alerting, dashboards, and data quality checks.

• Ability to manage small-to-medium features from technical design to delivery with minimal supervision.

🏝️ Benefits

• Competitive salary with annual reviews and equity opportunities.

• Unlimited paid time off (PTO).

• Comprehensive medical, dental, and vision insurance for you and your dependents.

• 401(k) plan with immediate vesting and company matching.

• 12 weeks of fully paid parental leave for non-birthing parents.

• 18-20 weeks of fully paid parental leave for birthing parents.

• Flexible remote work options or access to office hubs and creative spaces globally.

• Annual budget for learning and development.

• Leadership development programs.

• Opportunities to be team ambassadors.

• Inclusive team events.

• Team meet-ups.

• Access to Employee Resource Groups.