Data Engineer

This is a fully remote position, open to applicants in Canada.

📋 Description

• Develop and sustain Spark and SparkSQL jobs that enhance company data models.

• Take ownership of well-defined pipelines from inception to deployment, including monitoring and iterative improvements.

• Contribute to frameworks for data quality, testing, and data lineage tracking.

• Collaborate with data scientists, analysts, product managers, and engineers to transform data requirements into robust models.

• Expand datamarts and data models that facilitate ongoing reporting and analysis across various products.

• Enhance the reliability and cost-effectiveness of existing pipelines, dashboards, and frameworks.

• Engage in a business-hours on-call rotation and assist in refining runbooks and alerting systems.

• Construct and manage pipelines and data models that support Dropbox product and business analytics.

⛳️ Requirements

• Minimum of 2 years of development experience in Spark, Python, Java, C++, or Scala.

• At least 2 years of SQL experience, including optimization of query performance.

• Over 2 years of experience in schema design and dimensional data modeling.

• Proven experience in building and maintaining production data pipelines relied upon by others.

• Familiarity with cloud data lake or lakehouse platforms; Databricks is preferred.

• Strong written and verbal communication skills with non-engineering stakeholders, along with a history of seeking assistance and constructive feedback early.

• Bachelor's degree in Computer Science or a related technical field involving coding, or equivalent technical experience.

• Participation in a business-hours on-call rotation is expected as part of the role.

• Preferred qualifications: 4+ years of SQL experience; knowledge of medallion architectures and incremental data modeling; experience with Airflow or similar orchestration frameworks; familiarity with Monte Carlo or similar data quality monitoring tools; experience with streaming architectures like Kafka, Kinesis, or Structured Streaming.

🏝️ Benefits

• Competitive salary and performance-based bonuses.

• Comprehensive health, dental, and vision insurance.

• Flexible working hours and the possibility of remote work.

• Generous vacation and paid time off policy.

• Professional development opportunities.