Senior Data Engineer

This is a fully remote position, open to applicants in Canada, +1 more country.

📋 Description

• Oversee production data pipelines utilizing GCP-based data warehousing, from orchestration to reporting.

• Ensure the reliability, performance, cost-effectiveness, and integrity of pipelines.

• Develop scalable dbt and BigQuery SQL to construct and sustain data models across Beatport Group's business functions.

• Plan and design relational database management systems (RDBMS) and data warehouses, as well as data models, repositories, and pipelines for optimal performance and scalability.

• Maintain and enhance partner integrations through APIs and file-based exchange services such as SFTP and GCS.

• Assist with integrations involving streaming fraud detection partners and music suppliers.

• Migrate and phase out legacy data solutions using tools like Pentaho and Jenkins.

• Create and upkeep documentation for APIs, data pipelines, data models, and data dictionaries.

• Act as the primary contact for addressing load failures and connectivity problems impacting downstream resources.

• Support data flow and integrations across the various business units of the Beatport Group.

⛳️ Requirements

• A minimum of 5 years of direct experience in data engineering.

• Proven experience in building and managing cloud data warehouses, production data pipelines, and comprehensive ETL/ELT solutions.

• Ability to handle and prioritize data requests from both technical and non-technical stakeholders.

• Expert-level proficiency in SQL, particularly with Google Cloud SQL-supported dialects such as MySQL and Postgres.

• Proficient in dbt.

• At least 3 years of SQL-based programming and access control experience with RDBMS systems such as MS SQL Server, MySQL, Postgres, or Oracle.

• Experience in orchestrating, monitoring, and resolving incidents within production data pipelines.

• Familiarity with cloud orchestration tools like Airflow, Composer, or Cloud Run.

• Proficient in a scripting language in addition to SQL, especially Python.

• Ability to work autonomously and prioritize tasks efficiently.

• Detail-oriented approach to data integrity, particularly concerning financial or regulatory reporting.

• Strong communication and interpersonal skills, both technical and non-technical.

• Applicants must reside in the Pacific Northwest region of Canada or the USA.

• Valid work authorization is required.

🏝️ Benefits

• Competitive remuneration.

• Excellent development opportunities within a rapidly growing organization.

• In-depth integration into the international music industry.

• Option for remote work.