Analytics Engineer

This is a fully remote position, open to applicants in South Africa, +5 more countries.

📋 Description

• Design and develop dbt models that convert raw data sources into reliable curated datasets.

• Utilize dimensional modeling techniques to create facts and dimensions suitable for analytics.

• Model transactional Change Data Capture (CDC) and third normal form sources.

• Define and uphold naming conventions along with project structure.

• Build and sustain datasets and data products for internal stakeholders.

• Provide reporting solutions using Metabase and Pigment.

• Collaborate with stakeholders to translate business inquiries into data models.

• Facilitate secure and governed data sharing among teams.

• Take responsibility for the health of production pipelines managed in Databricks or Apache Airflow.

• Establish monitoring, alerting, and data quality assurance procedures.

• Oversee CI/CD pipelines, schema migrations, and ensure safe releases.

• Optimize workload performance and costs on columnar engines.

• Develop reusable development patterns and establish code review standards.

• Keep documentation, lineage, and column-level metadata updated.

• Contribute to the formulation of governance standards and data contracts.

• Assist in the ingestion of vendor and third-party data.

• Employ AI coding assistants for writing, testing, refactoring, and documenting SQL, dbt, and Python code.

• Investigate AI applications for documentation, data quality checks, and self-service analytics.

⛳️ Requirements

• Demonstrated experience with dimensional modeling for analytics warehouses.

• Practical production experience with dbt.

• Knowledge of CDC and third normal form modeling for MySQL or PostgreSQL data sources.

• Familiarity with lakehouse architecture and Delta Lake.

• Strong SQL skills and proficient, practical knowledge of Python.

• Comfortable using Git, the Linux shell, and participating in code review workflows.

• Experience in structuring and orchestrating workflows within Databricks or Apache Airflow.

• Production experience with CI/CD, migrations, monitoring, and alerting.

• Experience with AWS and Databricks platforms.

• Proven ability to model for and optimize performance on columnar engines.

• Experience in loading data from vendors and third-party sources.

• Familiarity with data quality assurance processes.

• Knowledge of data contracts and semantic layers is an advantage.

• Experience with visualization tools such as Metabase, Pigment, or similar.

• Ability to clearly communicate technical trade-offs to non-technical team members.

• Capacity to independently plan and execute complex tasks with minimal oversight.

• Ability to identify issues early and suggest viable solutions.

• Proficiency in English for daily operations and stakeholder interactions.

🏝️ Benefits

• Fully remote work environment.

• Compensation provided in EUR (specific amount not disclosed).

• Integration of AI coding assistants and innovations into the workflow.

• Human review incorporated into the quality assurance process.

• All communication in English for day-to-day operations and stakeholder engagement.