Senior Data Engineer

This is a fully remote position, open to applicants in United Arab Emirates (UAE).

📋 Description

• Develop the AI-native data foundation for MoonTech from the ground up.

• Take ownership of pipelines, warehouse architecture, and essential data models for creator matching, campaign performance, transaction attribution, payouts, and AI-driven decision-making.

• Construct and manage ingestion, transformation, and enrichment pipelines for high-volume data related to campaigns, creators, transactions, products, and commercial activities.

• Design fundamental data models utilized by AI agents, product systems, analytics, business intelligence, and machine-learning workflows.

• Create enrichment and embedding pipelines that support workflows for creator-brand matching, scoring, recommendations, and retrieval.

• Address identity and entity resolution challenges across various external systems.

• Model commercial data such as creator rates, commissions, payouts, and campaign terms using slowly changing dimensions.

• Establish data quality, freshness, lineage, and pipeline monitoring protocols.

• Consider testing, monitoring, documentation, and observability as integral components of the production infrastructure.

• Migrate and unify legacy reporting and data systems into a modern cloud warehouse.

• Manage and enhance data infrastructure across Google Cloud Platform (GCP) and Amazon Web Services (AWS).

• Assist data consumers, including machine learning models, embeddings, vector stores, recommendation systems, and autonomous agents.

• Report to the Data Products Lead and collaborate with teams in Data Science, Business Intelligence, Product, and Engineering.

• Contribute to defining data-platform architecture, prioritizing rebuild efforts, managing retirements, and establishing a reliable data foundation for MoonTech’s agentic platform.

⛳️ Requirements

• A minimum of 5 years of experience in building and managing production data pipelines, preferably in marketplace, e-commerce, affiliate, ad-tech, martech, or high-growth technology sectors.

• Proficient in advanced SQL.

• Strong practical experience in Python for developing production data pipelines and transformations.

• Extensive production experience with dbt and modern cloud data warehouses.

• Ability to design stable keys and data models for records originating from multiple third-party APIs, platforms, and partner systems.

• Hands-on familiarity with Airflow, Dagster, or Prefect, including managing dependencies, retries, backfills, scheduling, and failure recovery.

• Experience in operating production infrastructures on GCP, AWS, or both.

• Capable of designing and executing migrations while ensuring business continuity and validating the accuracy of historical reporting.

• Understanding of data infrastructure needs for machine learning models, embeddings, vector stores, recommendation systems, and autonomous agents.

• Actively utilize AI coding assistants, large language models, or agents in engineering workflows, with the ability to articulate their impact.

• Comfortable working in a dynamic environment where schemas, systems, and requirements are still under development.

• Strong ownership of production processes.

• Nice to have: background in influencer marketing, affiliate marketing, e-commerce, marketplaces, performance marketing, or ad-tech.

• Nice to have: experience with datasets related to creators, campaigns, attribution, conversion, or transactions.

• Nice to have: experience in developing ML data infrastructure, including feature pipelines, embeddings, vector databases, or retrieval systems.

• Nice to have: practical experience in entity resolution or identity graph development.

• Nice to have: experience completing a warehouse, cloud, or significant data-platform migration in a production environment.

• Nice to have: experience in supporting AI agents or agentic workflows.

• Nice to have: familiarity with the GCC or MENA market.

🏝️ Benefits

• Competitive salary and performance bonuses.

• Flexible work hours and remote work options.

• Comprehensive health, dental, and vision benefits.

• Professional development opportunities and continuous learning.

• A collaborative and innovative work environment.