Data & AI Platform Engineer

This is a fully remote position, open to applicants in Indonesia.

📋 Description

• Develop and manage ingestion systems and runtime infrastructure that support analytics, data science, and AI tools across Wego.

• Create dependable batch and streaming pipelines from various source systems.

• Operate pipelines and services on Kubernetes and cloud infrastructure.

• Establish repeatable environments and secure release and rollback procedures.

• Construct systems that allow AI assistants and agents to reliably utilize Wego's data and APIs.

• Collaborate with data scientists on evaluations related to AI.

• Enhance reliability and optimize cloud costs in accordance with agreed service objectives.

• Detect data loss, operational inefficiencies, and slow delivery; validate the impact with users and oversee end-to-end fixes.

• Develop pipelines that integrate APIs, databases, and event sources.

• Manage schema changes, incremental loads, and change data capture processes.

• Design mechanisms for retries, deduplication, backfills, and replays.

• Monitor data freshness and completeness from the source to the consumer.

• Deploy and manage containerized pipelines and services.

• Coordinate resources, configurations, scaling, and recovery in collaboration with platform teams.

• Implement infrastructure as code and automated delivery pipelines.

• Test modifications and manage secrets and access controls.

• Define metrics, logs, and alerts; diagnose incidents and resolve recurring failures.

• Develop tool and API integrations, agent loops, context and memory management, retrieval, prompts, and guardrails.

• Provide support for model serving whenever necessary.

• Create test sets, regression checks, and monitoring of AI outputs in partnership with data scientists.

⛳️ Requirements

• 3–8 years of experience in data engineering, platform engineering, or related infrastructure roles.

• Proven experience in managing ingestion systems in production, including handling failures, recovery, and source schema modifications.

• Practical experience in operating Kubernetes workloads and cloud infrastructure.

• Familiarity with DevOps practices, automated deployment processes, and infrastructure as code.

• Proficiency in Python and SQL.

• Solid skills in Linux, networking, and container management.

• Experience working with APIs, databases, and event systems, including batch or streaming ingestion.

• Understanding of delivery guarantees, idempotency, and schema compatibility.

• Proficient in using Kubernetes and container tools such as Docker and Helm.

• Experience with platforms like Google Cloud or AWS.

• Knowledge of infrastructure tools such as Terraform.

• Practical understanding of CI/CD, monitoring, alerting, and incident diagnosis.

• Capable of building AI assistants and agents, including functionalities like tool calling, agent loops, context and memory management, retrieval, and guardrails.

• Able to evaluate AI assistants and agents through test sets and regression checks.

• Competent in identifying significant problems, assessing their impact, and managing solutions that yield measurable results.

• Skillful in aligning priorities with stakeholders and navigating through ambiguity independently.

• Proficient in testing AI-generated code, investigating failure paths, and managing deployed outputs.

• Responsible for providing tests and operational evidence prior to completing changes and fixing defects post-release.

• Capable of clearly explaining engineering trade-offs and treating analysts, data scientists, and product teams as users.

• Experience in developing AI assistants, agents, evaluations, or model services is an advantage.

• Travel-domain experience is also a plus.

🏝️ Benefits

• Fully remote work arrangement.

• Opportunities to engage in high-impact projects related to data, platform, and AI tooling.

• Collaboration with analysts, data scientists, and engineering teams.

• Professional experience with cloud infrastructure, Kubernetes, DevOps, and AI systems.

• Travel-domain experience is a plus.