Senior AI Engineer

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Create, develop, and refine **advanced prompts**, **reasoning chains** (multi-step, agentic flows), and **generation pipelines** focused on practical business applications;

• Establish, implement, and sustain **quality evaluation frameworks** for LLM-based systems, incorporating both automatic metrics and human assessments;

• Set up **technical and functional guardrails**, such as controlling scope, defining response formats, ensuring semantic validations, and establishing fallback strategies;

• Design and apply **hallucination mitigation strategies**, including grounding, sourcing reliable information, cross-checking, and validating post-generation;

• Choose, evaluate, and optimize the use of **language models (LLMs)** based on cost, latency, quality, and security needs;

• Define and document **prompting standards**, response formats, and best practices to ensure consistent model application across various products;

• Plan and conduct **A/B tests** and controlled experiments to assess the effects of modifications to prompts, models, or architectures;

• Collaborate closely with Product, Engineering, and Design teams to **incorporate LLMs into user flows**, APIs, and conversational interfaces;

• Ensure adherence to **security, privacy, and regulatory requirements**, including preventing sensitive data (PII) leaks and following internal and regulatory policies;

• Continuously track the performance, quality, and risks of production systems using **logging, metrics, and user feedback** for ongoing enhancement.

⛳️ Requirements

• Practical experience with LLMs (specify models, use cases, and results);

• Proficiency in prompting techniques, prompt structuring, few-shot learning, and tool utilization;

• Evaluation expertise: quality metrics, A/B testing, and validation datasets;

• Knowledge of security and privacy measures: preventing data leakage, handling PII, and adhering to policies;

• Familiarity with RAG (embeddings, chunking, retrievers), vectors, and relevance;

• Experience with product integration (APIs, chat UX, logging).

🏝️ Benefits

• Competitive salary and performance-based bonuses;

• Opportunity for professional development and continuous learning;

• Flexible work arrangements and a collaborative team environment;

• Comprehensive health benefits and wellness programs.