Prompt Engineer / AI Agent Developer

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Set up system prompts, guidelines, and agent interaction flows on the client’s platform.

• Evaluate and choose the most appropriate model for each agent, taking into account quality, cost, and latency.

• Tailor instructions to align with the unique features of each LLM.

• Establish response quality benchmarks and perform iterative testing using structured test cases.

• Implement guardrails, manage out-of-scope responses, and apply mitigation strategies for prompt injection.

• Create documentation for prompt engineering standards, versions, and best practices to facilitate reuse and empower the team.

⛳️ Requirements

• Demonstrated hands-on experience in prompt engineering on practical projects employing various LLM families, including OpenAI/GPT, Anthropic/Claude, Google/Gemini, and Meta/Llama.

• Practical experience in developing AI agents in teams, encompassing orchestration, tool utilization, and context-memory management.

• Proficient in metrics and quality assessment for AI-generated responses.

• Outstanding proficiency in written Portuguese, ensuring clarity, precision, grammatical correctness, and an appropriate tone.

• Familiarity with Git and deployment through established CI/CD pipelines.

• Capability to swiftly learn and navigate new proprietary platforms.

• Experience with RAG architectures, particularly in evaluating responses based on documentary sources.

• Knowledge of Python for test automation and LLM assessment.

• Previous involvement in projects dealing with sensitive data in compliance with Brazil’s LGPD or within the healthcare sector.

🏝️ Benefits

• Meal or food allowance.

• Discounts on courses, universities, and language institutions.

• Stefanini Academy — a platform providing free, current online courses with certification.

• Mentorship opportunities.

• Benefits club offering discounts on consultations and medical tests.

• Health insurance coverage.

• Dental insurance coverage.

• Discounts and benefits club featuring offers at leading establishments.

• Travel club access.

• Pet benefits program.