This is a fully remote position, open to applicants in Brazil.

📋 Description

• Discovery Phase (Months 1–2): Conduct research, testing, and propose a minimum of 10 potential metrics to assess CORA's performance.

• Validation Phase (Months 3–7): Execute experiments to confirm which metrics accurately reflect the quality of our agent's analyses, ultimately selecting the top 3.

• Construction Phase (Months 7–12): Develop a real-time monitoring dashboard that allows the team to consistently track model performance and respond swiftly when necessary.

⛳️ Requirements

• Education: Bachelor's degree completed.

• Fields of study: Engineering; Computer Science / Information Systems; Data Engineering / Data Science; Statistics / Applied Mathematics; and related disciplines in Information Technology and Artificial Intelligence.

• Understanding of evaluation metrics for AI/ML models, particularly in the context of generative models.

• Background in statistical analysis and hypothesis validation.

• Expertise in creating dashboards and monitoring panels.

• Proficiency in Python and AWS QuickSight.

• AWS certifications (Cloud Practitioner).

• Involvement in generative AI projects and publications in the field of data science.