AI Platform Software Engineer

📋 Description

• Facilitate and enhance the adoption of the enterprise AI platform by troubleshooting AI functionalities.

• Recognize systemic deficiencies and promote ongoing improvements in platform performance and utilization.

• Collaborate directly with internal team members to address issues.

• Work closely with engineering teams to identify root causes across LLMs, agent workflows, tools (MCP), and backend systems.

• Investigate and resolve issues submitted by users of Agent Assist.

• Reproduce problems and trace failures in LLM responses, agent workflows, and orchestration.

• Analyze logs, traces, and telemetry (e.g., Langfuse, NewRelic logs).

• Document insights and collaborate with engineering on solutions utilizing Azure DevOps.

• Identify issues arising from prompting, retrieval (RAG), tool selection, or backend systems.

• Suggest enhancements to agents, skills, prompts, and workflows.

• Provide training to internal users on the effective use of Agent Assist.

• Conduct targeted demonstrations, onboarding sessions, and office hours.

• Serve as a trusted advisor to client-facing team members.

⛳️ Requirements

• Up to 3 years of experience in a technical support, QA, SDET, or engineering-related role (including internships, co-ops, or academic projects).

• Bachelor’s degree in Computer Science, Computer Information Systems, Business Information Systems, or a related technical field.

• Proven ability to troubleshoot and debug technical issues, with a focus on root cause analysis.

• Basic experience or exposure to API testing (Postman or similar).

• Ability to read logs and debug application behavior.

• Fundamental knowledge of SQL or data inspection.

• Exposure to or strong interest in AI/LLM-based systems (prompting, chatbots, RAG, or agents) through coursework, projects, or hands-on experimentation.

• Experience with or a willingness to learn AI-powered development tools (e.g., Cursor, Claude Code).

• Excellent communication skills, with the ability to articulate technical issues clearly to non-technical users.

• Demonstrated curiosity and a quick learning ability in a rapidly evolving technical landscape.

🏝️ Benefits

• 401(k) match

• Medical

• Dental

• Vision

• Paid-Time-Off