AI Platform Support Engineer

This is a fully remote position, open to applicants in New York.

📋 Description

• Assist in the daily operations and upkeep of the AI Assistant Platform.

• Oversee system performance, address issues, and collaborate with the development team for solutions.

• Design and sustain RAG pipelines, which encompass chunking, embedding generation, vector indexing, retrieval tuning, and evaluation.

• Set up and enhance LLM agent behaviors through instruction tuning, tool/Action Group testing, and prompt engineering.

• Aid in metadata extraction, JSON creation, SQL data loading, and semantic indexing.

• Organize and implement AI feature testing cycles, gather structured feedback from auditors, and monitor resolutions in JIRA.

• Facilitate document extraction processes for utility bill processing, ensuring accuracy and broadening template coverage.

• Assess, pilot, and suggest new AI tools and capabilities for the organization’s adoption.

• Keep technical documentation updated for AI platform components, data flows, agent configurations, and operational runbooks.

• Support cloud storage organization, data source management, and optimization of AI service costs.

• Contribute to future AI platform and CRM integration by assisting in defining data exchange interfaces and testing data flows.

• Work closely with auditors, developers, and leadership to translate business requirements into enhancements for the AI platform.

• Report directly to the AI Lead.

⛳️ Requirements

• 2–4 years of experience in a technical capacity involving AI/ML tools, cloud platforms, data engineering, or software development support.

• Strong understanding of contemporary AI and LLM principles, including prompt engineering, retrieval-augmented generation (RAG), embeddings, vector databases, and agent-based frameworks.

• Proven experience in building or managing RAG or embedding-based systems from prototype to production.

• Practical experience with at least one major cloud service provider (AWS, Azure, or GCP).

• Proficiency in Python (preferred) or JavaScript for scripting, data manipulation, and automation tasks.

• Experience with SQL databases for querying, data loading, and basic schema design.

• Familiarity with AI-assisted development tools such as Cursor IDE, Claude Code, or GitHub Copilot.

• Knowledge of work-tracking tools like JIRA, Azure DevOps, or similar platforms.

• Excellent communication skills with the ability to document technical processes and convey status updates to both technical and non-technical stakeholders.

• Self-motivated, with an eagerness to learn quickly and a strong interest in advancements in AI.

• Exceptional attention to detail when dealing with data pipelines, configurations, and testing procedures.

• A bachelor's degree is preferred but not mandatory; equivalent practical experience will be considered.

• Must reside in the US in a state with no more than a 1-hour time difference from EST.

• Must be authorized to work permanently in the US without requiring visa assistance.

🏝️ Benefits

• Competitive base salary (starting target range: $85,000–$90,000) along with a performance-based bonus.

• Health, dental, and vision insurance coverage.

• 401(k) plan with company matching.

• Generous paid time off (PTO).

• 11 paid holidays throughout the year.

• Fully remote work arrangement.

• Work hours from 9 AM to 6 PM EST.

• Must be authorized to work permanently in the US without requiring visa support.