Staff AI Engineer

This is a fully remote position, open to applicants in United States.

📋 Description

• Develop LLM-driven products that are ready for production.

• Create and implement LLM applications, including RAG pipelines, agents, tool-use systems, structured generation, and multi-step workflows.

• Take charge of prompt engineering and evaluation, drafting assessments prior to prompts and treating both as code.

• Integrate foundational models such as Claude, GPT, Gemini, Llama, Qwen, and Mistral.

• Construct production infrastructure that encompasses caching, streaming, retries, fallbacks, cost controls, observability, and guardrails.

• Fine-tune or distill models when prompting does not suffice, utilizing LoRA/QLoRA, SFT, or DPO techniques.

• Collaborate with product and design teams on AI-specific UX patterns, including latency masking, streaming user interfaces, confidence display, and human-in-the-loop workflows.

⛳️ Requirements

• A minimum of 3 years of software engineering experience, with at least 1 year dedicated to delivering LLM-based features in a production environment.

• Proficient in Python and TypeScript.

• Extensive practical knowledge of prompting techniques, function calling, structured outputs, context management, embedding models, and vector search.

• Experience in developing and maintaining an evaluation suite.

• Familiarity with at least one orchestration method: custom, LangGraph, Inngest, or Temporal.

• Proficiency with at least one vector store: pgvector, Pinecone, Turbopuffer, or Weaviate.

• Awareness of cost and latency, including the ability to analyze token bills and traces.

• Strong communication abilities and the capacity to challenge improper use of AI.

• Familiarity with agent frameworks and MCP, as well as fine-tuning open-weight models or inference servers, LLM security/evaluations/red-teaming, and open-source AI tools are advantageous.

🏝️ Benefits

• Work remotely from anywhere in the US; Machinify embraces a digital-first approach.

• Comprehensive Medical/Dental/Vision benefits.

• Flexible Spending Account (FSA) and Health Savings Account (HSA).

• Tuition reimbursement offered.

• 401(k) plan with company matching.

• Unlimited Paid Time Off (PTO).

• Additional health and wellness benefits and perks.

• A flexible and trusting environment that empowers you to perform at your best.

• Meaningful equity opportunities.