Software Engineer II – AI Engineer, Deployment

This is a fully remote position, open to applicants in California.

📋 Description

• Analyze, design, program, debug, test, implement, deploy, and provide support for software enhancements and new applications utilizing Generative AI technologies.

• Contribute to the development and deployment of GenAI-enabled applications, which include LLM-powered workflows, RAG pipelines, and AI-enhanced user experiences.

• Assist in maintaining SDLC documentation throughout all phases, emphasizing deployment, evaluation, observability, safety, and monitoring.

• Collaborate with users to define requirements and offer support for applications in production.

• Create and modify application modules, which consist of GenAI components.

• Construct prompt workflows, retrieval layers, APIs, and cloud services.

• Resolve production issues, addressing concerns such as latency, hallucinations, and errors.

• Deliver Level II production support for deployed systems.

• Design components, including integrations with LLM and RAG pipelines.

• Implement CI/CD pipelines, containerization, and release processes.

• Develop RAG pipelines featuring embeddings, chunking, and vector search.

• Utilize prompt engineering techniques, such as few-shot prompting and structured outputs.

• Assess models for accuracy, relevance, and hallucination risks.

• Establish safety guardrails, including PII protection and prompt-injection defenses.

• Conduct testing, encompassing unit, integration, and GenAI evaluation testing.

• Monitor production systems for latency, cost, usage, and errors.

• Assist in incident management with fallback and recovery strategies.

⛳️ Requirements

• Minimum of 4 years of experience in IT or a related field.

• At least 2 years of software engineering experience.

• A minimum of 1 year of experience in deploying GenAI solutions.

• Familiarity with AI coding agent-augmented development.

• Experience in cost optimization, particularly with token and caching strategies.

• Proficiency in programming languages such as Python, Java, C#, JavaScript, or SQL.

• Knowledge of cloud platforms, containers, and CI/CD practices.

• Understanding of the SDLC, APIs, and system architecture.

• Familiarity with databases and data integration processes.

• Comprehension of LLM fundamentals and token behavior.

• Experience with LLMOps/MLOps, including versioning and experiment tracking.

• Proficiency in prompt engineering techniques.

• Awareness of deployment governance, encompassing access control and compliance.

• Experience with observability practices, including logging, tracing, and monitoring.

• Excellent communication and skills in gathering requirements.

🏝️ Benefits

• Group health insurance benefits (medical, vision, dental).

• FSA and HSA healthcare accounts.

• Life and accident insurance.

• Adoption and fertility assistance.

• Paid parental leave of up to 6 weeks.

• Short/long-term disability coverage.

• Paid time off for vacation, personal needs, and sick days.

• Up to 17 days of Choice Time Off (CTO) per calendar year.

• Up to 11 paid holidays each calendar year.

• Employer match of 100% on the first 3% of your contributions for eligible employees.