
Senior Software Development Engineer – GenAI
Posted 3 days ago

Posted 3 days ago
This is a fully remote position, open to applicants in Texas.
• Create and develop core AI/GenAI platform services for CVS Health's internal agentic and LLM-driven tools.
• Establish LLM routing and cost governance frameworks.
• Construct internal developer tools to facilitate AI-assisted software development.
• Implement retrieval-augmented generation (RAG) functionalities.
• Develop orchestration tools for managing agentic workflows deployment.
• Design and execute platform services for authentication, quota and cost management, observability, and routing policies.
• Assist in shaping the next generation of foundational AI services.
• Work alongside senior engineers to introduce new concepts and tools into production.
• Facilitate the rapid, secure, and economical enterprise use of LLMs while ensuring compliance with healthcare regulations.
• Over 5 years of professional experience in software engineering.
• At least 2 years of experience in building production backend services using Python and/or TypeScript/Node.js.
• A minimum of 2 years in designing and constructing RESTful APIs or microservices with FastAPI, Flask, Express, or NestJS.
• Proven experience integrating with one or more LLM/AI provider APIs in a production environment.
• Familiarity with AWS, Azure, or GCP.
• Production experience with Redis, Kafka, and MongoDB or similar technologies.
• Knowledge of OAuth2/OIDC or JWT-based authentication and authorization systems.
• Experience with observability/telemetry tools such as OpenTelemetry, Prometheus, Grafana, Langfuse, or Datadog.
• Proficient in using Docker and CI/CD pipelines.
• Experience with Git and participating in code review processes.
• Bachelor's degree or equivalent professional experience in Mathematics, Statistics, Computer Science, Analytics, Engineering, or a related field.
• A genuine and self-driven curiosity about GenAI and evolving AI infrastructure.
• Ability to analyze system design trade-offs in distributed, stateful systems.
• Interest or experience in prompt engineering, model routing strategies, or LLM cost optimization methods.
• Excellent written and verbal communication skills.
• Experience in a regulated industry is preferred.
• A Master's degree is preferred.
• Medical coverage.
• Dental coverage.
• Vision coverage.
• Paid time off.
• Retirement savings options.
• Wellness programs.
• Additional resources supporting physical, emotional, and financial well-being.
• Eligibility for CVS Health bonus, commission, or short-term incentive programs in addition to base salary.
Helpware
Introhive
Boeing
M9 Solutions
Get handpicked remote jobs straight to your inbox weekly.