
AI Developer
Posted 2 days ago

Posted 2 days ago
This is a fully remote position, open to applicants in Mexico, +1 more country.
• Operate and implement open-source LLMs using Ollama and llama.cpp in local and on-premises settings.
• Create and sustain RAG pipelines that encompass embeddings, vector databases, chunking strategies, and retrieval quality.
• Develop integrations for MCP that connect LLMs to internal tools and data sources.
• Construct Python backend services for ML inference and AI-enhanced product features.
• Parse and handle structured and semi-structured data, including XML/XSD and various Office document formats.
• Advance into model optimization, focusing on GGUF quantization, GPU/CUDA tuning, and offline/air-gapped deployments.
• Establish and manage CI/CD pipelines for AI services.
• Deploy AI workloads on Microsoft Azure and AWS while containerizing services with Docker.
• Automate operational tasks utilizing Python, Bash, and/or PowerShell.
• Diagnose issues across the stack and determine root causes.
• Support event-driven architectures utilizing Apache Kafka producers and consumers.
• Collaborate with engineering and product teams to transition LLM-powered features from prototypes to reliably deployed systems.
• 3–5+ years of engineering experience with production-level Python for developing real services, LLM inference, RAG pipelines, and automated tools.
• Practical experience with LLM and AI integration, serving models via Ollama/llama.cpp, implementing vector retrieval/RAG, and creating MCP integrations.
• Expertise in cloud and infrastructure, including Azure/AWS deployments, Docker containerization, Linux/Windows administration, and CI/CD automation using Azure DevOps, GitHub Actions, or GitLab CI.
• Awareness of DevOps, security, and operations, including Git workflows, Python/Bash/PowerShell scripting, Prometheus/Grafana, DevSecOps, and compliance frameworks like SOC 2, ISO 27001, and Zero Trust.
• Strong problem-solving and communication skills, a mindset focused on root-cause troubleshooting, self-directed learning, strong ownership, and the ability to collaborate within remote/distributed teams.
• Experience with GPU/CUDA tuning and model quantization is advantageous.
• Knowledge of Terraform, Kubernetes, Kafka, or programming in Go/Rust/C++ is a plus.
• Competitive salary and performance-based bonuses.
• Comprehensive health, dental, and vision insurance.
• Flexible work hours and remote work options.
• Opportunities for professional development and continuous learning.
• A collaborative and innovative work environment.
Fluent, Inc
Fluent, Inc
Get handpicked remote jobs straight to your inbox weekly.