Senior Cloud FinOps, Generative AI Specialist – Cloud Architecture (GCP)

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Serve as a strategic liaison among Engineering, AI/Data Labs, SRE, and Executive/Finance leadership.

• Analyze cloud environments to identify opportunities for technical efficiency.

• Design financial governance for the generative AI platform hosted on GCP.

• Spearhead the modeling of token-based chargeback systems, LLM consumption limits, and the optimization of inference costs in production.

• Manage and enhance LLM gateways, overseeing model routing, rate limits, team budgets, and failover mechanisms.

• Organize and uphold Chargeback and Showback models based on Input/Output token consumption, applications, squads, projects, and use cases.

• Establish and track AI unit economics metrics.

• Continuously refine inference costs by balancing price, latency, and model quality.

• Implement safeguard measures, dynamic alerts in GCP Billing, and automated kill-switches.

• Assist in establishing LLM observability through consumption and cost tracing tools.

• Conduct diagnostics of GCP/AWS cloud environments to uncover waste and optimization possibilities.

• Execute rightsizing, manage CUDs, enforce data lifecycle policies, and eliminate idle resources.

• Develop and sustain operational and executive dashboards using Looker Studio.

• Communicate financial implications to internal clients and technical stakeholders.

• Evaluate the resilience, availability, and performance of production applications.

• Oversee and optimize costs associated with Kubernetes GKE clusters, adjusting HPA/VPA settings, node pools, and workload distributions.

• Ensure infrastructure automation through Terraform and maintain/evolve CI/CD pipelines.

• Support infrastructure observability patterns utilizing Prometheus, Grafana, Cloud Logging, and OpenTelemetry.

⛳️ Requirements

• Experience in Cloud Engineering, SRE, DevOps, or Systems Architecture.

• Minimum of 2+ years focused on FinOps and Cloud Cost Management.

• Hands-on experience with managing LLM consumption in Vertex AI (GCP) or equivalent platforms.

• Expertise in token-based pricing and inference quotas.

• Experience with AI proxies/gateways, such as LiteLLM or similar technologies.

• Extensive knowledge of Google Cloud Platform.

• Proficiency in GCP Billing, BigQuery Billing Export, and Budgeting & Alerts.

• Experience in administration and financial optimization of GKE clusters.

• Proficiency in Terraform for provisioning and automating environments.

• Practical experience in Python and/or Shell Script for automation and data collection via APIs.

• Familiarity with Langfuse, LangSmith, Traceloop, or similar tools is advantageous.

• GCP Professional Cloud Architect, GCP Professional Data/ML Engineer, or FinOps Certified Practitioner certifications are preferred.

• Knowledge of DevSecOps, IAM for AI services, and governance of sensitive data in prompts is a plus.

🏝️ Benefits

• Bradesco Health Plan (30% copay).

• Bradesco Dental Plan (no contribution).

• Life Insurance.

• Wellhub (Gympass).

• Childcare assistance.

• Exceptional child allowance.

• Payroll-deductible loan (consigned credit).

• Private pension.

• Pet plan.

• SESC membership.

• Conexa telemedicine.

• Cost assistance.

• Meal / food allowance.

• Multi-benefits card.

• Medical plan upgrade.

• Extended maternity and paternity leave.

• INMaterna Program: welcoming/support program for pregnant employees.

• Birth gift basket and the book "It Happened When I Was Born."

• Professional development: courses available through the internal university.

• 100% remote or hybrid options, depending on project applicability.