Senior AI Platform Engineer

This is a fully remote position, open to applicants in Brazil.

📋 Description

• Transform AI-generated prototypes into secure production systems utilizing enterprise data.

• Strengthen Node, React, and Postgres applications through architecture, authentication, testing, observability, and CI/CD practices.

• Securely connect Node, React, and Postgres applications to Databricks and Snowflake while adhering to governance and access controls.

• Create reliable and auditable APIs and pipelines that facilitate data movement between Postgres and Databricks or Snowflake.

• Deploy and manage open-weight LLMs on dedicated GPU servers utilizing vLLM or comparable inference engines.

• Develop both batch and real-time pipelines for LLM extraction, classification, and summarization across extensive datasets.

• Ensure sensitive data remains within controlled environments by employing network isolation, encryption, secrets management, and audit logging.

• Track GPU utilization, throughput, latency, and costs, adjusting infrastructure as workloads increase.

• Establish production standards for AI-generated prototypes and document the overall architecture.

• Collaborate directly with the Senior Leadership Team and integrated data teams.

⛳️ Requirements

• Over 6 years of professional experience in software engineering, including senior-level responsibility for production systems.

• Proficient in Node.js backend development (TypeScript preferred) encompassing APIs, services, and authentication.

• Extensive experience in React, specifically in building production-level front ends.

• In-depth knowledge of PostgreSQL, including schema design, query optimization, and migrations.

• Practical experience with Databricks, including Unity Catalog, Delta Lake, and Databricks SQL.

• Hands-on experience with Snowflake, including Snowpark, secure views, and role-based access control.

• Experience in deploying and serving LLMs on GPU infrastructure, with skills in throughput and memory tuning.

• Strong understanding of security fundamentals for sensitive data, such as access control, encryption, network isolation, and secrets management.

• Proficient with Linux, Docker, and at least one major cloud service (AWS, Azure, or GCP).

• Comfortable reviewing and refactoring AI-generated code, as well as utilizing AI coding tools personally.

• Fluent in professional English, both written and spoken, for daily interactions with a US-based team.

• Experience with Kubernetes, including managing GPU workloads.

• Familiarity with infrastructure as code practices (Terraform or similar).

• Knowledge of retrieval-augmented generation (RAG) and vector search technologies, such as pgvector, Databricks Vector Search, or Snowflake Cortex Search.

• Experience with Databricks Mosaic AI Model Serving, Snowflake Cortex, or Snowpark Container Services.

• Understanding of model quantization and inference optimization techniques.

• Experience in large-scale document processing, including OCR, entity extraction, and classification.

• Background in regulated or data-sensitive industries such as finance, healthcare, energy, or government.

• Valid Databricks or Snowflake (SnowPro) certifications.

🏝️ Benefits

• Work From Home

• Generous Salary Commensurate with Experience

• Flexible Working Environment