LLMs and models

Nexus supports a variety of models based on your policy settings. You can configure any Private LLM, and Nexus also has built-in support for OpenAI, Anthropic, xAI, OpenRouter, and Perplexity. You configure how private and public models are routed, so usage stays secure and tailored to your environment.

Private AI models — private OpenAI-compatible or Ollama endpoints (self-hosted or partner-hosted), tunneled over Diode:

Public LLMs — built-in OpenAI, Anthropic, xAI, OpenRouter, and Perplexity:

Catalog at a glance

Category What it is
Private AI models Any OpenAI-compatible or Ollama endpoint you or a partner operate (self-hosted or partner-hosted)
Built-in public LLMs OpenAI, Anthropic, xAI, OpenRouter, and Perplexity

Routing

  • Under Settings → LLMs, enable or disable providers and drag to rank them; the first enabled provider is the default
  • That ranking is how private and public models are routed for your policy
  • Prefer Diode connection modes (Auto Discovery or manual bind) so the model hop stays on your private path
  • Combine with Tools and MCP so the model can use organization data
  • When a tool declares an LLM scope, Nexus routes only to policy-allowed models — not merely the workspace default
  • In Perimeter Managed mode, Auto Discovery finds Private AI endpoints IT published on the ZTNA perimeter

Private endpoint setup: Private AI models.

Setup: Configure an LLM.