Skip to main content

platform: 'vllm' title: 'vLLM' quickStart:

  • 'Open vLLM settings'
  • 'Paste the config snippet'
  • 'Test the connection' faq:
  • q: 'Connection failed' a: 'Check API key, URL, and network access.'
  • q: 'No memories returned' a: 'Save a memory first, then retry recall.' config: | Use baseUrl http://localhost:8000/v1 in provider setup.

vLLM Setup

Welcome to the vLLM setup guide.