Skip to main content

Host Machine Models

Use GGUF models stored on your computer's local disk.

Overview​

Host machine models are GGUF models stored on your computer (not on the Docket USB). This is useful when:

  • You have large models that won't fit on the USB
  • You want faster loading from an SSD
  • You already have a collection of GGUF models

Adding Host Models​

Step 1: Open the Models Page​

  1. Click Models in the sidebar
  2. Select the Local Models tab

Step 2: Add a Model​

  1. Click Add Model
  2. Use the file browser to select a .gguf file
  3. The model is added to your registry

Step 3: Load and Use​

  1. Select the model
  2. Click Load
  3. Start chatting

How It Works​

  • Model files stay on your computer's disk
  • Docket remembers the file path
  • The model is loaded through llama-server

Machine-Specific​

Host models are tied to the specific computer:

  • Adding a model on your desktop won't make it appear on your laptop
  • The registry tracks which hostname added each model
  • If you move the file, you'll need to update the path

Managing Host Models​

Rename a Model​

  1. Click on the model
  2. Click Rename
  3. Enter a new display name

Update Path​

If you move a model file:

  1. Click on the model
  2. Click Edit Path
  3. Browse to the new location

Remove from Registry​

  1. Click on the model
  2. Click Remove
note

Removing a model from Docket does not delete the file from your computer.

llama-server Fallback​

Docket uses a fallback chain to find llama-server:

  1. Docket USB — core/bin/llama-server on the USB drive
  2. Custom Path — A path you configure in settings
  3. System PATH — llama-server available system-wide

This means you can use host models even when:

  • The Docket USB is not connected
  • You want to use your own llama-server build

Set Custom llama-server Path​

  1. Go to Settings
  2. Find llama-server Path
  3. Enter the path to your llama-server executable

Availability Tracking​

Docket checks if host model files still exist:

  • Available — File exists at the registered path
  • Unavailable — File not found (moved or deleted)

If a model shows as unavailable:

  • Check if the file was moved
  • Update the path if needed
  • Remove the model if you deleted the file

Tips​

  • Store models on an SSD for fastest loading
  • Use descriptive names when adding models
  • Keep track of where you store model files
  • Regularly check model availability if you reorganize files

Limitations​

  • Only GGUF format is supported
  • One model can be loaded at a time (same as USB models)
  • File must be accessible when you want to load the model