Skip to main content

Models Overview

Docket supports multiple AI models from different sources.

Models Page

Model Sources

My Docket (USB Drive Models)

Models stored on your Docket USB drive. These include:

  • Pre-installed models — Ready to use out of the box
  • Downloaded models — Models you've added from Hugging Face

Pros:

  • Work completely offline
  • Portable — take them anywhere
  • Private — data never leaves your device

Local Models (Host Machine)

Models stored on your computer's hard drive (not on the Docket USB).

Pros:

  • No USB storage space used
  • Faster loading from SSD
  • Can use models larger than USB capacity

Note: These models are machine-specific and won't appear on other computers.

OpenRouter (API Models)

Access hundreds of cloud models via OpenRouter API.

Pros:

  • Access to GPT-4, Claude, Gemini, and more
  • No local storage needed
  • Run models too large for local hardware

Cons:

  • Requires internet connection
  • API costs apply
  • Data sent to cloud servers
Offline Mode Protection

When Docket is in Offline mode, no data is ever sent to OpenRouter — the connection is completely blocked. Data is only sent to OpenRouter when you are in Online mode and actively using an OpenRouter model.

Model Types

Text Models

Standard language models for:

  • Conversations
  • Writing
  • Analysis
  • Code generation

Vision Models

Multimodal models that can understand images:

  • Qwen 2.5 VL Vision (pre-installed)
  • Various OpenRouter vision models

Vision models show a 📷 icon in the model selector.

Code Models

Optimized for programming tasks:

  • Qwen 2.5 Coder (pre-installed)
  • Better at understanding and generating code

Choosing a Model

NeedRecommended Model
Quick responsesLlama 3.2 (1B)
General chatGemma 2
Uncensored responsesQwen 2.5 Uncensored
Image understandingQwen 2.5 VL Vision
Programming helpQwen 2.5 Coder
Complex reasoningQwen 2.5 14B

Default Model

Default Model

You can set a default model that automatically loads when starting new chats:

  1. Hover over any model in your list
  2. Click the star icon to set it as default
  3. The starred model appears in the "Default Model" section at the top

The default model is automatically selected when starting new chats, saving you time.

tip

You can also rename models by hovering over them and clicking the edit icon.

Model States

StateMeaning
AvailableReady to load
LoadingCurrently loading into memory
ReadyLoaded and ready for chat
ErrorFailed to load

Managing Models