Docs/Core concepts

Providers & models

Connect Gray to OpenAI, Anthropic, Google, OpenRouter, DeepSeek, Groq, xAI, Mistral, Ollama or any OpenAI-compatible endpoint, and switch models mid-session.

Source: crates/gray/src/setup/catalog.rs

Gray speaks the OpenAI chat-completions protocol over SSE, so any compatible endpoint works. /connect lists the built-in catalog; anything else goes in as a custom base URL. Claude models get Anthropic-style prompt caching.

ProviderSign-inBase URL
OpenAIChatGPT login or API keyapi.openai.com/v1
AnthropicAPI keyapi.anthropic.com/v1
GoogleGemini API keygenerativelanguage.googleapis.com
OpenRouterAPI key — 300+ modelsopenrouter.ai/api/v1
CommandCodeAPI keyapi.commandcode.ai/provider/v1
DeepSeekAPI keyapi.deepseek.com
GroqAPI keyapi.groq.com/openai/v1
xAI (Grok)Grok login or API keyapi.x.ai/v1
MistralAPI keyapi.mistral.ai/v1
GitHub Copilottokenapi.githubcopilot.com
Ollamanone — locallocalhost:11434/v1

Keys

/connect (aliases /provider, /key, /keys) stores keys per provider in ~/.gray/auth.json with 0600 permissions. Environment variables win over stored keys, and --api-key wins over both, so CI and one-off shells stay easy. Shift+Enter on a highlighted provider in the connect modal removes it.

bash
$export GRAY_API_KEY=sk-... # or OPENAI_API_KEY
$gray --model openrouter/<model-id>
$gray --base-url http://localhost:8000/v1 # vLLM, LM Studio, a proxy…

Models

/model opens a searchable picker over the bundled models.dev catalog; /model provider/id sets one directly. Switching mid-session keeps the conversation.

Reasoning effort

/thinking (aliases /effort, /reasoning) picks how hard a reasoning model thinks. Only the levels the current model supports are accepted.

LevelMeaning
offno reasoning
minimalvery brief reasoning
lowlight reasoning
mediummoderate reasoning
highdeep reasoning
xhighvery deep reasoning
maxmaximum reasoning

Provider plugins

Sign-in flows that are more than a pasted key live in plugins speaking plugin protocol 1.2, where the host owns the credentials. Once installed they appear in /connect beside the built-ins. See Plugins.

Join the Discord

Chat with the people building and running Gray. Show what you made with it.

Join Discord →

Need help?

Open an issue on GitHub, run /feedback from the REPL, or ask in Discord.

Open an issue →