Skip to main content

UNCONFIGURED_CONTEXT_WINDOW_FALLBACK

Constant UNCONFIGURED_CONTEXT_WINDOW_FALLBACK 

pub const UNCONFIGURED_CONTEXT_WINDOW_FALLBACK: usize = 32_000; // 32_000usize
Expand description

Context window assumed when no provider profile declares one.

Deliberately conservative: it has to be safe for any model, which means it is almost always wrong for the model actually in use — a 1M-context model on a profile that omits context_window runs against this number. It exists so budget arithmetic has an operand, not because it describes any model.

Anything reporting to an operator must call Config::configured_model_context_window and say “not configured” when it returns None, rather than echoing this value as the model’s real capacity.