Enum CacheTtl
pub enum CacheTtl {
FiveMinutes,
OneHour,
}Expand description
Prompt-cache entry lifetime to request for this provider’s Anthropic
cache markers. "5m" is the API default; "1h" extends the cache
entry lifetime to one hour so a pause longer than five minutes does
not force a full-price rewrite of the cached prefix. Meaningful only
where Anthropic-shaped cache_control markers reach the API: the
native Anthropic provider always places them, compatible providers
only behind cache_passthrough (with passthrough off the setting is
inert). One TTL applies to every marker this implementation places;
operator-supplied cache_control (via provider_extra or raw tool
JSON) sits outside that guarantee and must order 1h before 5m when
mixing lifetimes in one request.
Variants§
FiveMinutes
Standard 5-minute cache lifetime (the API default).
OneHour
1-hour cache lifetime; cache writes bill at a premium write rate.
Trait Implementations§
impl Copy for CacheTtl
Source§impl<'de> Deserialize<'de> for CacheTtl
impl<'de> Deserialize<'de> for CacheTtl
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
impl Eq for CacheTtl
Source§impl HasPropKind for CacheTtl
impl HasPropKind for CacheTtl
const PROP_KIND: PropKind = crate::config::PropKind::Enum
const ALIAS_SOURCE: Option<AliasSource> = None
Source§fn display_secret_terminals() -> Vec<&'static str>
fn display_secret_terminals() -> Vec<&'static str>
secret_field_terminals.Source§impl JsonSchema for CacheTtl
impl JsonSchema for CacheTtl
Source§fn schema_id() -> Cow<'static, str>
fn schema_id() -> Cow<'static, str>
Source§fn json_schema(generator: &mut SchemaGenerator) -> Schema
fn json_schema(generator: &mut SchemaGenerator) -> Schema
Source§fn inline_schema() -> bool
fn inline_schema() -> bool
$ref keyword. Read moreimpl StructuralPartialEq for CacheTtl
Auto Trait Implementations§
impl Freeze for CacheTtl
impl RefUnwindSafe for CacheTtl
impl Send for CacheTtl
impl Sync for CacheTtl
impl Unpin for CacheTtl
impl UnsafeUnpin for CacheTtl
impl UnwindSafe for CacheTtl
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> DeserializeOwned for Twhere
T: for<'de> Deserialize<'de>,
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
key and return true if they are equal.§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more