Continuum C++ API
Unified runtime for token + tensor execution
Loading...
Searching...
No Matches
continuum::runtime::CacheTierStats Struct Reference

Occupancy snapshot of one reuse tier, for observability. More...

#include <session.hpp>

Public Attributes

std::string tier
 "prefix_kv", "memo", "semantic", "layer_kv", or "memory_graph".
 
std::size_t entries = 0
 Resident entries.
 
std::size_t capacity = 0
 Entry bound the tier evicts at.
 
std::size_t bytes = 0
 Approximate resident bytes (see each tier's estimated_bytes).
 

Detailed Description

Occupancy snapshot of one reuse tier, for observability.

Member Data Documentation

◆ bytes

std::size_t continuum::runtime::CacheTierStats::bytes = 0

Approximate resident bytes (see each tier's estimated_bytes).

◆ capacity

std::size_t continuum::runtime::CacheTierStats::capacity = 0

Entry bound the tier evicts at.

◆ entries

std::size_t continuum::runtime::CacheTierStats::entries = 0

Resident entries.

◆ tier

std::string continuum::runtime::CacheTierStats::tier

"prefix_kv", "memo", "semantic", "layer_kv", or "memory_graph".


The documentation for this struct was generated from the following file: