|
Continuum C++ API
Unified runtime for token + tensor execution
|
Occupancy snapshot of one reuse tier, for observability. More...
#include <session.hpp>
Public Attributes | |
| std::string | tier |
| "prefix_kv", "memo", "semantic", "layer_kv", or "memory_graph". | |
| std::size_t | entries = 0 |
| Resident entries. | |
| std::size_t | capacity = 0 |
| Entry bound the tier evicts at. | |
| std::size_t | bytes = 0 |
Approximate resident bytes (see each tier's estimated_bytes). | |
Occupancy snapshot of one reuse tier, for observability.
| std::size_t continuum::runtime::CacheTierStats::bytes = 0 |
Approximate resident bytes (see each tier's estimated_bytes).
| std::size_t continuum::runtime::CacheTierStats::capacity = 0 |
Entry bound the tier evicts at.
| std::size_t continuum::runtime::CacheTierStats::entries = 0 |
Resident entries.
| std::string continuum::runtime::CacheTierStats::tier |
"prefix_kv", "memo", "semantic", "layer_kv", or "memory_graph".