|
Continuum C++ API
Unified runtime for token + tensor execution
|
This is the complete list of members for continuum::runtime::KVCacheIndex, including all inherited members.
| clear() | continuum::runtime::KVCacheIndex | |
| estimated_bytes() const | continuum::runtime::KVCacheIndex | |
| insert(CacheEntry entry, const std::vector< std::int32_t > &token_prefix) | continuum::runtime::KVCacheIndex | |
| insert_unlocked(CacheEntry entry, const std::vector< std::int32_t > &token_prefix) | continuum::runtime::KVCacheIndex | |
| invalidate(void *backend_handle) | continuum::runtime::KVCacheIndex | |
| KVCacheIndex(std::size_t max_entries=8192) | continuum::runtime::KVCacheIndex | explicit |
| load_metadata(const std::string &path) | continuum::runtime::KVCacheIndex | |
| longest_prefix(const std::string &model_id, const DecodeParams &decode, const std::vector< std::int32_t > &tokens, const std::string &cache_namespace={}) const | continuum::runtime::KVCacheIndex | |
| max_entries() const | continuum::runtime::KVCacheIndex | inline |
| save_metadata(const std::string &path) const | continuum::runtime::KVCacheIndex | |
| size() const | continuum::runtime::KVCacheIndex | |
| snapshot() const | continuum::runtime::KVCacheIndex |