|
Continuum C++ API
Unified runtime for token + tensor execution
|
#include <kv_prefix_cache.hpp>
Public Attributes | |
| CacheEntry | entry |
| std::vector< std::int32_t > | tokens |
| CacheEntry continuum::runtime::KVCacheIndex::SnapshotEntry::entry |
| std::vector<std::int32_t> continuum::runtime::KVCacheIndex::SnapshotEntry::tokens |