Continuum C++ API
Unified runtime for token + tensor execution
Loading...
Searching...
No Matches
continuum::runtime::KVCacheIndex::SnapshotEntry Struct Reference

#include <kv_prefix_cache.hpp>

Public Attributes

CacheEntry entry
 
std::vector< std::int32_t > tokens
 

Member Data Documentation

◆ entry

CacheEntry continuum::runtime::KVCacheIndex::SnapshotEntry::entry

◆ tokens

std::vector<std::int32_t> continuum::runtime::KVCacheIndex::SnapshotEntry::tokens

The documentation for this struct was generated from the following file: