|
Continuum C++ API
Unified runtime for token + tensor execution
|
#include <observer.hpp>
Public Attributes | |
| ReuseEventKind | kind = ReuseEventKind::TierLookup |
| std::string | tier |
| TierLookup: "memo", "semantic", "prefix_kv", "layer_kv", "memory_graph". | |
| std::string | node_name |
| std::string | node_kind |
| "TokenOp", "TensorOp", "PromptOp", "ToolOp", "ControlOp". | |
| std::string | backend |
| std::string | model_id |
| std::string | cache_namespace |
| bool | hit = false |
| TierLookup: the tier matched (for memory_graph: recalled >= 1 node). | |
| std::string | served_by |
| NodeExecution: "memo", "semantic", "backend", or "passthrough". | |
| float | similarity = 0.0f |
| Semantic: best similarity. Memory graph: top recalled similarity. | |
| std::int32_t | match_len = 0 |
| Prefix / layer KV: matched prefix length. Memory graph: nodes recalled. | |
| std::int32_t | total_tokens = 0 |
| std::int32_t | tokens_saved = 0 |
| std::int32_t | tokens_sent = 0 |
| std::int32_t | reused_prefix_len = 0 |
| std::int32_t | compute_steps = 0 |
| bool | used_cached_state = false |
| std::int64_t | start_unix_ns = 0 |
| std::int64_t | end_unix_ns = 0 |
Structured record the interpreter emits for observability (tracing, metrics). Times are Unix-epoch nanoseconds from the system clock.
| std::string continuum::runtime::ReuseEvent::backend |
| std::string continuum::runtime::ReuseEvent::cache_namespace |
| std::int32_t continuum::runtime::ReuseEvent::compute_steps = 0 |
| std::int64_t continuum::runtime::ReuseEvent::end_unix_ns = 0 |
| bool continuum::runtime::ReuseEvent::hit = false |
TierLookup: the tier matched (for memory_graph: recalled >= 1 node).
| ReuseEventKind continuum::runtime::ReuseEvent::kind = ReuseEventKind::TierLookup |
| std::int32_t continuum::runtime::ReuseEvent::match_len = 0 |
Prefix / layer KV: matched prefix length. Memory graph: nodes recalled.
| std::string continuum::runtime::ReuseEvent::model_id |
| std::string continuum::runtime::ReuseEvent::node_kind |
"TokenOp", "TensorOp", "PromptOp", "ToolOp", "ControlOp".
| std::string continuum::runtime::ReuseEvent::node_name |
| std::int32_t continuum::runtime::ReuseEvent::reused_prefix_len = 0 |
| std::string continuum::runtime::ReuseEvent::served_by |
NodeExecution: "memo", "semantic", "backend", or "passthrough".
| float continuum::runtime::ReuseEvent::similarity = 0.0f |
Semantic: best similarity. Memory graph: top recalled similarity.
| std::int64_t continuum::runtime::ReuseEvent::start_unix_ns = 0 |
| std::string continuum::runtime::ReuseEvent::tier |
TierLookup: "memo", "semantic", "prefix_kv", "layer_kv", "memory_graph".
| std::int32_t continuum::runtime::ReuseEvent::tokens_saved = 0 |
| std::int32_t continuum::runtime::ReuseEvent::tokens_sent = 0 |
| std::int32_t continuum::runtime::ReuseEvent::total_tokens = 0 |
| bool continuum::runtime::ReuseEvent::used_cached_state = false |