Continuum C++ API
Unified runtime for token + tensor execution
Loading...
Searching...
No Matches
continuum::ir::TokenOpPayload Struct Reference

#include <node.hpp>

Public Attributes

std::string op_name
 
std::string model_id
 
float temperature = 1.0f
 
std::int32_t max_tokens = 512
 

Member Data Documentation

◆ max_tokens

std::int32_t continuum::ir::TokenOpPayload::max_tokens = 512

◆ model_id

std::string continuum::ir::TokenOpPayload::model_id

◆ op_name

std::string continuum::ir::TokenOpPayload::op_name

◆ temperature

float continuum::ir::TokenOpPayload::temperature = 1.0f

The documentation for this struct was generated from the following file: