continuum::backend::VllmShimBackend::PrefixState Struct Reference

Prefix text and model a state handle refers to. More...

#include <vllm_shim.hpp>

Public Attributes
std::string	prefix_text
std::string	model

Detailed Description

Prefix text and model a state handle refers to.

Member Data Documentation

model

std::string continuum::backend::VllmShimBackend::PrefixState::model

prefix_text

std::string continuum::backend::VllmShimBackend::PrefixState::prefix_text

---

The documentation for this struct was generated from the following file:

• include/continuum/backend/vllm_shim.hpp