continuum::runtime::EmbeddingProvider Struct Reference

#include <semantic_cache.hpp>

Inheritance diagram for continuum::runtime::EmbeddingProvider:

Public Member Functions
virtual	~EmbeddingProvider ()=default
virtual std::vector< float >	embed (const std::string &text) const =0
	Embed text; the result must have dimension() elements.
virtual std::size_t	dimension () const =0
virtual std::string	identity () const =0

Detailed Description

Source of the vectors the semantic tier compares.

Implement it in C++ or subclass continuum._native.EmbeddingProvider in Python (a local model, a hosted endpoint, precomputed vectors, ...).

Constructor & Destructor Documentation

~EmbeddingProvider()

virtual continuum::runtime::EmbeddingProvider::~EmbeddingProvider ( )

virtualdefault

Member Function Documentation

dimension()

virtual std::size_t continuum::runtime::EmbeddingProvider::dimension ( ) const

pure virtual

Implemented in continuum::runtime::BruteForceEmbeddingProvider.

embed()

virtual std::vector< float > continuum::runtime::EmbeddingProvider::embed ( const std::string &  text ) const

pure virtual

Embed text; the result must have dimension() elements.

Implemented in continuum::runtime::BruteForceEmbeddingProvider.

identity()

virtual std::string continuum::runtime::EmbeddingProvider::identity ( ) const

pure virtual

Stable identity of the embedding space (model name + version + any setting that changes vectors). It is part of the semantic cache key, so vectors from different embedders never compare against each other.

Implemented in continuum::runtime::BruteForceEmbeddingProvider.

---

The documentation for this struct was generated from the following file:

• include/continuum/runtime/semantic_cache.hpp