Interface
IContextFragmentsManager

Provides methods for splitting text into context fragments and joining them.

Definition

Assembly:Telerik.Documents.AI.Core.dll

Syntax:

cs-api-definition

public interface IContextFragmentsManager

Splits the specified text into fragments suitable for processing, based on the model and encoding.

Declaration

cs-api-definition

Task<IFragments> SplitIntoFragments(string text, int maxTokenSizeOfSingleEmbedding)

Parameters

text

The input text to split.

maxTokenSizeOfSingleEmbedding

The maximum token size for a single embedding.

Returns

An array of text fragments.