Parameters for sampling/createMessage. More...

#include <sampling.hpp>

Public Attributes
std::vector< SamplingMessage >	messages
	Conversation messages to sample from.

std::optional< ModelPreferences >	model_preferences
	Optional model selection preferences.

std::optional< std::string >	system_prompt
	Optional system prompt supplied outside the message array.

std::optional< std::string >	include_context
	Optional instruction for whether client context should be included.

std::optional< double >	temperature
	Optional sampling temperature. Explicit 0.0 is serialized.

int	max_tokens = 0
	Maximum tokens the client may generate.

std::vector< std::string >	stop_sequences
	Optional stop sequences.

Json	metadata = Json::object()
	Optional metadata object carried through the sampling request.

std::optional< TaskRequestParameters >	task
	Optional task request parameters for asynchronous sampling.

std::optional< Json >	meta
	Optional `_meta` extension object preserved on the wire.

std::vector< ToolDefinition >	tools
	Optional tools available to the sampled model.

std::optional< ToolChoice >	tool_choice
	Optional tool selection behavior.

Json	extensions = Json::object()
	Unknown JSON members preserved for forward-compatible round trips.

Detailed Description

Parameters for sampling/createMessage.

The documentation for this struct was generated from the following file:

Public Attributes