Preferences used by the client when choosing a model. More...

#include <sampling.hpp>

Public Attributes
std::vector< ModelHint >	hints
	Ordered or unordered model hints supplied by the requester.

std::optional< double >	cost_priority
	Optional priority for low cost, typically normalized by the peer.

std::optional< double >	speed_priority
	Optional priority for low latency, typically normalized by the peer.

std::optional< double >	intelligence_priority
	Optional priority for model capability, typically normalized by the peer.

Json	extensions = Json::object()
	Unknown JSON members preserved for forward-compatible round trips.

Detailed Description

Preferences used by the client when choosing a model.

The documentation for this struct was generated from the following file:

Public Attributes