apply_request_transforms

Function apply_request_transforms 

Source
pub fn apply_request_transforms(
    messages: Vec<Message>,
    tool_descriptors: &[ToolDescriptor],
    transforms: &[Arc<dyn InferenceRequestTransform>],
) -> InferenceTransformOutput
Expand description

Apply a chain of transforms, piping messages through each in order.

Returns the final messages and whether any transform requested prompt caching.