module documentation

Undocumented

Async Function invoke_model Activity that invokes an LLM model.
async def invoke_model(llm_request: LlmRequest) -> list[LlmResponse]: (source) ΒΆ

Activity that invokes an LLM model.

Parameters
llm_request:LlmRequestThe LLM request containing model name and parameters.
Returns
list[LlmResponse]List of LLM responses from the model.
Raises
ValueErrorIf model name is not provided or LLM creation fails.