Type Alias ChatCompletionRequest

ChatCompletionRequest: {
    max_tokens?: number;
    messages: ChatCompletionMessage[];
    model: string;
    response_format?: unknown;
    stream?: boolean;
    temperature?: number;
    tool_choice?: unknown;
    tools?: unknown[];
    top_k?: number;
    top_p?: number;
    [key: string]: unknown;
}

A request to the LLM Gateway's OpenAI-compatible chat completions endpoint. Uncommon fields (e.g. fallback_config, transcript_id) can still be passed by name even though they aren't individually typed here.

Type declaration

  • [key: string]: unknown
  • Optionalmax_tokens?: number
  • messages: ChatCompletionMessage[]
  • model: string
  • Optionalresponse_format?: unknown
  • Optionalstream?: boolean

    SSE streaming is not supported by this client yet.

  • Optionaltemperature?: number
  • Optionaltool_choice?: unknown
  • Optionaltools?: unknown[]
  • Optionaltop_k?: number
  • Optionaltop_p?: number

Settings

Member Visibility