File tree Expand file tree Collapse file tree 2 files changed +2
-2
lines changed
Expand file tree Collapse file tree 2 files changed +2
-2
lines changed Original file line number Diff line number Diff line change @@ -70,7 +70,7 @@ Proxying requests to OpenAI is supported now. Other LLM services will be support
7070| provider.options.top_p | No | number | Defines the top-p probability mass (0 - 1) for nucleus sampling. | |
7171| provider.options.stream | No | boolean | Enables streaming responses via SSE. | |
7272| provider.override.endpoint | No | string | Custom host override for the AI provider. | |
73- | timeout | No | integer | Request timeout in milliseconds (1-60000). | 3000 |
73+ | timeout | No | integer | Request timeout in milliseconds (1-60000). | 30000 |
7474| keepalive | No | boolean | Enables keepalive connections. | true |
7575| keepalive_timeout | No | integer | Timeout for keepalive connections (minimum 1000ms). | 60000 |
7676| keepalive_pool | No | integer | Maximum keepalive connections. | 30 |
Original file line number Diff line number Diff line change @@ -63,7 +63,7 @@ Proxying requests to OpenAI is supported now. Other LLM services will be support
6363| model.options.top_p | No | Number | Top-p probability mass. Range: 0 - 1 |
6464| model.options.stream | No | Boolean | Stream response by SSE. |
6565| override.endpoint | No | String | Override the endpoint of the AI provider |
66- | timeout | No | Integer | Timeout in milliseconds for requests to LLM. Range: 1 - 60000. Default: 3000 |
66+ | timeout | No | Integer | Timeout in milliseconds for requests to LLM. Range: 1 - 60000. Default: 30000 |
6767| keepalive | No | Boolean | Enable keepalive for requests to LLM. Default: true |
6868| keepalive_timeout | No | Integer | Keepalive timeout in milliseconds for requests to LLM. Minimum: 1000. Default: 60000 |
6969| keepalive_pool | No | Integer | Keepalive pool size for requests to LLM. Minimum: 1. Default: 30 |
You can’t perform that action at this time.
0 commit comments