-
Notifications
You must be signed in to change notification settings - Fork 53
Allow Users to Supply Additional CLI arguments to Llama Server #71
Description
The new Llama.cpp version that is bundled with LlamaBarn features the new MCP feature. However, most MCP servers correctly do not send the necessary headers to prevent the WebUI from experiencing CORS errors. There is a command line flag that will make LlamaServer spin up a proxy server to circumvent this, but it has to be supplied. Currently, there is no way to adjust the CLI arguments LlamaBarn supplies to the server.
It would be nice to be able to customize the CLI arguments in the settings window. Enabling just a very coarse text field with one (additional) argument per line would be sufficient to also account for any future CLI arguments that LlamaServer might add. This seems to me simpler and better maintainable than manually implementing settings for any potential new argument LlamaServer allows. This would also make this future-proof.