Skip to content

Allow Users to Supply Additional CLI arguments to Llama Server #71

@nathanlesage

Description

@nathanlesage

The new Llama.cpp version that is bundled with LlamaBarn features the new MCP feature. However, most MCP servers correctly do not send the necessary headers to prevent the WebUI from experiencing CORS errors. There is a command line flag that will make LlamaServer spin up a proxy server to circumvent this, but it has to be supplied. Currently, there is no way to adjust the CLI arguments LlamaBarn supplies to the server.

It would be nice to be able to customize the CLI arguments in the settings window. Enabling just a very coarse text field with one (additional) argument per line would be sufficient to also account for any future CLI arguments that LlamaServer might add. This seems to me simpler and better maintainable than manually implementing settings for any potential new argument LlamaServer allows. This would also make this future-proof.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions