Connecting to Deepseek and Anthropic via Custom API

[ReneKry]

I have API keys for both providers, and I tested them, they are working.

I added them via Custom API.

Nevertheless, when I want to select a model, f.i. for the Run step, I cannot see them, I only see my local ollama models.

Do I have a faulty expectation, am I doing something wrong, or is this a bug?

[scosman]

You'll need to add models using the "Add Models" button before they will show up in the dropdown (if the providers don't support the model list API). You also might have an incorrect URL.

Even easier: I added Anthropic support with a nice UI. It's not in a release yet, but try a build from main like this one: https://github.com/Kiln-AI/Kiln/actions/runs/13876232989

[ReneKry]

Sorry for not being precise. I added DeepSeek via Settings->Providers and Models ->Custom API, entering a name, the base URL and the DeepSeek-API Key. I click Add. Then I go to the Run tab, and I open the models dropdown. It takes a few seconds, but then in the dropdown I can see two deepseek models after the last separator. Now I do the same with Anthropic: Name = "Anthropic", base URL = "https://api.anthropic.com/v1/messages" (as per the Anthropic API docu, though I also tried "https://api.anthropic.com/v1") and my Anthropic API-Key. I go to the Run tab, I open the models dropdown, it takes a few seconds, but then .... not only is Anthropic not there, but also the two Deepseek models are missing! I delete Anthropic in Settings->Providers and Models ->Custom API, and still I cannot see Deepseek. I delete Deepseek and add it again - it's there. If instead of clicking "Custom API", I use the "Add Models"->"Add Model" I can enter a name, but the dropdown "Providers" is empty. I click on it, and there is no element in that dropdown list. So I can only enter a name. I tried "claude-3-7-sonnet-20250219", but the Add Model button in the Add Model dialogue remains read only. So I tried first adding Anthropic as a Custom API and then go to "Add Models"->"Add Model", but still that dropdown is empty.

[ryanmon1]

Why is this still not fixed?

[ReneKry]

@scosman: Tried your solution, but it gave me this error message:

[scosman]

fix here: https://github.com/Kiln-AI/kiln_server/commit/9bb328ad3fcb91db8946d7fc3410996f977d67eb#diff-e905303ce1e174798b402eed64930aebe1e9645763a902b0455a510613d7d730