IQuest-Coder-V1

[knetrix]

Hello. Can you add this model? Especially 7B and 14B. I have 24 GB RAM. Unfortunately I can't run Devstral 2. Thanks.
Source: https://github.com/IQuestLab/IQuest-Coder-V1

[corysus]

This would be incredibly useful, and could potentially include additional Quant options. For instance, I can run certain models in Q3 that meet my specific needs, but the app currently restricts access to some models entirely. It might be beneficial to give users more flexibility and autonomy in selecting the models they want to use, while still maintaining the app's core focus on secure model selection - perhaps through an override feature or similar functionality.

[erusev]

@corysus I agree. We're looking for ways to support models that are not in the catalog.

Related: #14

[mdstaff]

@knetrix I think we can close this issue since this commit was added 0872d6e before Release 0.25.0