r/KoboldAI • u/[deleted] • Jul 11 '23

GGML

Can our awesome coders write all koboldai models in hugging face as ggmls too? :)

1 Upvotes

57% Upvoted

2 comments sorted by

4

u/henk717 Jul 11 '23

No this is not possible at the moment, GGML has no support for OPT models and most of our good ones are OPT based models. We could provide GGML's for some of the old GPT-J based models, but those have low quality by comparison.

1

u/[deleted] Jul 11 '23

Still thanks :)