REDDIT 原始帖子
More Motif 3 Beta Quant When?
I know this model isn't talked about much here because it hasn't seen much widespread support. Motif 3 beta is a promising 314B-parameter mixture-of-experts model with ~13B active parameters. It is on Artificial Analysis intelligence benchmark at 44, neck and…
I know this model isn't talked about much here because it hasn't seen much widespread support. Motif 3 beta is a promising 314B-parameter mixture-of-experts model with ~13B active parameters. It is on Artificial Analysis intelligence benchmark at 44, neck and neck with Deepseek V4 Pro. I would love a 4 bit quant of this to play with, any clue if it will ever happen? I see some 8 bit quant on HF but there aren't many quants.
已收录讨论
Also this model is for non-commercial use only, another reason it may not be so popular. Still an interesting model in frontier intelligence at the ~300B paramater count.
I'd benchmark it if it were available
I have a PR to llama.cpp which has some Q2-Q8 quants in the description if you'd like to try the model https://github.com/ggml-org/llama.cpp/pull/26298 . I personally quite like it. Note that you must not enable flash attention for the time being (the model uses a weird GQA ratio, so I am still trying to figure out how to get FA working.) Enabling it will likely produce gibberish for now.