https://huggingface.co/dpcpw/Mellum2-12B-A2.5B-Thinking-GGUF-mixed-q4-q8
dpc3d⋮Share...https://huggingface.co/dpcpw/Mellum2-12B-A2.5B-Thinking-GGUF-mixed-q4-q8 My first custom self-quantized model. :D Reply