Home
Commands
Quantize model (llama.cpp)
Quantize model (llama.cpp)
AI
./build/bin/llama-quantize model.gguf model-q4.gguf Q4_K_M
Copy command