Skip to content

CUDA: mul_mat_q=true as default for llama_context_params#2912

Merged
JohannesGaessler merged 1 commit intoggml-org:masterfrom
JohannesGaessler:cuda-mmq-default-2
Aug 30, 2023
Merged

CUDA: mul_mat_q=true as default for llama_context_params#2912
JohannesGaessler merged 1 commit intoggml-org:masterfrom
JohannesGaessler:cuda-mmq-default-2

Commits

Commits on Aug 30, 2023