wylab/llama.cpp
0
0
Fork 1
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-09-07 16:37:57 +02:00
Code Issues Packages Projects Releases Wiki Activity
10,841 Commits 778 Branches 7,351 Tags
0cc4m/vulkan-mul-mm-refactor
Commit Graph
2 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
JamePengandGitHub cc231cb0da dflash: pass missing NVFP4 scales to attention operations (#28000) 
- DFlash2 NVFP4 draft models produced almost no accepted speculative
tokens because the Q, K, V, and output projection scales were not
passed to the corresponding graph operations.
 2026-08-30 11:34:39 +03:00
JamePengandGitHub e40bf88642 metal : avoid threadgroup matrix array instantiation in kernel_lightning_indexer (#26646) 
- In MSL, declaring an array of matrix types like `threadgroup half4x4` causes
a 'no matching constructor' compilation error because MSL matrix types do not
have zero-argument default constructors and threadgroup variables cannot have
initializers.

- Fix this by declaring a POD `threadgroup half` array instead and casting
to `threadgroup half4x4 *` for matrix indexing.

Signed-off-by: JamePeng <jame_peng@sina.com>
 2026-08-07 07:49:14 +03:00