wylab/llama.cpp
0
0
Fork 1
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-09-01 01:27:50 +02:00
Code Issues Packages Projects Releases Wiki Activity
Files
b10645
llama.cpp/tools
T
History
Jonas JandGitHub c5fc7e3488 llama : add --n-cpu-ffn option (#26622) 
* common : dedupe --n-cpu-moe / --spec-draft-n-cpu-moe override loops

* common : add --n-cpu-ffn to CPU-offload dense FFN weights of first N layers

* common : generalize llm_ffn_block_regex over the FFN regex, drop TODO
2026-08-27 11:26:42 +02:00
..
batched-bench
cmake : add install() for impl libraries + fix apple builds (#23511)
2026-05-22 11:46:26 +03:00
cli
common: add json.h abstraction (#27511)
2026-08-22 16:28:28 +02:00
completion
common: migrate the deprecated --mmap/--no-mmap to --load-mode (#26934)
2026-08-15 16:35:53 +08:00
cvector-generator
cmake : introduce semantic versioning (#26839)
2026-08-12 14:15:03 +02:00
export-lora
docs: fix export-lora --lora-scaled syntax [no release] (#24703)
2026-06-18 16:46:17 +02:00
fit-params
fit: also take into account n_streams (#27496)
2026-08-22 16:16:06 +02:00
gguf-split
cmake : introduce semantic versioning (#26839)
2026-08-12 14:15:03 +02:00
imatrix
imatrix.cpp: Move finite check and only check touched experts (#26861)
2026-08-11 11:18:19 -04:00
llama-bench
llama : add --n-cpu-ffn option (#26622)
2026-08-27 11:26:42 +02:00
mtmd
mtmd: video: fix moov atom at the end of file (#27596)
2026-08-24 09:59:04 +02:00
perplexity
quant : Optimise memory usage by evicting weights after processing each layer (#22877)
2026-08-18 16:22:32 +02:00
quantize
cmake : introduce semantic versioning (#26839)
2026-08-12 14:15:03 +02:00
results
libs : rename libcommon -> libllama-common (#21936)
2026-04-17 11:11:46 +03:00
rpc
rpc: support apple RDMA as an RPC transport (#26421)
2026-08-25 20:12:15 +03:00
server
server : reject prefilled assistant messages with tool calls (#27626)
2026-08-25 09:35:22 -05:00
tokenize
tokenize : drop --stdin mutual-exclusion check (#25672)
2026-07-15 18:41:51 +02:00
tts
mtmd: add --mmproj-device argument (#23255)
2026-08-20 18:45:37 +02:00
tuning
metal : per-device tuned (Q, NE) for flash-attn vec (#26570)
2026-08-24 19:22:27 +03:00
ui
ui: Move Settings and MCP Servers routes to dialog-based views (#27744)
2026-08-26 21:07:24 +02:00
CMakeLists.txt
metal : per-device tuned (Q, NE) for flash-attn vec (#26570)
2026-08-24 19:22:27 +03:00