wylab/llama.cpp
0
0
Fork 1
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-09-14 18:02:52 +02:00
Code Issues Packages Projects Releases Wiki Activity
10,968 Commits 786 Branches 7,431 Tags

Default Branch

master

41abbfd599 · qwen4exp: enable rms_norm + mul fusion (#28896) · Updated 2026-09-14 16:16:30 +02:00
 ZIP  TAR.GZ

Branches

llama-metadata

d0445a2eff · better documentation · Updated 2023-11-10 01:38:20 +01:00    wylab

9467
3
 ZIP  TAR.GZ
fix-tensor-split-zero

47d604fa2d · fix issues · Updated 2023-11-05 13:20:22 +01:00    wylab

9481
3
 ZIP  TAR.GZ
revert-pool

3ef358fffd · Revert "cuda : use CUDA memory pool with async memory allocation/deallocation when available (#3903)" · Updated 2023-11-04 21:26:51 +01:00    wylab

9485
2
 ZIP  TAR.GZ
metal-soft-max

46868a499e · metal : multi-simd softmax · Updated 2023-11-01 20:16:34 +01:00    wylab

9510
1
 ZIP  TAR.GZ
llm-build-context

a8796f9609 · llm : cleanup + comments · Updated 2023-11-01 19:08:02 +01:00    wylab

9519
4
 ZIP  TAR.GZ
llm-reuse-constants

7420bef83e · wip wip wip · Updated 2023-11-01 07:51:43 +01:00    wylab

9519
1
 ZIP  TAR.GZ
llama-refactor

afb3929279 · Merge branch 'master' into llama-refactor · Updated 2023-10-31 19:35:31 +01:00    wylab

9521
21
 ZIP  TAR.GZ
test-mmv

29fe516913 · wip · Updated 2023-10-31 17:36:37 +01:00    wylab

9522
1
 ZIP  TAR.GZ
deploy

dab42893c9 · scripts : working curl pipe · Updated 2023-10-31 16:03:56 +01:00    wylab

9522
3
 ZIP  TAR.GZ
llama-refactor-norm

7923b70cb8 · llama : add llm_build_inp_embd helper · Updated 2023-10-31 15:43:08 +01:00    wylab

9527
37
 ZIP  TAR.GZ
ggml-impl

4b3cb98d46 · ggml-impl : move extern "C" to start of file · Updated 2023-10-30 18:05:58 +01:00    wylab

9523
7
 ZIP  TAR.GZ
lto

bc28aaa8c2 · make : use -lfto=auto to avoid warnings and maintain perf · Updated 2023-10-30 15:00:53 +01:00    wylab

9523
5
 ZIP  TAR.GZ
scratch

15267192c0 · llama : refactor tensor offloading as callback · Updated 2023-10-29 12:04:36 +01:00    wylab

9527
15
 ZIP  TAR.GZ
ggml-quants

8a86b95e87 · quantize : --pure option for disabling k-quant mixtures · Updated 2023-10-28 22:37:03 +02:00    wylab

9528
3
 ZIP  TAR.GZ
apply-3585

de7e0912b6 · convert : ignore tokens if their IDs are within [0, vocab_size) · Updated 2023-10-28 14:01:36 +02:00    wylab

9531
1
 ZIP  TAR.GZ
sampling-greedy-with-probs

bbfc62ac2f · sampling : temp == 0.0 -> no probs, temp < 0.0 -> probs · Updated 2023-10-28 13:04:57 +02:00    wylab

9539
3
 ZIP  TAR.GZ
cuda-multi-gpu

cd3e20fb50 · cuda : fix multi-gpu with tensor cores · Updated 2023-10-27 22:11:50 +02:00    wylab

9538
3
 ZIP  TAR.GZ
cuda-quantum-batch

49af767fad · build : add compile option to force use of MMQ kernels · Updated 2023-10-27 12:21:04 +02:00    wylab

9540
7
 ZIP  TAR.GZ
cuda-batched-gemm

d798a17c34 · cuda : add TODO for calling cublas from kernel + using mem pool · Updated 2023-10-24 15:33:24 +02:00    wylab

9554
10
 ZIP  TAR.GZ
cuda-batched-gemm-deq

6966474928 · cuda : play with faster Q4_0 dequantization · Updated 2023-10-24 09:29:40 +02:00    wylab

9554
8
 ZIP  TAR.GZ