wylab/llama.cpp
1
0
Fork 1
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-07-16 17:35:58 +02:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • e789095502 llama: print memory breakdown on exit (#15860) b6569 Johannes Gäßler 2025-09-24 16:53:48 +02:00
  • f2a789e334 ggml : split graph allocations according to backend max buffer size (#15815) b6568 Acly 2025-09-24 16:17:49 +02:00
  • 3a59971967 model : add label for LiquidAI LFM2-2.6B model (#16204) b6567 Tarek Dakhran 2025-09-24 13:42:26 +02:00
  • 63b54c81a6 model-conversion : make causal-verify-logits fails with model names containing "." (#16215) Jie Fu (傅杰) 2025-09-24 16:25:26 +08:00
  • 152729f884 common : add missing chrono header for common.cpp (#16211) b6565 Uilian Ries 2025-09-24 08:53:47 +02:00
  • c0c59c1157 codeowners : match all requirements files (#16214) Sigbjørn Skjæret 2025-09-24 08:53:20 +02:00
  • 7735706b93 model-conversion : run-org-model.py fails to run on mac m1 (#16213) Jie Fu (傅杰) 2025-09-24 14:46:52 +08:00
  • 4d9ea03d17 codeowners : use slash prefix for root files [no ci] (#16210) Daniel Bevenius 2025-09-24 08:10:09 +02:00
  • 8ba548dae2 model-conversion : fix the make targets in the README.md (#16209) Jie Fu (傅杰) 2025-09-24 12:19:23 +08:00
  • f505bd83ca ci : disable AMD workflows + update NVIDIA workflows (#16200) Georgi Gerganov 2025-09-23 20:41:40 +03:00
  • 0889589dbe ci : enable Vulkan workflow on Mac (#16194) Georgi Gerganov 2025-09-23 13:44:25 +03:00
  • 4e29084ba4 ggml-cpu: Respect cpumask settings (#16164) b6558 Xiangyan Sun 2025-09-23 01:58:12 -07:00
  • f6b4af3d04 ggml : fix uninitialized is_on_grid in quantize_row_iq3_xxs_impl (#15928) b6557 Sigbjørn Skjæret 2025-09-23 10:25:20 +02:00
  • 264f1b5187 zdnn: refactor codebase + add docs (#16178) b6556 Aaron Teo 2025-09-23 14:53:05 +08:00
  • 0bc7cc7154 codeowners : add @danbev to model-conversion example [no ci] (#16190) Daniel Bevenius 2025-09-23 08:13:22 +02:00
  • 4b9f4cb0f8 devops: add s390x containers (#15915) Aaron Teo 2025-09-23 13:59:34 +08:00
  • 85e72271ba ggml-cpu : fix typo in gemm comments [no ci] (#16189) Daniel Bevenius 2025-09-23 05:59:03 +02:00
  • 1d0125bcf1 feat: Add conversion support in GraniteHybrid for non-hybrid (all attn) (#16177) Gabe Goodhart 2025-09-22 12:40:10 -06:00
  • 351f3da39c clang-tidy : disable warning about performance enum size (#16127) Haiyue Wang 2025-09-23 01:57:46 +08:00
  • 3ecb2f671a ggml : implement set_rows with i32 index (#16159) b6550 Sigbjørn Skjæret 2025-09-22 19:13:00 +02:00
  • 432cf4304c codeowners : update + cleanup (#16174) b6549 Georgi Gerganov 2025-09-22 18:20:21 +03:00
  • 37a23c17bd common : enable --offline mode without curl support (#16137) b6548 Adrien Gallouët 2025-09-22 14:13:51 +02:00
  • 138c87ce8b webui : fix handling incomplete chunks (#16107) Quentin Bramas 2025-09-22 10:53:13 +02:00
  • c6db9a1027 embedding : fix typos in README (#16171) GideonSerf 2025-09-22 10:49:58 +02:00
  • d05affbab7 common : remove unused local variables (#16140) b6545 Haiyue Wang 2025-09-22 16:48:42 +08:00
  • 4f324a556c ggml : extend ggml_can_fuse to work with non-sequential nodes (#16123) b6544 Georgi Gerganov 2025-09-22 11:12:37 +03:00
  • a71ae3ba7a ggml : add ggml_op_is_empty (#16122) b6543 Georgi Gerganov 2025-09-22 11:12:09 +03:00
  • 05a2458121 codeowners : update ownership for @ngxson and @allozuar (#16128) Xuan-Son Nguyen 2025-09-22 15:10:58 +07:00
  • 96fdca043b Vulkan: add conv_transpose_2d operation (#16022) b6541 Shin-myoung-serp 2025-09-22 17:04:01 +09:00
  • b2d980fce0 codeowners : claim responsibility for ci, models, gguf-py and convert (#16124) Sigbjørn Skjæret 2025-09-22 09:59:05 +02:00
  • 5c6106a696 contrib : update roles (#16113) Georgi Gerganov 2025-09-22 10:58:02 +03:00
  • ec65fb52f0 ci : remove vulkaninfo calls (#16169) Georgi Gerganov 2025-09-22 10:16:05 +03:00
  • 1d660d2fae ci : use smaller model (#16168) Georgi Gerganov 2025-09-22 09:11:39 +03:00
  • a20d810d79 vulkan: add RTE variants of exp shader (#16165) b6536 Jeff Bolz 2025-09-22 00:37:17 -05:00
  • 4d0a7cbc61 ci : adjust params for less runtime (#16167) b6535 Georgi Gerganov 2025-09-22 08:31:40 +03:00
  • 9073a73d82 vulkan: vec dot matrix multiplication fix (#16151) b6534 Ruben Ortlam 2025-09-22 07:22:43 +02:00
  • 51f5a45fbe opencl: fix concat crash on win arm64 with Adreno (#15944) b6533 lhez 2025-09-21 16:42:10 -07:00
  • c4510dc937 opencl: initial q8_0 mv support (#15732) b6532 lhez 2025-09-21 14:48:44 -07:00
  • da30ab5f86 ci : add label for the RISC-V runner (#16150) Georgi Gerganov 2025-09-21 19:00:27 +03:00
  • 28baac9c9f ci : migrate ggml ci to self-hosted runners (#16116) Georgi Gerganov 2025-09-21 16:50:45 +03:00
  • 1eeb523c3e vulkan: optimize UMA buffer operations and fix driver hangs (#16059) b6529 Giuseppe Scrivano 2025-09-21 08:31:55 +02:00
  • 5bb4a3edec vulkan: fix validation error about VK_PIPELINE_CREATE_CAPTURE_STATISTICS_BIT_KHR (#16086) b6528 Jeff Bolz 2025-09-21 01:23:37 -05:00
  • 17ca6ed540 Implement llama-pull tool llama-pull Eric Curtin 2025-09-20 17:24:35 +01:00
  • 7f766929ca sync : ggml b6527 Georgi Gerganov 2025-09-20 12:55:47 +03:00
  • 405921dcef ggml : introduce semantic versioning (ggml/1336) Daniel Bevenius 2025-09-16 06:16:52 +02:00
  • fa6383ca7e CUDA : conditionally add cuda architectures (ggml/1341) Gregor Jasny 2025-09-10 17:21:11 +02:00
  • 803dac2e48 vulkan: use vec dot for matrix matrix multiplications (#16056) b6524 Ruben Ortlam 2025-09-20 10:42:56 +02:00
  • e83ef74733 one less magic number xsn/qwen3next_experiment Xuan Son Nguyen 2025-09-20 12:58:36 +07:00
  • 459c0c2c1a server: fix SSE and OpenAI compatibility for error messages when streaming (#16109) b6523 Benni 2025-09-20 07:56:30 +02:00
  • f643b957f4 refactor softplus fn Xuan Son Nguyen 2025-09-20 12:17:15 +07:00
  • 46110e0630 split q_proj/gate Xuan Son Nguyen 2025-09-20 12:00:14 +07:00
  • be79d9fdd9 llama-bench: add --devices and --list-devices support (#16039) b6522 ssweens 2025-09-19 15:15:21 -07:00
  • f432d8d83e chat: Fix streaming parser for granite models (#15682) b6521 shun095 2025-09-20 00:57:30 +09:00
  • 4067f07fc5 feat: Improve mobile UI for Settings Dialog (#16084) Aleksander Grygier 2025-09-19 09:52:27 +02:00
  • 4b8560ab56 chat : fix build on arm64 (#16101) b6519 Xuan-Son Nguyen 2025-09-19 13:02:51 +07:00
  • 0dd58b6877 ggml : refactor forward_dup for cpu backend (#16062) b6518 Xuan-Son Nguyen 2025-09-19 11:31:56 +07:00
  • 69ffd89163 ggml-amx : fix ggml_amx_init() on generic Linux (#16049) b6517 Adrien Gallouët 2025-09-18 23:07:26 +02:00
  • 246c0d9c79 cmake : fix static linking for OpenMP on Unix-like systems (#16031) b6516 Adrien Gallouët 2025-09-18 23:07:18 +02:00
  • 178230ee21 Getting to decode stage... Piotr Wilkin 2025-09-18 21:47:40 +02:00
  • 3edd87cd05 opencl: optimize mxfp4 kernels (#16037) b6515 Shawn Gu 2025-09-18 12:03:34 -07:00
  • c0b45097c3 rename optimize_graph to graph_optimize (#16082) b6514 Jeff Bolz 2025-09-18 13:46:17 -05:00
  • 38dbdf4c05 CUDA: Optimize PAD_REFLECT_1D (#15957) b6513 Bowen Han 2025-09-18 11:26:03 -07:00
  • 368560a1e3 CUDA: fix compilation on CC 6.0 (#16091) b6512 Johannes Gäßler 2025-09-18 19:28:32 +02:00
  • 4ca088b036 Add resumable downloads for llama-server model loading (#15963) b6511 Eric Curtin 2025-09-18 16:22:50 +01:00
  • 652d303b32 metal : fuse add + rms gg/metal-fuse-add-rms Georgi Gerganov 2025-09-18 16:28:49 +03:00
  • 703f9e32c4 metal : use function constants for mul_mv_ext kernels (#16074) b6510 Georgi Gerganov 2025-09-18 16:28:41 +03:00
  • ad6bd9083b cuda : add missing F32<->I32 entries in ggml_cuda_cpy_fn (#16060) b6509 Sigbjørn Skjæret 2025-09-18 13:28:22 +02:00
  • c78f9fce68 Merge branch 'ggml-org:master' into qwen3_next Piotr Wilkin (ilintar) 2025-09-18 12:59:39 +02:00
  • 2b6b55a59f server : include usage statistics only when user request them (#16052) b6508 Radoslav Gerganov 2025-09-18 13:36:57 +03:00
  • e58174cecb llama : bump max seq limit from 64 to 256 (#15916) b6507 Georgi Gerganov 2025-09-18 12:47:56 +03:00
  • b213fce89b metal : improve F32, F16 and BF16 mat-vec multiplication (#16057) b6506 Georgi Gerganov 2025-09-18 12:33:45 +03:00
  • 64c6dcbe6d metal : make the NSG a function constant in mul_mv kernels gg/metal-mul-mv-opt-2 Georgi Gerganov 2025-09-18 11:13:59 +03:00
  • 320f029657 metal : improve F32, F16 and BF16 mat-vec multiplication Georgi Gerganov 2025-09-17 17:45:13 +03:00
  • e00f3fd8ff metal : avoid call free for non-owned buffer (#16067) b6505 Jhen-Jie Hong 2025-09-18 15:06:48 +08:00
  • f2f28380ea metal : handle nil cv during pipeline creation (#16065) b6504 Georgi Gerganov 2025-09-18 10:03:24 +03:00
  • 62c3b645c5 CANN: Remove print (#16044) b6503 Chenguang Li 2025-09-18 09:26:33 +08:00
  • 344331c2b6 First draft Piotr Wilkin 2025-09-18 00:21:17 +02:00
  • d304f459d8 GGML WebGPU: Support for ADD, MUL, RMS_NORM, GET_ROWS operators (#16018) b6502 Reese Levine 2025-09-17 13:09:40 -07:00
  • 0320ac5264 metal : refactor + optimize v2 (#15995) b6501 Georgi Gerganov 2025-09-17 20:38:12 +03:00
  • a7a98e0fff SvelteKit-based WebUI (#14839) b6500 Aleksander Grygier 2025-09-17 19:29:13 +02:00
  • 8f8f2274ee convert : add Llama4ForCausalLM (#16042) b6499 Xuan-Son Nguyen 2025-09-18 00:18:21 +07:00
  • c959b676be CUDA: fix FA occupancy, optimize tile kernel (#15982) b6498 Johannes Gäßler 2025-09-17 15:32:42 +02:00
  • cd08fc3ecc common : Fix corrupted memory error on json grammar initialization (#16038) b6497 David Ribeiro Alves 2025-09-17 01:08:02 -07:00
  • cb5bb6cc05 vulkan: automatically remove unsupported devices (#15976) b6496 Eve 2025-09-17 07:35:37 +00:00
  • a91d035b90 ci : revert back to macos-13 for macOS-latest-cmake-x64 (#16040) Daniel Bevenius 2025-09-17 09:34:09 +02:00
  • 745cbcf2fe llama-quant : fix the verification of attention layers for encoder-decoder models (#16023) b6494 Jie Fu (傅杰) 2025-09-17 15:30:55 +08:00
  • 1cbd80f8cf examples : support encoder-decoder models in the simple example (#16002) b6493 Jie Fu (傅杰) 2025-09-17 15:29:00 +08:00
  • 85286f3548 model : add OLMo3 support (#16015) b6492 Shane A 2025-09-17 00:01:58 -07:00
  • d5fabe3682 CANN: Optimize ggml_cann_set_device (#15935) b6491 Chenguang Li 2025-09-17 14:33:08 +08:00
  • 8ff206097c llama-bench: add --n-cpu-moe support (#15952) b6490 jacekpoplawski 2025-09-16 16:17:08 +02:00
  • 77475530b8 ci : use macos-latest for arm64 webgpu build (#16029) Daniel Bevenius 2025-09-16 15:27:52 +02:00
  • 3913f8730e ggml : fix padding in timestep embedding kernels (#15932) b6488 Daniel Bevenius 2025-09-16 15:25:57 +02:00
  • 76888d202e ci : upload xcframework artifact from ios-xcode-build job (#16010) Daniel Bevenius 2025-09-16 13:41:38 +02:00
  • f1fbffb5c0 fix: apply clang-format to CUDA macros (#16017) Bowen Han 2025-09-15 23:59:19 -07:00
  • 51abc96bdc ci : update macos-latest* jobs to use macos-latest (#15938) Daniel Bevenius 2025-09-16 05:57:16 +02:00
  • 07808ebb07 cmake : Do not install tools on iOS targets (#15903) b6484 Yuri Khrustalev 2025-09-15 22:54:44 -04:00
  • 6d758839ff Add LLaDA-7b-MoE diffusion model (#16003) b6483 Aman Gupta 2025-09-16 10:38:28 +08:00
  • 3d4053f77f CUDA: fix im2col_3d to respect non-contiguous inputs (views) (#15956) b6482 Jake Karnes 2025-09-15 16:28:31 -06:00
  • dc381aa9a6 docker : enable rocWMMA in ROCm images, add gfx1151 (#15997) Diego Devesa 2025-09-15 14:38:52 -07:00
  • 10d197409b releases : switch to rocWMMA develop branch, add gfx1151 (#15992) b6480 Diego Devesa 2025-09-15 14:38:42 -07:00