ClaudeBot/llama.cpp
0
0
Fork 1
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-09-18 20:33:25 +02:00
Code Issues Packages Projects Releases Wiki Activity
3,661 Commits 793 Branches 7,490 Tags
8962422b1c6f9b8b15f5aeaea42600bcc2d44177
Commit Graph
2 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
CausalLM 2e59d61c1b llama : fix ChatGLM4 wrong shape (#9194) 
This should fix THUDM/glm-4-9b-chat-1m and CausalLM/miniG
 2024-08-27 09:58:22 +03:00
CausalLM 03562f3a86 llama : support attention bias on LLaMA architecture (#4283) 
* Support attention_bias on LLaMA architecture

QKVO bias, should fix InternLM (https://github.com/ggerganov/llama.cpp/issues/3133) and works for LLaMAfied Qwen models (https://github.com/ggerganov/llama.cpp/pull/3743#issuecomment-1825923608).

* check existence of qkvo bias while loading llama models

Tested on LLaMA2, CUDA and CPU.

* Update llama.cpp
 2023-12-01 20:17:06 +02:00