wylab/llama.cpp
0
0
Fork 1
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-09-14 18:02:52 +02:00
Code Issues Packages Projects Releases Wiki Activity
159 Commits 786 Branches 7,431 Tags
tcp_server
Commit Graph
4 Commits
Author SHA1 Message Date
Stephan WalterGitHubGeorgi Gerganov
 		69c92298a9 Deduplicate q4 quantization functions (#383) 
* Deduplicate q4 quantization functions

* Use const; add basic test

* Re-enable quantization test

* Disable AVX2 flags in CI

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2023-03-22 19:29:06 +02:00
Georgi GerganovandGitHub f5a77a629b Introduce C-style API (#370) 
* Major refactoring - introduce C-style API

* Clean up

* Add <cassert>

* Add <iterator>

* Add <algorithm> ....

* Fix timing reporting and accumulation

* Measure eval time only for single-token calls

* Change llama_tokenize return meaning
 2023-03-22 07:32:36 +02:00
hoangmitandGitHub 6eac39ba95 Add RMS norm and use it (#187) 
* add ggml_rms_norm

* update op num
 2023-03-16 00:41:38 +02:00
Georgi Gerganov 26c0846629 Initial release 2023-03-10 20:56:40 +02:00