llama.cpp/examples/parallel at 7e2b9974d1ded87010d8d300cb09e194bf7f156d - llama.cpp - Gitea: Git with a cup of tea

wylab/llama.cpp

mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-09-15 18:13:29 +02:00

Files

T

History

Georgi Gerganov fa0e677820 llama : extend batch API to select which logits to output

2023-09-19 00:24:13 +03:00

..

CMakeLists.txt

parallel : example for serving multiple users in parallel

2023-09-18 20:37:28 +03:00

parallel.cpp

llama : extend batch API to select which logits to output

2023-09-19 00:24:13 +03:00