 Aldehir Rojas
|
5254a7994d
|
common : support manually triggering the reasoning budget end sequence (#23949)
|
2026-06-01 11:37:11 +02:00 |
|
|
Aldehir Rojas
|
d77599234e
|
common : do not pass prompt tokens to reasoning budget sampler (#22488)
|
2026-04-29 14:10:58 -05:00 |
|
|
Aldehir Rojas
|
59d840209a
|
common : inhibit lazy grammar sampler while reasoning is active (#20970)
* common : inhibit grammar while reasoning budget is active
* cont : update force_pos in accept
* cont : fix tests
* cont : tweak should apply logic
* cont : return early not using grammar sampler
* Add tests
* cont : prevent backend sampling when reasoning budget enabled
* cont : fix typo
---------
Co-authored-by: Piotr Wilkin <piotr.wilkin@syndatis.com>
|
2026-03-27 18:30:40 +01:00 |
|
|
Piotr Wilkin (ilintar)
|
5e54d51b19
|
common/parser: add proper reasoning tag prefill reading (#20424)
* Implement proper prefill extraction
* Refactor cli parameters, update docs, move reasoning budget sampler part to common/reasoning-budget.cpp
* Update tools/server/server-task.cpp
* refactor: move grammars to variant, remove grammar_external, handle exception internally
* Make code less C++y
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
|
2026-03-19 16:58:21 +01:00 |
|
|
Piotr Wilkin (ilintar)
|
acb7c79069
|
common/parser: handle reasoning budget (#20297)
* v1
* Finished!
* Handlie cli
* Reasoning sampler
* Apply suggestions from code review
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
* Less explosive terminology :)
* Add utf-8 case and tests
* common : migrate reasoning budget sampler to common
* cont : clean up
* cont : expose state and allow passing as initial state
* cont : remove unused imports
* cont : update state machine doc string
---------
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
Co-authored-by: Alde Rojas <hello@alde.dev>
|
2026-03-11 10:26:12 +01:00 |
|