wylab/llama.cpp
0
0
Fork 1
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-09-14 18:02:52 +02:00
Code Issues Packages Projects Releases Wiki Activity
9,102 Commits 786 Branches 7,431 Tags
gg/spec-mtp-experiments
Commit Graph
547 Commits
Author SHA1 Message Date
Georgi Gerganov c8f8e2364c cont : simplify 2026-05-11 10:54:07 +03:00
Aman Gupta a428b010ab spec: support MTP 2026-05-11 11:28:30 +08:00
Georgi Gerganov db8e326913 spec : introduce common_speculative_process() 2026-05-09 17:12:24 +03:00
Georgi Gerganov ec8bc44854 cont : minor 2026-05-09 16:38:17 +03:00
Georgi Gerganov b3bd3bd4cc cont : clean-up 2026-05-09 15:03:20 +03:00
Georgi Gerganov ce0acf03ea server, spec : clean-up 2026-05-09 10:21:57 +03:00
Georgi Gerganov f1652197dd server : support parallel drafting 2026-05-08 19:30:31 +03:00
Georgi Gerganov f88c942861 spec : support parallel drafts 2026-05-08 18:53:33 +03:00
Georgi Gerganov 927d6635d3 cont : prepare params 2026-05-08 17:50:20 +03:00
Georgi Gerganov 8822c122be cont : prepare params 2026-05-08 17:06:24 +03:00
Georgi Gerganov 6582523eaa spec : refactor for multi-sequence speculative context 2026-05-08 15:43:36 +03:00
Georgi Gerganov efa2f8e5a7 naming : improve consistency 2026-05-08 12:24:57 +03:00
Georgi Gerganov 778f9e247e tools : update readme 2026-05-08 11:55:16 +03:00
Georgi Gerganov 1dbc054da5 server : fix slot ctx_drft ptr 2026-05-08 11:55:05 +03:00
Georgi Gerganov e5b1401318 speculative-simple : update 2026-05-08 11:09:34 +03:00
Georgi Gerganov 3b1a8df8fd server : clean-up + dry 2026-05-08 10:20:01 +03:00
Georgi Gerganov 233d1aee69 server : add comment 
[no ci]
 2026-05-08 08:50:23 +03:00
Georgi Gerganov 12c7cfbe83 server : fix URL for draft model 2026-05-08 08:03:49 +03:00
Georgi Gerganov 6a4b05a030 server : fix mtmd draft processing 2026-05-08 08:02:11 +03:00
Georgi Gerganov 7e118cdce0 cont : process images throught the draft context 2026-05-07 21:44:09 +03:00
Georgi Gerganov ae6703fa89 cont : pass correct n_past for drafting 2026-05-07 21:44:08 +03:00
Georgi Gerganov 0239f4c611 cont : handle non-ckpt models 2026-05-07 21:44:08 +03:00
Georgi Gerganov c7facb0fe1 cont : async drft eval when possible 2026-05-07 21:44:08 +03:00
Georgi Gerganov 08c8012bde cont : sync main and drft contexts 2026-05-07 21:44:08 +03:00
Georgi Gerganov de35b1255c server, spec : transition to unified spec context 2026-05-07 21:44:08 +03:00
Georgi Gerganov 1afee5b262 server : improve ctx names 
[no ci]
 2026-05-07 21:44:08 +03:00
Georgi Gerganov 11fd5e7272 server : draft prompt cache and checkpoints 
[no ci]
 2026-05-07 21:44:08 +03:00
Georgi Gerganov c97dc3605e server : sketch the ctx_dft decode loop 
[no ci]
 2026-05-07 21:44:08 +03:00
Georgi Gerganov 8a50f6f0b9 cont : dedup ctx_seq_rm_type 
[no ci]
 2026-05-07 21:44:07 +03:00
Georgi Gerganov 77269ad8a7 cont : pass seq_id 
[no ci]
 2026-05-07 21:44:07 +03:00
Georgi Gerganov 4550f0f08b spec : update common_speculative_init() 
[no ci]
 2026-05-07 21:44:07 +03:00
Georgi Gerganov befc7ef635 spec : drop support for incompatible vocabs 
[no ci]
 2026-05-07 21:44:07 +03:00
Georgi Gerganov 2c9a40849f spec : refactor 
[no ci]
 2026-05-07 21:44:07 +03:00
PascalandGitHub f4b5a2ee91 webui: fix ?model= URL param race in router mode (#22771) 
* webui: fix ?model= URL param race in router mode

* chore: update webui build output
 2026-05-07 13:09:32 +02:00
viggyandGitHub e358d75adb webui: fix flicker issue on dismiss animation on overlay primitives (#22773) 
* add fill-mode-forwards

* generated diffs
 2026-05-07 08:11:31 +02:00
Aleksander GrygierandGitHub e3e3f8e46a webui: Remove Google Favicons & Improve MCP Information logic & UI (#22719) 
* refactor: Remove Google favicon utility

* fix: MCP Server favicon

* refactor: Cleanup

* refactor: MCP Server Information

* fix: Fix MCP Settings UI

* refactor: Cleanup
 2026-05-06 11:12:27 +02:00
viggyandGitHub 07eaf919ed add tabindex and aria-hidden (#22699) 2026-05-06 09:21:58 +02:00
Georgi GerganovandGitHub 2bacb1eb77 server : validate --tools CLI argument against known tool names (#22538) 
Previously, unknown tool names passed via --tools were silently ignored.
Now the server validates each tool name at startup and exits with an
error if an unrecognized tool is specified, listing the available tools.

Assisted-by: llama.cpp:local pi
 2026-05-05 06:35:27 +03:00
Georgi GerganovandGitHub d6e7b033a4 llama : add option to save memory in device buffers (#22679) 
* llama : add option to save memory in device buffers

* tests : extend llama-save-load-state
 2026-05-05 06:35:07 +03:00
Xuan-Son NguyenandGitHub 935a340292 server: implement /models?reload=1 (#21848) 2026-05-04 16:23:26 +02:00
JusteLeoandGitHub 36a694c965 webui : fix circular dependency between chat.service.ts and models.svelte.ts (#22625) 2026-05-04 13:38:10 +02:00
Piotr Wilkin (ilintar)andGitHub a4701c98f7 common/autoparser: fixes for newline handling / forced tool calls (#22654) 
* chat/autoparser: the fixes

* Move optspace() to chat-peg-parser, comment out server tests invalidated due to content now allowed with forced tool calls.

* Trim whitespace on apply instead
 2026-05-04 13:18:11 +02:00
Evan HuusandGitHub c84e6d6db5 server: Add a simple get_datetime server tool (#22649) 2026-05-04 12:19:41 +02:00
Nick TowleandGitHub fa8feaed34 webui: restore missing settings (#22666) 2026-05-04 09:04:07 +02:00
Georgi GerganovandGitHub 846262d787 docs : update speculative decoding parameters after refactor (#22397) (#22539) 
* docs : update speculative decoding parameters after refactor (#22397)

Update docs/speculative.md to reflect the new parameter naming scheme
introduced in PR #22397:

- Replace --draft-max/--draft-min with --spec-draft-n-max/--spec-draft-n-min
- Replace --spec-ngram-size-n/m with per-implementation variants
- Add documentation for all new --spec-ngram-*- parameters
- Update all example commands

Assisted-by: llama.cpp:local pi

* pi : add rule to use gh CLI for GitHub resources

Assisted-by: llama.cpp:local pi

* docs : run llama-gen-docs

* arg : fix typo
 2026-05-04 08:52:07 +03:00
Georgi GerganovandGitHub 0754b7b6fe server : avoid checkpoint data host copies (#22558) 
* server : avoid checkpoint data host copies

* llama : refactor llama_io_read_i
 2026-05-02 18:03:25 +03:00
Aleksander GrygierGitHubXuan Son Nguyen
 		ab6120cde5 webui: Spring Cleaning Refactor v1 (#22505) 
* wip: server_tools

* feat: Integrate with `/tools` endpoint

* feat: Builtin + MCP + JSON Schema Tools WIP

* refactor

* displayName -> display_name

* snake_case everywhere

* rm redundant field

* feat: Improvements

* chore: update webui build output

* refactor: Updates after server updates

* chore: update webui build output

* change arg to --tools all

* feat: UI improvements

* chore: update webui build output

* add readme mention

* llama-gen-docs

* chore: update webui build output

* chore: update webui build output

* chore: update webui build output

* feat: Reorganize settings sections

* feat: Separate dialogs for MCP Servers Settings and Import/Export

* feat: WIP

* feat: WIP

* feat: WIP

* feat: WIP

* feat: WIP

* feat: WIP

* WIP on allozaur/20677-webui-server-tools

* feat: UI improvements

* chore: Update package lock

* chore: Run `npm audit fix`

* feat: UI WIP

* feat: UI

* refactor: Desktop Icon Strip DRY

* feat: Cleaner rendering and transition for ChatScreen

* feat: UI improvements

* feat: UI improvement

* feat: Remove MCP Server "enable" switch from Tools submenu

* chore: Run `npm audit fix`

* feat: WIP

* feat: Logic improvements

* refactor: Cleanup

* refactor: DRY

* test: Fix Chat Sidebar UI Tests

* chore: Update package lock

* refactor: Cleanup

* feat: Chat Message Action Card with Continue and Permission flow implementations

* feat: Add agentic steering messages, draft messages and improve chat UX

* fix: Search results UI

* test: Fix unit test

* feat: UI/UX improvements

* refactor: Simplify `useToolsPanel` access in components

* feat: Implement Processing Info Context API

* feat: Implement 'Go back to chat' functionality for settings

* feat: Enhance MCP Server management in Chat Form Attachments

* style: Minor UI and branding adjustments

* chore: Update webui static build output

* chore: Formatting, linting & type checks

* feat: Draft messages logic

* feat: UI improvements

* feat: Steering Messages improvements

* refactor: Cleanup

* refactor: Cleanup

* feat: Improve UI

* refactor: Settings navigation hook

* refactor: DRY code

* refactor: DRY ChatMessageUser UI components

* refactor: Desktop Icon Strip DRY

* refactor: Tools & permissions

* fix: Navigation condition

* refactor: Cleanup

* refactor: Cleanup

* refactor: Cleanup

* fix: preserve reasoning_content in agentic flow

* refactor: Storybook cleanup

* refactor: isInViewport util function

* refactor: Rename globally `onClick` to `onclick`

* chore: `npm audit fix`

* refactor: Action Icon usage

* refactor: Naming

* refactor: JS in `class` directive

* refactor: Chat components cleanup WIP

* refactor: Components structure

* refactor: Cleanup WIP

* feat: New ChatAttachmentsPreview component

* feat: UI improvements

* feat: UI improvements

* refactor: Cleanup

* refactor: ChatAttachmentsPreview UI/UX

* refactor: Remove dead code

* refactor: Cleanup

* fix: Model Name aliases displaying

* feat: Shortcut improvements

* refactor: Chat Message

* feat: Move Import/Export to settings

* refactor: Cleanup

* refactor: Cleanup

* refactor: Cleanup

* refactor: Cleanup

---------

Co-authored-by: Xuan Son Nguyen <son@huggingface.co>
 2026-05-01 18:36:29 +02:00
Georgi GerganovandGitHub 80afa33aad spec : fix draft model checkpoints (#22521) 
* spec : fix draft model checkpoints

* cont : clean-up

* cont : gate the ngram-mod reset warning behind verbose flag
 2026-04-30 08:32:18 +03:00
Georgi GerganovandGitHub 683c5acb90 spec : disacard last drafted token with low prob (#22506) 2026-04-29 17:00:00 +03:00
PascalandGitHub 59237bfbbc webui: fix slow mic stop and WAV encode (#22480) 
* webui: instant mic stop, race-free recorder restart

* webui: faster WAV PCM encode via hoisted channels and Int16Array

* chore: update webui build output

* webui: drop setTimeout(0) hack and harden cancelRecording

* chore: update webui build output
 2026-04-29 12:58:35 +02:00