Benson Wong 29d3d9ba20 perf: add macOS GPU monitoring via mactop and ioreg (#816) ...

Implement performance monitoring on OSX for Apple Silicon hardware. 

The implementation uses a combination of mactop and ioreg. If mactop is
installed (`brew install mactop`) it is used in a headless cli mode to
stream usage metrics. mactop hooks into unpublished(?) C based APIs in
OSX. Rather than introduce a cgo dependency into llama-swap's build
chain only for darwin I opted to go the external process route.

ioreg, which comes bundled with OSX is used as the fallback. It does not
provide temperature and power usage data but is able to show accurate
GPU and memory utilization.

Updates #771, #814

2026-06-03 21:51:03 -07:00

..

cache

Introduce new routing backend (#790)

2026-05-28 21:47:01 -07:00

chain

Introduce new routing backend (#790)

2026-05-28 21:47:01 -07:00

config

Introduce new routing backend (#790)

2026-05-28 21:47:01 -07:00

event

Introduce new routing backend (#790)

2026-05-28 21:47:01 -07:00

logmon

Introduce new routing backend (#790)

2026-05-28 21:47:01 -07:00

perf

perf: add macOS GPU monitoring via mactop and ioreg (#816)

2026-06-03 21:51:03 -07:00

process

internal/process: improve windows shutdown behaviour (#808)

2026-06-01 00:45:30 -07:00

ring

proxy,ui: add performance monitoring with Prometheus metrics (#743)

2026-05-09 13:29:22 -07:00

router

internal/process: improve windows shutdown behaviour (#808)

2026-06-01 00:45:30 -07:00

server

fix: update the concurrency middleware to respond with a JSON payload (#798)

2026-05-29 23:59:32 -07:00

shared

Introduce new routing backend (#790)

2026-05-28 21:47:01 -07:00

watcher

Introduce new routing backend (#790)

2026-05-28 21:47:01 -07:00