3 people ad6c66839a ggml-cuda: fallback to F32 on device without BF16 hardware acceleration (#28846) ...

* ggml-cuda: fallback to F32 on device without BF16 hardware acceleration: (Nvidia >= AMPERE, AMD >= RDNA3 or = CDNA)

* apply logic to NVIDIA as well

---------

Co-authored-by: Johannes Gäßler <johannesg@5d6.de>

2026-09-14 00:05:10 +02:00

..

ggml-blas

llama: add default load-mode auto, which avoids mmap on iGPUs (#26081)

2026-08-11 09:20:46 +03:00

ggml-cann

ggml: add SWIGLU_CLAMP (#27930)

2026-08-30 23:00:02 +08:00

ggml-cpu

ggml-cpu(s390x): guard VXE-only repack helpers (#28775)

2026-09-14 01:18:53 +08:00

ggml-cuda

ggml-cuda: fallback to F32 on device without BF16 hardware acceleration (#28846)

2026-09-14 00:05:10 +02:00

ggml-et

ggml: add SWIGLU_CLAMP (#27930)

2026-08-30 23:00:02 +08:00

ggml-hexagon

hexagon: support for multi-device model split (aka row-split) (#28589)

2026-09-11 20:46:51 -07:00

ggml-hip

CUDA: replace GGML_FA_ALL_QUANTS with GGML_FA_QUANTS, more control over what is compiled (#28079)

2026-09-09 12:50:08 +02:00

ggml-metal

metal : skip the empty half of the mul_mm_id token tile (#28301)

2026-09-11 14:12:55 +03:00

ggml-musa

CUDA: replace GGML_FA_ALL_QUANTS with GGML_FA_QUANTS, more control over what is compiled (#28079)

2026-09-09 12:50:08 +02:00

ggml-opencl

opencl: apply the noshuffle row-alignment rule to q4_K, q5_K and q8_0, not just q6_K (#28575)

2026-09-12 21:33:23 -07:00

ggml-openvino

vulkan: support type-aligned GET_ROWS (#28253)

2026-09-07 12:22:10 +02:00

ggml-rpc

rpc : fix linking when compiling with BUILD_SHARED_LIBS=OFF (#28492)

2026-09-12 09:22:57 +03:00

ggml-sycl

sycl : Fix get mem error (#28227)

2026-09-13 18:31:34 +03:00

ggml-virtgpu

ggml: allow passing alloc dependencies in graph_optimize (#27301)

2026-08-30 11:34:20 +08:00

ggml-vulkan

vulkan: workaround NV queuesubmit driver bug (#28830)

2026-09-13 09:18:19 +03:00

ggml-webgpu

webgpu: align tensor bindings to the type block size (#28382)

2026-09-12 06:40:21 +02:00

ggml-zdnn

llama: add default load-mode auto, which avoids mmap on iGPUs (#26081)

2026-08-11 09:20:46 +03:00

ggml-zendnn

CI: Use LLVM's OpenMP over MSVC_DEBUG_non_redist on Windows (#26678)

2026-08-20 15:42:26 +02:00

CMakeLists.txt

ggml : replace compile definitions with version.h.in (#28364)

2026-09-04 10:28:23 +02:00

ggml-alloc.c

ggml : fix ggml_clamp (#27644)

2026-08-24 10:43:04 +03:00

ggml-backend-dl.cpp

hexagon: enable offloading to Hexagon on Windows on Snapdragon (#19150)

2026-01-29 12:33:21 -08:00

ggml-backend-dl.h

hexagon: enable offloading to Hexagon on Windows on Snapdragon (#19150)

2026-01-29 12:33:21 -08:00

ggml-backend-impl.h

sync : ggml (#28379)

2026-09-04 14:39:19 +03:00

ggml-backend-meta.cpp

ggml-meta: propagate buffer usage and call init on the new tensors (#27586)

2026-08-26 08:27:51 +03:00

ggml-backend-reg.cpp

ggml : don't crash when backend search path can't be read (#28271)

2026-09-04 10:24:06 +03:00

ggml-backend.cpp

ggml: skip 0-sized ids tensor when offloading selected experts (#28739)

2026-09-11 15:17:08 +02:00

ggml-common.h

AVX2: Speed up large batch size prompt processing of IQ models (#27402)

2026-08-31 14:33:50 -04:00

ggml-feats.h

ggml : fix arm builds, unused var (#26991)

2026-08-13 07:57:24 +03:00

ggml-impl.h

ggml : update ggml_prec specification (#26675)

2026-09-08 09:06:24 +03:00

ggml-opt.cpp

fix: free ctx_copy in ggml_opt_free to plug per-training-session leak (#21592)

2026-04-08 17:40:15 +02:00

ggml-quants.c

Add Q2_0 quantization: type definition and CPU backend (#24448)

2026-07-07 12:05:47 -07:00

ggml-quants.h

Add Q2_0 quantization: type definition and CPU backend (#24448)

2026-07-07 12:05:47 -07:00

ggml-threading.cpp

…

ggml-threading.h

remove CMAKE_WINDOWS_EXPORT_ALL_SYMBOLS (#10797)

2024-12-12 19:02:49 +01:00

ggml-version.h.in

ggml : replace compile definitions with version.h.in (#28364)

2026-09-04 10:28:23 +02:00

ggml.c

ggml : update ggml_prec specification (#26675)

2026-09-08 09:06:24 +03:00

ggml.cpp

ggml : Print backtrace on uncaught C++ exceptions (ggml/1232)

2025-06-01 13:43:57 +03:00

gguf.cpp

llama : add missing headers (#28566)

2026-09-08 12:59:53 +02:00