ollama/llm
Daniel Hiltgen 7555ea44f8 Revamp the dynamic library shim
This switches the default llama.cpp to be CPU based, and builds the GPU variants
as dynamically loaded libraries which we can select at runtime.

This also bumps the ROCm library to version 6 given 5.7 builds don't work
on the latest ROCm library that just shipped.
2023-12-20 14:45:57 -08:00
..
llama.cpp Revamp the dynamic library shim 2023-12-20 14:45:57 -08:00
dynamic_shim.c Revamp the dynamic library shim 2023-12-20 14:45:57 -08:00
dynamic_shim.h Revamp the dynamic library shim 2023-12-20 14:45:57 -08:00
ext_server.go Revamp the dynamic library shim 2023-12-20 14:45:57 -08:00
ggml.go deprecate ggml 2023-12-19 09:05:46 -08:00
gguf.go remove per-model types 2023-12-11 09:40:21 -08:00
llama.go Revamp the dynamic library shim 2023-12-20 14:45:57 -08:00
llm.go Revamp the dynamic library shim 2023-12-20 14:45:57 -08:00
shim_darwin.go Revamp the dynamic library shim 2023-12-20 14:45:57 -08:00
shim_ext_server.go Revamp the dynamic library shim 2023-12-20 14:45:57 -08:00
utils.go partial decode ggml bin for more info 2023-08-10 09:23:10 -07:00