ollama

gered/ollama

Fork 0

Commit graph

Author	SHA1	Message	Date
Daniel Hiltgen	3c49c3ab0d	Harden GPU mgmt library lookup When there are multiple management libraries installed on a system not every one will be compatible with the current driver. This change improves our management library algorithm to build up a set of discovered libraries based on glob patterns, and then try all of them until we're able to load one without error.	2024-01-10 15:06:41 -08:00
Daniel Hiltgen	35934b2e05	Adapted rocm support to cgo based llama.cpp	2023-12-19 09:05:46 -08:00

Author

SHA1

Message

Date

Daniel Hiltgen

3c49c3ab0d

Harden GPU mgmt library lookup

When there are multiple management libraries installed on a system
not every one will be compatible with the current driver.  This change
improves our management library algorithm to build up a set of discovered
libraries based on glob patterns, and then try all of them until we're able to
load one without error.

2024-01-10 15:06:41 -08:00

Daniel Hiltgen

35934b2e05

Adapted rocm support to cgo based llama.cpp

2023-12-19 09:05:46 -08:00

2 commits