gered/ollama
1
0
Fork 0
Code Issues Pull requests Actions Packages Projects Releases Wiki Activity
ollama/gpu
History
Daniel Hiltgen f457d63400 Implement linux NUMA detection 
If the system has multiple numa nodes, enable numa support in llama.cpp
If we detect numactl in the path, use that, else use the basic "distribute" mode.
2024-08-05 12:56:20 -07:00
..
amd_common.go lint 2024-08-01 17:06:06 -07:00
amd_hip_windows.go lint 2024-08-01 17:06:06 -07:00
amd_linux.go lint 2024-08-01 17:06:06 -07:00
amd_windows.go lint 2024-08-01 17:06:06 -07:00
assets.go lint 2024-08-01 17:06:06 -07:00
cpu_common.go Implement linux NUMA detection 2024-08-05 12:56:20 -07:00
cuda_common.go lint linux 2024-06-04 11:13:30 -07:00
gpu.go lint 2024-08-01 17:06:06 -07:00
gpu_darwin.go lint 2024-08-01 17:06:06 -07:00
gpu_info.h lint 2024-08-01 17:06:06 -07:00
gpu_info_cudart.c Fix bad symbol load detection 2024-06-19 08:39:07 -07:00
gpu_info_cudart.h Refine GPU discovery to bootstrap once 2024-06-14 14:51:40 -07:00
gpu_info_darwin.h gpu: report system free memory instead of 0 (#5521) 2024-07-06 19:35:04 -04:00
gpu_info_darwin.m gpu: report system free memory instead of 0 (#5521) 2024-07-06 19:35:04 -04:00
gpu_info_nvcuda.c Better nvidia GPU discovery logging 2024-07-03 10:50:40 -07:00
gpu_info_nvcuda.h Better nvidia GPU discovery logging 2024-07-03 10:50:40 -07:00
gpu_info_nvml.c Fix bad symbol load detection 2024-06-19 08:39:07 -07:00
gpu_info_nvml.h Reintroduce nvidia nvml library for windows 2024-06-14 14:51:40 -07:00
gpu_info_oneapi.c get real func ptr. 2024-06-19 09:00:51 +08:00
gpu_info_oneapi.h review comments and coverage 2024-06-14 14:55:50 -07:00
gpu_linux.go lint 2024-08-01 17:06:06 -07:00
gpu_oneapi.go support ollama run on Intel GPUs 2024-05-24 11:18:27 +08:00
gpu_test.go lint 2024-06-04 11:13:30 -07:00
gpu_windows.go lint 2024-08-01 17:06:06 -07:00
types.go llm: avoid loading model if system memory is too small (#5637) 2024-07-11 16:42:57 -07:00