Daniel Hiltgen
|
434dfe30c5
|
Reintroduce nvidia nvml library for windows
This library will give us the most reliable free VRAM reporting on windows
to enable concurrent model scheduling.
|
2024-06-14 14:51:40 -07:00 |
|
|
Daniel Hiltgen
|
43ed358f9a
|
Refine GPU discovery to bootstrap once
Now that we call the GPU discovery routines many times to
update memory, this splits initial discovery from free memory
updating.
|
2024-06-14 14:51:40 -07:00 |
|
|
Daniel Hiltgen
|
8727a9c140
|
Record more GPU information
This cleans up the logging for GPU discovery a bit, and can
serve as a foundation to report GPU information in a future UX.
|
2024-05-09 14:18:14 -07:00 |
|
|
Daniel Hiltgen
|
089daaeabc
|
Add CUDA Driver API for GPU discovery
We're seeing some corner cases with cudart which might be resolved by
switching to the driver API which comes bundled with the driver package
|
2024-04-30 18:00:45 -07:00 |
|