ollama/docs/development.md

40 lines
686 B
Markdown
Raw Normal View History

2023-06-27 13:46:46 -04:00
# Development
- Install cmake or (optionally, required tools for GPUs)
- run `go generate ./...`
- run `go build .`
2023-07-07 12:59:24 -04:00
Install required tools:
2023-06-27 13:46:46 -04:00
- cmake version 3.24 or higher
- go version 1.20 or higher
- gcc version 11.4.0 or higher
2023-06-27 13:46:46 -04:00
```
brew install go cmake gcc
2023-06-27 13:46:46 -04:00
```
Get the required libraries:
```
go generate ./...
```
Then build ollama:
2023-06-27 13:46:46 -04:00
```
go build .
2023-06-27 13:46:46 -04:00
```
2023-07-07 12:59:24 -04:00
Now you can run `ollama`:
2023-06-27 13:46:46 -04:00
```
2023-07-07 12:59:24 -04:00
./ollama
2023-06-27 13:46:46 -04:00
```
## Building on Linux with GPU support
- Install cmake and nvidia-cuda-toolkit
2023-09-20 12:40:42 -04:00
- run `CUDA_VERSION=11 CUDA_PATH=/path/to/libcuda.so CUBLAS_PATH=/path/to/libcublas.so CUDART_PATH=/path/to/libcudart.so CUBLASLT_PATH=/path/to/libcublasLt.so go generate ./...`
- run `go build .`