ollama/docs/development.md
2023-09-20 20:00:41 +01:00

670 B

Development

  • Install cmake or (optionally, required tools for GPUs)
  • run go generate ./...
  • run go build .

Install required tools:

  • cmake version 3.24 or higher
  • go version 1.20 or higher
  • gcc version 11.4.0 or higher
brew install go cmake gcc

Get the required libraries:

go generate ./...

Then build ollama:

go build .

Now you can run ollama:

./ollama

Building on Linux with GPU support

  • Install cmake and nvidia-cuda-toolkit
  • run CUDA_PATH=/path/to/libcuda.so CUBLAS_PATH=/path/to/libcublas.so CUDART_PATH=/path/to/libcudart.so CUBLASLT_PATH=/path/to/libcublasLt.so go generate ./...
  • run go build .