gered/ollama
1
0
Fork 0
Code Issues Pull requests Actions Packages Projects Releases Wiki Activity
2672 commits 3 branches 2 tags 9.8 MiB
Commit graph

2672 commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Daniel Hiltgen 83d6d46e29
Merge pull request #4299 from dhiltgen/handle_vram_reporting_lag 
Wait for GPU free memory reporting to converge
 2024-05-09 15:08:56 -07:00
Daniel Hiltgen 354ad9254e Wait for GPU free memory reporting to converge 
The GPU drivers take a while to update their free memory reporting, so we need
to wait until the values converge with what we're expecting before proceeding
to start another runner in order to get an accurate picture.
 2024-05-09 14:56:01 -07:00
Daniel Hiltgen dc18eee39d
Merge pull request #4238 from dhiltgen/gpu_info 
Record more GPU information
 2024-05-09 14:26:58 -07:00
Daniel Hiltgen 8727a9c140 Record more GPU information 
This cleans up the logging for GPU discovery a bit, and can
serve as a foundation to report GPU information in a future UX.
 2024-05-09 14:18:14 -07:00
Daniel Hiltgen d0425f26cf
Merge pull request #4294 from dhiltgen/harden_subprocess_reaping 
Harden subprocess reaping
 2024-05-09 14:02:16 -07:00
Bruce MacDonald cfa84b8470
add done_reason to the api (#4235) 2024-05-09 13:30:14 -07:00
Michael Yang 1580ed4c06
Merge pull request #4295 from ollama/mxyng/fix-list 
routes: skip invalid filepaths
 2024-05-09 11:37:34 -07:00
Michael Yang a7ee84fc31 routes: skip invalid filepaths 2024-05-09 11:23:22 -07:00
Daniel Hiltgen 84ac7ce139 Refine subprocess reaping 2024-05-09 11:21:31 -07:00
tusharhero 788b092c49
docs: add Guix package manager in README. (#4040) 2024-05-09 11:10:24 -07:00
J S 5cde17a096
Add PromptingTools.jl (#2192) 2024-05-09 09:39:05 -07:00
Daniel Hiltgen c3837eb08c
Merge pull request #4289 from dhiltgen/doc_container_workarounds 
Doc container usage and workaround for nvidia errors
 2024-05-09 09:27:29 -07:00
Daniel Hiltgen 8cc0ee2efe Doc container usage and workaround for nvidia errors 2024-05-09 09:26:45 -07:00
Jeffrey Morgan d5eec16d23
use model defaults for num_gqa, rope_frequency_base and rope_frequency_scale (#1983) 2024-05-09 09:06:13 -07:00
Carlos Gamez daa1a032f7
Update langchainjs.md (#2027) 
Updated sample code as per warning notification from the package maintainers
 2024-05-08 20:21:03 -07:00
jmorganca 6042e8bc57 remove bash-comparemodels example 2024-05-08 19:49:45 -07:00
Daniel Hiltgen 920a4b0794 Merge remote-tracking branch 'upstream/main' into pr3702 2024-05-08 16:44:35 -07:00
Daniel Hiltgen ee49844d09
Merge pull request #4153 from dhiltgen/gpu_verbose_response 
Add GPU usage
 2024-05-08 16:39:11 -07:00
Daniel Hiltgen 8a516ac862
Merge pull request #4241 from dhiltgen/fix_tmp_override 
Detect noexec and report a better error
 2024-05-08 15:34:22 -07:00
Daniel Hiltgen bee2f4a3b0 Record GPU usage information 
This records more GPU usage information for eventual UX inclusion.
 2024-05-08 14:45:39 -07:00
Bruce MacDonald cef45feaa4
Add preflight OPTIONS handling and update CORS config (#4086) 
* Add preflight OPTIONS handling and update CORS config

- Implement early return with HTTP 204 (No Content) for OPTIONS requests in allowedHostsMiddleware to optimize preflight handling.

- Extend CORS configuration to explicitly allow 'Authorization' headers and 'OPTIONS' method when OLLAMA_ORIGINS environment variable is set.

* allow auth, content-type, and user-agent headers

* Update routes.go
 2024-05-08 13:14:00 -07:00
Michael Yang 2687f02c96
Merge pull request #4265 from ollama/mxyng/fix-show-llava 
routes: fix show llava models
 2024-05-08 12:51:21 -07:00
Michael Yang b25976aeb8 routes: fix show llava models 2024-05-08 12:43:36 -07:00
Michael Yang 001f167aad
Merge pull request #4261 from ollama/mxyng/fix-tag-case 
types/model: fix tag case
 2024-05-08 11:09:47 -07:00
Michael Yang 486a2c1d94 types/model: fix tag case 2024-05-08 08:47:16 -07:00
Michael Yang 88cf154483
Merge pull request #4244 from ollama/mxyng/skip-if-same 
skip if same quantization
 2024-05-07 19:03:37 -07:00
Bruce MacDonald 8cbd3e7510
skip hidden files in list models handler (#4247) 2024-05-07 19:01:45 -07:00
Michael Yang eeb695261f skip if same quantization 2024-05-07 17:44:19 -07:00
Bruce MacDonald dc9b1111e0 fix invalid destination error message 2024-05-07 17:35:52 -07:00
Tobias Gårdhus 06ac829e70
Fix help string for stop parameter (#2307) 2024-05-07 16:48:35 -07:00
Daniel Hiltgen 72700279e2 Detect noexec and report a better error 
This will bubble up a much more informative error message if noexec
is preventing us from running the subprocess
 2024-05-07 16:46:15 -07:00
boessu 5d3f7fff26
Update langchainpy.md (#4236) 
fixing pip code.
 2024-05-07 16:36:34 -07:00
Eli Bendersky d77c1c5f9d
api: fill up API documentation (#3596) 
* api: fill up API documentation

Followup for #2878

Now that the documentation is more complete, mention it in the README.

Updates #2840

* fix typo/lint

* Update README.md

Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>

---------

Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>
 2024-05-07 16:27:46 -07:00
Giuseppe Lumia 2a5302a1cf
Fix paste of text with line feed characters (#3043) 
Some terminals may send line feed characters when pasting text with
newlines.
 2024-05-07 15:26:07 -07:00
Michael Yang ffbd3d173f
Merge pull request #3715 from ollama/mxyng/modelname-2 
update list handler to use model.Name
 2024-05-07 15:21:39 -07:00
Michael Yang 1e0a669f75
Merge pull request #3682 from ollama/mxyng/quantize-all-the-things 
quantize any fp16/fp32 model
 2024-05-07 15:20:49 -07:00
Bruce MacDonald 527e9be058
fix: store accurate model parameter size (#4058) 
- add test for number formatting
- fix bug where 1B and 1M were not stored correctly
- display 2 decimal points for million param sizes
- display 1 decimal point for billion param sizes
 2024-05-07 14:41:53 -07:00
Renat 34bea2e272
Add macai to list of Web & Desktop integrations (#3881) 2024-05-07 13:31:34 -07:00
Fernando Maclen fe44ae3371
Update README.md (#3884) 2024-05-07 13:17:35 -07:00
Michael Yang adeb40eaf2
Merge pull request #4231 from ollama/mxyng/parser 
types/model: fix parser for empty values
 2024-05-07 10:48:32 -07:00
Michael Yang d7d33e5255
Merge pull request #951 from ollama/mxyng/example-fly 
fly example
 2024-05-07 10:46:24 -07:00
Michael Yang 63bc884e25 types/model: fix parser for empty values 2024-05-07 10:44:43 -07:00
Michael Yang ef4e095d24
Merge pull request #4232 from ollama/revert-4190-fix/golang-ci 
Revert "fix golangci workflow not enable gofmt and goimports"
 2024-05-07 10:39:37 -07:00
Michael Yang 4d4f75a8a8
Revert "fix golangci workflow missing gofmt and goimports (#4190)" 
This reverts commit 04f971c84b.
 2024-05-07 10:35:44 -07:00
Mélony QIN 3f71ba406a
Correct the kubernetes terminology (#3843) 
* add details on kubernetes deployment and separate the testing process

* Update examples/kubernetes/README.md

thanks for suggesting this change, I agree with you and let's make this project better together !

Co-authored-by: JonZeolla <Zeolla@gmail.com>

---------

Co-authored-by: QIN Mélony <MQN1@dsone.3ds.com>
Co-authored-by: JonZeolla <Zeolla@gmail.com>
 2024-05-07 09:53:08 -07:00
Hause Lin 88a67127d8
Update README.md to include ollama-r library (#4012) 
* Update README.md

Add Ollama for R - ollama-r library

* Update README.md

---------

Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>
 2024-05-07 09:52:30 -07:00
Jeffrey Morgan f7dc7dcc64
Update .gitattributes 2024-05-07 09:50:19 -07:00
alwqx 04f971c84b
fix golangci workflow missing gofmt and goimports (#4190) 2024-05-07 09:49:40 -07:00
Michael Yang 548a7df014 update list handler to use model.Name 2024-05-07 09:38:45 -07:00
Michael Yang 70edb9bc4d
Merge pull request #4215 from ollama/mxyng/mem 
llm: add minimum based on layer size
 2024-05-07 09:26:33 -07:00