Bruce MacDonald
|
e9a9580bdd
|
do not regenerate embeddings
- re-use previously evaluated embeddings when possible
- change embeddings digest identifier to be based on model name and embedded file path
|
2023-08-14 10:34:17 -03:00 |
|
|
Patrick Devine
|
d9cf18e28d
|
add maximum retries when pushing (#334)
|
2023-08-11 15:41:55 -07:00 |
|
|
Michael Yang
|
6517bcc53c
|
Merge pull request #290 from jmorganca/add-adapter-layers
implement loading ggml lora adapters through the modelfile
|
2023-08-10 17:23:01 -07:00 |
|
|
Michael Yang
|
6a6828bddf
|
Merge pull request #167 from jmorganca/decode-ggml
partial decode ggml bin for more info
|
2023-08-10 17:22:40 -07:00 |
|
|
Patrick Devine
|
be989d89d1
|
Token auth (#314)
|
2023-08-10 11:34:25 -07:00 |
|
|
Michael Yang
|
6de5d032e1
|
implement loading ggml lora adapters through the modelfile
|
2023-08-10 09:23:39 -07:00 |
|
|
Michael Yang
|
fccf8d179f
|
partial decode ggml bin for more info
|
2023-08-10 09:23:10 -07:00 |
|
|
Bruce MacDonald
|
984c9c628c
|
fix embeddings invalid values
|
2023-08-09 16:50:53 -04:00 |
|
|
Bruce MacDonald
|
ac971c56d1
|
Update images.go
|
2023-08-09 11:31:54 -04:00 |
|
|
Bruce MacDonald
|
868e3b31c7
|
allow for concurrent pulls of the same files
|
2023-08-09 11:31:54 -04:00 |
|
|
Bruce MacDonald
|
1bee2347be
|
pr feedback
- defer closing llm on embedding
- do not override licenses
- remove debugging print line
- reformat model file docs
|
2023-08-08 17:01:37 -04:00 |
|
|
Bruce MacDonald
|
884d78ceb3
|
allow embedding from model binary
|
2023-08-08 14:38:57 -04:00 |
|
|
Bruce MacDonald
|
21ddcaa1f1
|
pr comments
- default to embeddings enabled
- move embedding logic for loaded model to request
- allow embedding full directory
- close llm on reload
|
2023-08-08 13:49:37 -04:00 |
|
|
Bruce MacDonald
|
a6f6d18f83
|
embed text document in modelfile
|
2023-08-08 11:27:17 -04:00 |
|
|
Jeffrey Morgan
|
8713ac23a8
|
allow overriding template and system in /api/generate
Fixes #297
Fixes #296
|
2023-08-08 00:55:34 -04:00 |
|
|
Michael Yang
|
a71ff3f6a2
|
use a pipe to push to registry with progress
switch to a monolithic upload instead of a chunk upload through a pipe
to report progress
|
2023-08-03 10:37:13 -07:00 |
|
|
Bruce MacDonald
|
1c5a8770ee
|
read runner parameter options from map
- read runner options from map to see what was specified explicitly and overwrite zero values
|
2023-08-01 13:38:19 -04:00 |
|
|
Bruce MacDonald
|
daa0d1de7a
|
allow specifying zero values in modelfile
|
2023-08-01 13:37:50 -04:00 |
|
|
Jeffrey Morgan
|
528bafa585
|
cache loaded model
|
2023-08-01 11:24:18 -04:00 |
|
|
Michael Yang
|
872011630a
|
fix license
|
2023-07-31 21:46:48 -07:00 |
|
|
Michael Yang
|
203fdbc4b8
|
check err
|
2023-07-31 21:46:48 -07:00 |
|
|
Michael Yang
|
70e0ab6b3d
|
remove unnecessary fmt.Sprintf
|
2023-07-31 21:46:47 -07:00 |
|
|
Jeffrey Morgan
|
9968153729
|
fix Go warnings
|
2023-07-31 21:37:40 -04:00 |
|
|
Michael Yang
|
eadee46840
|
Merge pull request #236 from jmorganca/check-os-walk
check os.Walk err
|
2023-07-28 14:14:21 -07:00 |
|
|
Michael Yang
|
bd58528fbd
|
check os.Walk err
|
2023-07-28 12:15:31 -07:00 |
|
|
Michael Yang
|
c5e447a359
|
remove io/ioutil import
ioutil is deprecated
|
2023-07-28 12:06:03 -07:00 |
|
|
Bruce MacDonald
|
f5cbcb08e6
|
specify stop params separately
|
2023-07-28 11:29:00 -04:00 |
|
|
Bruce MacDonald
|
184ad8f057
|
allow specifying stop conditions in modelfile
|
2023-07-28 11:02:04 -04:00 |
|
|
Bruce MacDonald
|
1ac38ec89c
|
improve modelfile docs
|
2023-07-27 15:13:04 -04:00 |
|
|
Bruce MacDonald
|
4c1caa3733
|
download models when creating from modelfile
|
2023-07-25 14:25:13 -04:00 |
|
|
Bruce MacDonald
|
07ed69bc37
|
remove reduandant err var
|
2023-07-25 10:30:14 -04:00 |
|
|
Bruce MacDonald
|
536028c35a
|
better error message when model not found on pull
|
2023-07-24 17:48:17 -04:00 |
|
|
Bruce MacDonald
|
abf614804b
|
remove file on digest mismatch
|
2023-07-24 21:59:12 +02:00 |
|
|
Bruce MacDonald
|
a0dbbb23c4
|
truncate file size on resume
|
2023-07-24 21:58:32 +02:00 |
|
|
Bruce MacDonald
|
0fd6278446
|
do not panic server if file cannot be opened
|
2023-07-24 15:24:34 -04:00 |
|
|
Bruce MacDonald
|
abfc73d31e
|
make response errors unique for error trace
|
2023-07-24 15:04:21 -04:00 |
|
|
Bruce MacDonald
|
5a5ca8e7ff
|
remove file on digest mismatch
|
2023-07-24 14:53:01 -04:00 |
|
|
Bruce MacDonald
|
fdbef6c95e
|
truncate file size on resume
|
2023-07-24 14:36:19 -04:00 |
|
|
Patrick Devine
|
4cb42ca55e
|
add copy command (#191)
|
2023-07-24 11:27:28 -04:00 |
|
|
Patrick Devine
|
88c55199f8
|
change push to chunked uploads from monolithic (#179)
|
2023-07-22 17:31:26 -07:00 |
|
|
Patrick Devine
|
6d6b0d3321
|
change error handler behavior and fix error when a model isn't found (#173)
|
2023-07-21 23:02:12 -07:00 |
|
|
Michael Yang
|
20a5d99f77
|
fix vars.First
|
2023-07-21 20:45:32 -07:00 |
|
|
Patrick Devine
|
b8421dce3d
|
get the proper path for blobs to delete (#168)
|
2023-07-21 17:30:40 -07:00 |
|
|
Patrick Devine
|
9f6e97865c
|
allow pushing/pulling to insecure registries (#157)
|
2023-07-21 15:42:19 -07:00 |
|
|
Patrick Devine
|
e7a393de54
|
add rm command for models (#151)
|
2023-07-20 16:09:23 -07:00 |
|
|
Michael Yang
|
6cea2061ec
|
windows: fix model pulling
|
2023-07-20 12:35:04 -07:00 |
|
|
Michael Yang
|
2832801c2a
|
Merge pull request #91 from jmorganca/fix-stream-errors
fix stream errors
|
2023-07-20 12:21:59 -07:00 |
|
|
Michael Yang
|
992892866b
|
Merge pull request #145 from jmorganca/verify-digest
verify blob digest
|
2023-07-20 12:14:21 -07:00 |
|
|
Michael Yang
|
1f27d7f1b8
|
fix stream errors
|
2023-07-20 12:12:08 -07:00 |
|
|
Michael Yang
|
bf198c3918
|
verify blob digest
|
2023-07-20 11:53:57 -07:00 |
|