Commit graph

29 commits

Author SHA1 Message Date
Patrick Devine 4a28a2f093
add modelpaths (#96) 2023-07-17 22:44:21 -07:00
Patrick Devine 2fb52261ad
basic distribution w/ push/pull (#78)
* basic distribution w/ push/pull

* add the parser

* add create, pull, and push

* changes to the parser, FROM line, and fix commands

* mkdirp new manifest directories

* make `blobs` directory if it does not exist

* fix go warnings

* add progressbar for model pulls

* move model struct

---------

Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>
2023-07-16 17:02:22 -07:00
Michael Yang 743e957d88 use filepath for os compat 2023-07-14 17:27:14 -07:00
Michael Yang 1775647f76 continue conversation
feed responses back into the llm
2023-07-13 17:13:00 -07:00
Michael Yang 05e08d2310 return more info in generate response 2023-07-13 09:37:32 -07:00
Michael Yang 0944b01e7d pull fixes 2023-07-12 09:55:07 -07:00
Michael Yang e243329e2e check api status 2023-07-11 13:42:05 -07:00
Michael Yang edba935d67 return error in generate response 2023-07-10 13:30:10 -07:00
Bruce MacDonald 07a4c1e3fb
take all args as one prompt 2023-07-10 06:05:09 -04:00
Jeffrey Morgan 553c884474 allow specifying server host and port with OLLAMA_HOST and OLLAMA_PORT 2023-07-07 16:48:13 -04:00
Bruce MacDonald 4d8b0414f7 take all args as one prompt
- parse all run arguments into one prompt
- do not echo prompt back on one-shot
- example of summarizing a document
2023-07-07 16:14:58 -04:00
Michael Yang 0fea50cd42
Merge pull request #54 from jmorganca/empty-line
no prompt on empty line
2023-07-07 11:29:39 -07:00
Bruce MacDonald c316893545 fix resume download 2023-07-07 14:26:58 -04:00
Michael Yang 053739d19f no prompt on empty line 2023-07-07 11:01:44 -07:00
Bruce MacDonald ad84138469 do not pull when local is available 2023-07-07 10:22:37 -04:00
Michael Yang b0618a466e generate progress 2023-07-06 17:07:40 -07:00
Michael Yang b0e63bfb4c simplify api client 2023-07-06 17:07:40 -07:00
Michael Yang c4b9e84945 progress 2023-07-06 17:07:40 -07:00
Michael Yang 3d6009aae3 run prompts 2023-07-06 17:07:40 -07:00
Bruce MacDonald 350aec772b clean up unessesary comments 2023-07-06 16:34:44 -04:00
Bruce MacDonald c9f45abef3 resumable downloads 2023-07-06 16:34:44 -04:00
Bruce MacDonald 7cf5905063 display pull progress 2023-07-06 16:34:44 -04:00
Michael Yang 5079282120 tcp socket 2023-07-06 16:34:44 -04:00
Bruce MacDonald a6494f8211 pull models 2023-07-06 16:34:44 -04:00
Bruce MacDonald 926ffa7f8c refactor cmd 2023-07-06 16:34:44 -04:00
Jeffrey Morgan fd962a36e5 client updates 2023-07-06 16:34:44 -04:00
Jeffrey Morgan 9164981d72 move prompt templates out of python bindings 2023-07-06 16:34:44 -04:00
Jeffrey Morgan 6093a88c1a add llama.cpp go bindings 2023-07-06 16:34:44 -04:00
Jeffrey Morgan 76cb60d496 wip go engine
Co-authored-by: Patrick Devine <pdevine@sonic.net>
2023-07-06 16:34:44 -04:00