Commit Graph

9 Commits

Author SHA1 Message Date
Meng Zhang
2dcb5599b3 feat(experimental): update tabby.py to use debug_options.raw_prompt 2023-10-21 17:27:43 -07:00
Meng Zhang
1d31b33ccc chore(eval): move tabby-python-client to eval dir 2023-10-21 16:10:36 -07:00
Meng Zhang
8fca850037
feat(eval): add debug_options.raw_prompt to tabby api for evaluation purpose (#605)
* update eval

* feat: re-purpose  as raw input to LLM

* move prompt to Debug options

* Update crates/tabby/src/serve/completions.rs
2023-10-21 20:47:44 +00:00
Meng Zhang
257dba64a5
feat(experimental): use modal for easier evaluation. (#594) 2023-10-18 23:33:27 -07:00
Meng Zhang
2ad0b69786
feat(experimental): visualize with streamlit (#290) 2023-07-11 15:29:45 +08:00
Meng Zhang
7ca416aa13 feat(experimental): add script to run eval in cli 2023-07-11 10:34:41 +08:00
Meng Zhang
b135022dc0 feat: add script to run eval in cli 2023-07-11 10:31:50 +08:00
Meng Zhang
bed723fced
feat: add python eval script (#266)
* feat: add python eval script

* update

* add local script

* move eval script

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* add README
2023-07-11 09:53:04 +08:00
Meng Zhang
848aff7d1f chore: add experimental eval setup 2023-06-24 09:24:02 -07:00