grailfinder/jane-index
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Update readme.md

Browse Source
This commit is contained in:
grailfinder 2023-07-26 08:21:28 +00:00
parent 744ae53344
commit e6c58e75b7
1 changed files with 7 additions and 5 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

12
readme.md
View File

@ -16,7 +16,9 @@ judge scores each generation as success or failure, modifies initial json file t
where 1 is a perfect score and 0 is a complete failure. where 1 is a perfect score and 0 is a complete failure.
### Index example in json file ### Index example in json file
scores of answers `TheBloke_Nous-Hermes-Llama2-GTPQ` inside of file `TheBloke_Nous-Hermes-Llama2-GTPQ.json` by judge `MetaIX_GPT4-X-Alpasta-30b-4bit` scores of answers `TheBloke_Nous-Hermes-Llama2-GTPQ`
inside of file `TheBloke_Nous-Hermes-Llama2-GTPQ.json`
by judge `MetaIX_GPT4-X-Alpasta-30b-4bit`
``` ```
"MetaIX_GPT4-X-Alpasta-30b-4bit_success_rate_full": 0.6979166666666666, "MetaIX_GPT4-X-Alpasta-30b-4bit_success_rate_full": 0.6979166666666666,
"MetaIX_GPT4-X-Alpasta-30b-4bit_success_rate_Asterism": 0.83, "MetaIX_GPT4-X-Alpasta-30b-4bit_success_rate_Asterism": 0.83,
@ -38,8 +40,8 @@ scores of answers `TheBloke_Nous-Hermes-Llama2-GTPQ` inside of file `TheBloke_No
``` ```
### Run human eval gui ### Run human eval gui
`./human_eval_gui.py TheBloke_Llama-2-13B-GPTQ.json` `./human_eval_gui.py TheBloke_Llama-2-13B-GPTQ.json`
screen shall appear screen shall appear
![gui_screen](./human_eval_example.png) ![gui_screen](./human_eval_example.png)
after you finish all objects score will appear in the text box, after you finish all objects score will appear in the text box,
at this point you may quit the gui and check scores in json file. at this point you may quit the gui and check scores in json file.