grailfinder/jane-index
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Update readme.md

Browse Source
This commit is contained in:
grailfinder 2023-07-26 08:21:28 +00:00
parent 744ae53344
commit e6c58e75b7
1 changed files with 7 additions and 5 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

12
readme.md
View File

@ -16,7 +16,9 @@ judge scores each generation as success or failure, modifies initial json file t
where 1 is a perfect score and 0 is a complete failure.
### Index example in json file
scores of answers `TheBloke_Nous-Hermes-Llama2-GTPQ` inside of file `TheBloke_Nous-Hermes-Llama2-GTPQ.json` by judge `MetaIX_GPT4-X-Alpasta-30b-4bit`
scores of answers `TheBloke_Nous-Hermes-Llama2-GTPQ`
inside of file `TheBloke_Nous-Hermes-Llama2-GTPQ.json`
by judge `MetaIX_GPT4-X-Alpasta-30b-4bit`
```
"MetaIX_GPT4-X-Alpasta-30b-4bit_success_rate_full": 0.6979166666666666,
"MetaIX_GPT4-X-Alpasta-30b-4bit_success_rate_Asterism": 0.83,
@ -38,8 +40,8 @@ scores of answers `TheBloke_Nous-Hermes-Llama2-GTPQ` inside of file `TheBloke_No
```
### Run human eval gui
`./human_eval_gui.py TheBloke_Llama-2-13B-GPTQ.json`
screen shall appear
![gui_screen](./human_eval_example.png)
after you finish all objects score will appear in the text box,
`./human_eval_gui.py TheBloke_Llama-2-13B-GPTQ.json`
screen shall appear
![gui_screen](./human_eval_example.png)
after you finish all objects score will appear in the text box,
at this point you may quit the gui and check scores in json file.