Publish docs
This commit is contained in:
parent
7c049388f6
commit
77016417f2
1 changed files with 65 additions and 58 deletions
|
|
@ -348,7 +348,7 @@
|
|||
"id": "cell-8",
|
||||
"metadata": {},
|
||||
"source": [
|
||||
"The [saved historical run](https://great-ai.scoutinscience.com/examples/scibert/validation-results.json) selected a checkpoint with **validation binary F1 of 0.8966** (recorded value: 0.896551724137931). This validation split was also used for early stopping and checkpoint selection, so the number is not an independent test result or macro F1. The historical split seed was not recorded; the seeded code above defines future runs and does not reproduce that split. Its results are saved to `models/validation_results.json` and `models/validation-run.json`.\n",
|
||||
"The [saved historical run](https://great-ai.schmelczer.dev/examples/scibert/validation-results.json) selected a checkpoint with **validation binary F1 of 0.8966** (recorded value: 0.896551724137931). This validation split was also used for early stopping and checkpoint selection, so the number is not an independent test result or macro F1. The historical split seed was not recorded; the seeded code above defines future runs and does not reproduce that split. Its results are saved to `models/validation_results.json` and `models/validation-run.json`.\n",
|
||||
"\n",
|
||||
"To estimate performance after model selection, evaluate once on a separate untouched test split. We make no test-set performance claim here. Next, store the selected model for deployment."
|
||||
]
|
||||
|
|
@ -409,7 +409,7 @@
|
|||
"id": "cell-10",
|
||||
"metadata": {},
|
||||
"source": [
|
||||
"Next: [Part 3](https://great-ai.scoutinscience.com/examples/scibert/deploy)"
|
||||
"Next: [Part 3](https://great-ai.schmelczer.dev/examples/scibert/deploy)"
|
||||
]
|
||||
}
|
||||
],
|
||||
|
|
|
|||
Loading…
Reference in a new issue