andras/great-ai
andras/great-ai
Watch
1
0
Fork
You've already forked great-ai
 0
Code Issues Pull requests 2 Projects Releases 4 Packages 1 Wiki Activity Actions

Publish docs

Browse source
This commit is contained in:
Andras Schmelczer 2026-10-28 12:57:37 +00:00
commit 77016417f2
1 changed files with 65 additions and 58 deletions
Download patch file Download diff file Expand all files Collapse all files

6
docs/tutorial/train.ipynb
View file

@ -68,7 +68,7 @@
"source": [
"First, we have to get some data. After downloading it [from here](https://github.com/allenai/scibert/tree/master/data/text_classification/mag), we might notice that the dataset is in [JSON Lines](https://jsonlines.org/) format (each line is a separate JSON document). \n",
"\n",
"Let's write a function which takes a single line and returns the sentence and the corresponding label from it. Before returning, the sentence is also [cleaned](https://great-ai.scoutinscience.com/reference/utilities/#great_ai.utilities.clean.clean) to remove any LaTeX, XML, unicode, PDF-extraction artifacts."
"Let's write a function which takes a single line and returns the sentence and the corresponding label from it. Before returning, the sentence is also [cleaned](https://great-ai.schmelczer.dev/reference/utilities/#great_ai.utilities.clean.clean) to remove any LaTeX, XML, unicode, PDF-extraction artifacts."
],
"id": "cell-4"
},
@ -96,7 +96,7 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"Now, we can load the dataset and extract the *training* samples from it. Since we're impatient, we can do it in parallel using the [`simple_parallel_map`](https://great-ai.scoutinscience.com/reference/utilities/#great_ai.utilities.simple_parallel_map) function.\n",
"Now, we can load the dataset and extract the *training* samples from it. Since we're impatient, we can do it in parallel using the [`simple_parallel_map`](https://great-ai.schmelczer.dev/reference/utilities/#great_ai.utilities.simple_parallel_map) function.\n",
"\n",
"> Open files in Python are iterable: in text mode, each iteration returns the next line."
],
@ -242,7 +242,7 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"### [Let's continue by finishing the deployment in the next notebook.](https://great-ai.scoutinscience.com/tutorial/deploy)"
"### [Let's continue by finishing the deployment in the next notebook.](https://great-ai.schmelczer.dev/tutorial/deploy)"
],
"id": "cell-18"
}