{ "cells": [ { "cell_type": "markdown", "id": "cell-0", "metadata": {}, "source": [ "# Explore data and feasibility of approach\n", "\n", "The original annotations are proprietary. This notebook defaults to 60\n", "clearly synthetic sentences with two simulated annotators so the entire\n", "training/deployment workflow can run locally without credentials.\n", "These data and their scores demonstrate execution only.\n", "\n", "To use your own JSON annotation files (each maps sentences to binary\n", "labels), set `GREAT_AI_ANNOTATIONS_DIR` to their directory before starting\n", "Jupyter. No private data or cloud configuration is included in this repo." ] }, { "cell_type": "markdown", "id": "6da6bb8a", "metadata": {}, "source": [ "## Local setup\n", "\n", "Use Python 3.12 or 3.13 and install this checkout with `uv pip install --editable '.[notebooks]'`.\n", "See **Run notebooks locally** in the repository README for the kernel, execution order,\n", "and full-data options. Run related notebooks from the same working directory\n", "to share the default `.cache/` model store and `tracing_database.json` database.\n" ] }, { "cell_type": "code", "execution_count": 1, "id": "cell-3", "metadata": { "execution": { "iopub.execute_input": "2026-10-28T22:47:59.684612Z", "iopub.status.busy": "2026-10-28T22:47:59.684455Z", "iopub.status.idle": "2026-10-28T22:47:59.694166Z", "shell.execute_reply": "2026-10-28T22:47:59.693485Z" } }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "Using synthetic demo annotations; scores are not research results.\n" ] } ], "source": [ "import json\n", "import os\n", "from pathlib import Path\n", "\n", "from docs.notebook_support import demo_annotations\n", "\n", "annotation_dir = os.environ.get(\"GREAT_AI_ANNOTATIONS_DIR\")\n", "if annotation_dir:\n", " annotations = [\n", " json.loads(p.read_text(encoding=\"utf-8\"))\n", " for p in sorted(Path(annotation_dir).expanduser().glob(\"*.json\"))\n", " ]\n", " if not annotations:\n", " raise ValueError(f\"No annotation JSON files found in {annotation_dir}\")\n", "else:\n", " annotations = demo_annotations()\n", " print(\"Using synthetic demo annotations; scores are not research results.\")\n", "\n", "evaluations = {\n", " sentence: [\n", " annotation[sentence] for annotation in annotations if sentence in annotation\n", " ]\n", " for sentence in sorted(\n", " {sentence for annotation in annotations for sentence in annotation}\n", " )\n", "}\n", "X = list(evaluations)\n", "y = [int(sum(e) > 0) for e in evaluations.values()]" ] }, { "cell_type": "markdown", "id": "cell-4", "metadata": {}, "source": [ "Save the processed dataset using local versioned storage for the training notebook." ] }, { "cell_type": "code", "execution_count": 2, "id": "cell-5", "metadata": { "execution": { "iopub.execute_input": "2026-10-28T22:47:59.695771Z", "iopub.status.busy": "2026-10-28T22:47:59.695589Z", "iopub.status.idle": "2026-10-28T22:48:00.795320Z", "shell.execute_reply": "2026-10-28T22:48:00.795003Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "\u001b[38;5;39mFetching cached versions of summary-train-dataset-small\u001b[0m\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "\u001b[38;5;39mFetching cached versions of summary-train-dataset-small\u001b[0m\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "\u001b[38;5;39mFetching cached versions of summary-train-dataset-small\u001b[0m\n" ] } ], "source": [ "from great_ai.large_file import LargeFileLocal\n", "\n", "with LargeFileLocal(\"summary-train-dataset-small\", \"w\", encoding=\"utf-8\") as f:\n", " json.dump((X, y), f)" ] }, { "cell_type": "markdown", "id": "cell-6", "metadata": {}, "source": [ "Filter out sentences which don't have enough annotations." ] }, { "cell_type": "code", "execution_count": 3, "id": "cell-7", "metadata": { "execution": { "iopub.execute_input": "2026-10-28T22:48:00.796420Z", "iopub.status.busy": "2026-10-28T22:48:00.796263Z", "iopub.status.idle": "2026-10-28T22:48:00.798035Z", "shell.execute_reply": "2026-10-28T22:48:00.797684Z" } }, "outputs": [], "source": [ "y1 = [e[0] for e in evaluations.values() if len(e) == 2]\n", "y2 = [e[1] for e in evaluations.values() if len(e) == 2]" ] }, { "cell_type": "markdown", "id": "cell-8", "metadata": {}, "source": [ "Calculate [Cohen's kappa](https://en.wikipedia.org/wiki/Cohen%27s_kappa).\n", "\n", "It's a bit low but the task itself is pretty subjective so it's not all that surprising." ] }, { "cell_type": "code", "execution_count": 4, "id": "cell-9", "metadata": { "execution": { "iopub.execute_input": "2026-10-28T22:48:00.798711Z", "iopub.status.busy": "2026-10-28T22:48:00.798654Z", "iopub.status.idle": "2026-10-28T22:48:00.806309Z", "shell.execute_reply": "2026-10-28T22:48:00.806045Z" } }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "0.8\n" ] } ], "source": [ "import sklearn.metrics\n", "\n", "if y1:\n", " print(sklearn.metrics.cohen_kappa_score(y1, y2))\n", "else:\n", " print(\"No sentences have exactly two annotations; kappa is unavailable.\")" ] }, { "cell_type": "markdown", "id": "cell-10", "metadata": {}, "source": [ "Can we train anything on this data?\n", "\n", "Let's try with a trivial SVM." ] }, { "cell_type": "code", "execution_count": 5, "id": "cell-11", "metadata": { "execution": { "iopub.execute_input": "2026-10-28T22:48:00.807045Z", "iopub.status.busy": "2026-10-28T22:48:00.806983Z", "iopub.status.idle": "2026-10-28T22:48:00.808468Z", "shell.execute_reply": "2026-10-28T22:48:00.808132Z" } }, "outputs": [], "source": [ "X = [s for s in evaluations.keys()]\n", "y = [int(sum(e) > 0) for e in evaluations.values()]" ] }, { "cell_type": "code", "execution_count": 6, "id": "cell-12", "metadata": { "execution": { "iopub.execute_input": "2026-10-28T22:48:00.809082Z", "iopub.status.busy": "2026-10-28T22:48:00.809029Z", "iopub.status.idle": "2026-10-28T22:48:00.861903Z", "shell.execute_reply": "2026-10-28T22:48:00.861397Z" } }, "outputs": [ { "data": { "text/plain": [ "array([0.41666667, 0.25 , 0.16666667, 0.41666667, 0.5 ])" ] }, "execution_count": 6, "metadata": {}, "output_type": "execute_result" } ], "source": [ "from sklearn.model_selection import train_test_split\n", "from sklearn.svm import LinearSVC\n", "from sklearn.pipeline import Pipeline\n", "from sklearn.feature_extraction.text import TfidfVectorizer\n", "from sklearn.model_selection import cross_val_score\n", "\n", "model = Pipeline(\n", " steps=[\n", " (\"vectorizer\", TfidfVectorizer(sublinear_tf=True, min_df=3, max_df=0.3)),\n", " (\"classifier\", LinearSVC(random_state=42)),\n", " ]\n", ") # baseline model\n", "\n", "cross_val_score(model, X, y, cv=5)" ] }, { "cell_type": "markdown", "id": "cell-13", "metadata": {}, "source": [ "The cross-validation shows promising accuracies. But accuracy isn't everything, therefore, we should investigate the accuracy metrics." ] }, { "cell_type": "code", "execution_count": 7, "id": "cell-14", "metadata": { "execution": { "iopub.execute_input": "2026-10-28T22:48:00.862626Z", "iopub.status.busy": "2026-10-28T22:48:00.862564Z", "iopub.status.idle": "2026-10-28T22:48:00.873305Z", "shell.execute_reply": "2026-10-28T22:48:00.872879Z" } }, "outputs": [ { "data": { "text/html": [ "
Pipeline(steps=[('vectorizer',\n",
       "                 TfidfVectorizer(max_df=0.3, min_df=3, sublinear_tf=True)),\n",
       "                ('classifier', LinearSVC(random_state=42))])
In a Jupyter environment, please rerun this cell to show the HTML representation or trust the notebook.
On GitHub, the HTML representation is unable to render, please try loading this page with nbviewer.org.
" ], "text/plain": [ "Pipeline(steps=[('vectorizer',\n", " TfidfVectorizer(max_df=0.3, min_df=3, sublinear_tf=True)),\n", " ('classifier', LinearSVC(random_state=42))])" ] }, "execution_count": 7, "metadata": {}, "output_type": "execute_result" } ], "source": [ "X_train, X_test, y_train, y_test = train_test_split(\n", " X, y, test_size=0.2, random_state=42, stratify=y\n", ")\n", "model.fit(X_train, y_train)" ] }, { "cell_type": "code", "execution_count": 8, "id": "cell-15", "metadata": { "execution": { "iopub.execute_input": "2026-10-28T22:48:00.874007Z", "iopub.status.busy": "2026-10-28T22:48:00.873948Z", "iopub.status.idle": "2026-10-28T22:48:00.920993Z", "shell.execute_reply": "2026-10-28T22:48:00.920537Z" } }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ " precision recall f1-score support\n", "\n", " False 0.00 0.00 0.00 5\n", " True 0.58 1.00 0.74 7\n", "\n", " accuracy 0.58 12\n", " macro avg 0.29 0.50 0.37 12\n", "weighted avg 0.34 0.58 0.43 12\n", "\n" ] }, { "data": { "image/png": "iVBORw0KGgoAAAANSUhEUgAAAgQAAAHMCAYAAACqUbDSAAAAOnRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjExLjIsIGh0dHBzOi8vbWF0cGxvdGxpYi5vcmcvgI3uAAAAAAlwSFlzAAAPYQAAD2EBqD+naQAAMilJREFUeJzt3QucTeX++PHvmitmzBjjzrjkMrmekFQokaRSSo5LKJVOvaIkuv2Ukt9/TlJRLsURqX5CinJEJRyV0E3JiVQY9/sME+ay1//1PJrd7Lmw915rX9bM531e62X2mvWs/ZjmWN/9/T4XwzRNUwAAQJkWEeoOAACA0CMgAAAABAQAAICAAAAAEBAAAAACAgAAoDGoEAAAEBAAAAACAgAAICJR/BQAAHC2e++9V44fP17kfIcOHWT48OFe3YOAAAAAh+vRo4ecOnXK/Xr//v3y0EMP6YDAWwZ7GQAAULo899xz8vTTT8vevXslKSnJqzYEBAAAlDKpqalyySWXyJtvvul1G0oGXnK5XDrSqlixohiG4e9/IwBAiKjNfU+cOCG1atWSiIjAzbo/ffq0ZGdn29Lfws+b2NhYfZzL2rVrZdu2bfKvf/3Lp/cjQ+Cl3bt3S0pKik8/XABA+ElPT5c6deoELBhoUC9e9h/Ms3yv+Ph4OXnypMe5sWPH6lLAudxxxx3y1Vdfyc8//+zT+5Eh8JLKDCgd5TqJkmiffsiAU0QtqxHqLgABk/tHtqy+dbb73/NAyM7O1sHAzm/qS0JF/7MQmSdcUq/tDh28JCQkuM+fLzugMiALFy6UcePG+fyeBAReyk/bqGAgyiAgQOkUHRcT6i4AAReMsm98RUMf/nLJ2bYqGCgYEJzPvHnzJDc3VwYPHuzzexIQAABgszzTJXmmtfb+mDVrlvTq1UuqVq3qc1v2MgAAwGYuMS0fvtq8ebNs2LBBhg4d6lefCQgAACgFYmJiZP78+dK1a1e/2lMyAADAZi79P2vtfdWkSRN9+IuAAAAAm+WZpj6stA82SgYAAIAMAQAAdvN3YGDB9sFGyQAAAJupB3qewwICSgYAAIAMAQAAdqNkAAAAhFkGAADAkRhUCACAzdSyQtYWJgo+AgIAAGyWZ3GWgZW2/iIgAADAZmqnQ2u7HUrQMe0QAACQIQAAwG6MIQAAAOISQ/LEsBBQ+N/WX5QMAAAAJQMAAOzmMs8eVtoHG7MMAACwWZ7FkoGVtv6iZAAAAMgQAABgNydmCCgZAABgM5dp6MNK+2AjIAAAwGZOzBAwhgAAAJAhAADAbnkSoQ//2wcfJQMAAGxmWhxDoNoHGyUDAABAhgAAALs5cVAhJQMAAGyWZ0bow//2EnSUDAAAABkCAADsprYvdln4zO2S4KcIKBkAAGAzJ44hoGQAAADIEAAAEH6DCikZAABQSsYQGJbaBxtjCAAAsJnL4tLFoRhUyBgCAABAhgAAALsxhgAAAIgqGThtHQJKBgAAgJIBAAB2yzMNfVhpH2zMMgAAwGZ5FmcZ5FEyAAAAocAYAgAAbOYyIywfvjp+/Lj8z//8j1xyySXSsWNHmTVrlk/tKRkAAODwkkFmZqZ06NBBqlSpIhMmTJDExESZMWOG1KlTR7p37+7VPQgIAABwuPHjx8vRo0dl/fr1Eh8fr89Nnz5d8vLyvL4HAQEAADZzWZwpoNr74p133pF+/fq5g4F8kZGRXt+DMQQAAARoYSIrR34poOBx5syZIu916tQpSU9PlwYNGsg999wjLVu2lG7dusns2bPF9GHXRAICAAACtHSxlUNJSUnR4wHyj7S0tCLvlZ2drf9UAwqbNWsmb7/9ttx2220yfPhwmThxotd9pmQAAECYUp/8ExIS3K9jY2OLXFOxYkV9Xg0eHDFihD7XqlUr2bx5s8ycOVNGjx7t1XsREAAAYDOXGPqw0l5RwUDBgKA4ERER0q5dO6lUqZLHefU6KyvL6/ekZAAAQJiWDLw1bNgwee+992TLli369e7du2XOnDlyww03eH0PMgQAADhc3759ZceOHXLZZZdJXFycHDt2TP7+97/LCy+84PU9CAgAAAi7hYl8b/voo4/KQw89JAcPHpTq1atLdHS0T+0JCAAAsJnLNPRhpb0/YmJi9OqE/mAMAQAAIEMAAIDdXBZLBvkLEwUTJQMAAGzm746FBdsHGyUDAABAhgAAALvliaEPK+2DjZIBAAA2c2LJgIAAAACb5Vn8lK/aBxtjCAAAABkCAADsRskAAACIPxsUFWSlrb8oGQAAAEoGAADYzRRDXBYGFar2wcYsAwAAbEbJAAAAOBIZAgAASsn2x1YQEAAAYLM8i7sdWmnrL2YZAAAAMgQAANiNkgEAABCXROjD74AiBAl8xhAAAGCzPNPQh5X2wcYYAgAAQIYAAAC7MYYAAACIaUboHQ+ttA82SgYAAICSAQAAdssTQx9W2gcbswwAALCZy7S2/LBqH2yODghOnz4tsbGxYhjBj6Tgm7qNT8vdY/bKBc1Py/EjUfLhnGRZMS/Zcht/7gvYLW9xlrheP+F5MsaQ6Hern7Oda8MZcc09Ieb+PDFqRUnEHfES0SbW52sAxwcEOTk5kpeXV+S8Nw/5w4cPS9WqVeW7776Tiy66KIC9hFUJlXPl+UW/yoaVFeWxvhdIk7+dkodeSJfcbENWLqrsdxt/7gsExGlTJDlSol4qEIye53OKa0u25D1xVCKGVJTIK8uJ65NTkvfoUTGmVRGjcbTX1yA8uSwOKrTS1pGDCnv06CFxcXFSqVIlj2PXrl2h7BZs1mPAEYmIMOWlUSmy+9dy8tl7SbJ8XmXpP+KgpTb+3BcImAgRo1LEX0fiuf95db2TJUarGIm8LV6MOlESOaSiGI2iJW/+SZ+uQXhyiWH5KHOzDPr3769T/wWPevXqyZkzZ/TXKovgK9M0LX0f9mp5aZb8sC5eXHl//YJ/u6aipDQ8I4nJOX638ee+QMDsyZOc/gclZ9BByR1/TMy9uee83NyULUZbz9S/cXGsmD9k+3QNUGoCgpIkJyfrbIHKINSqVUtGjx4t2dkl/58gNzdXhg8frtuVL19e2rdvL2vXrnV/X2Udbr75ZqlQoYJUrFhROnfuLJs2bQrS36ZsS66eI8cOeVan8l8nV8/1u40/9wUCooIhEXfFS9SEyhI1JknklCm5/zgs5uGiJVHFzDVFMlxiJBX6J1i9PuLy+hqE/9LFeRaOMhcQuFwuj+xAfkbg5MmT+rXKFKxYsUKWLl0qEydOLPE+M2fOlA8//FDWr18vWVlZMn36dFm0aJH+nnrdpUsXadiwoezZs0cOHTokV199tXTv3l2OHz9e7P3U+2ZmZnoc8JOh/jt7nsrLPfvLbkSY/rfx575AAETeGCeRfeLFSIkSIzVaIscmicQa4no/q/gGZgn/AkcW+J431yDsxxC4LBxlLiCYP3++x/iB2267rUh6v3HjxnL//ffL+++/X+J90tPT9QO/UaNGEhkZKW3atJFJkybp782bN08HHmlpaRIfH6+//8gjj+jBi8uXLy/2furaxMRE95GSkmLz37zsyDgSJYnJnp+UEpNz3d/zt40/9wWCwYgxxLggWsxdxWeqjGhDJM4Q83ihiDbDJfLn2ANvrkH4cqlxAKaFgzEEp2XBggX6hzl16lRp0qSJlCtXTj+QR44cqR/6JRk4cKBs3rxZlwrGjx+vMwX5vv32W9m5c6cuFagjISFBHwcOHCjxno8//rhkZGS4j3O9N85t63cVpHm7LI+PNa0uOymH9kbL4X0xfrfx575AMKgPMmoMgVFJfZwvntE0WswfPcug5vfZYjSL9ukawC5hGWYuW7ZMHnvsMZk8ebJO1av0/WuvvabHCZSkWbNm8uuvv+qxBnv37pWePXvKjTfeqDMDSrt27YoMXlSHur44KnuQHzjkH/Dzv+fblSUhKVf6P3BQIqNMadTyD7nutqPywZy/pmi1aH9SFmzeLCmNTnvdxptrgGDIm5Qh5m85YrpMMf9wiWvqCZF9eWJcV/6vaxZlSc6tB9yvI26JE3P9GXF9flq3c312Sj/sI26O8+kahCfT4gwD1T7YwjKvumHDBmnbtq2elphv3bp1522nygG33nqrPu677z5p1aqVbN26Vd9r9uzZOlBQAxQRXAfSY+XpOxvI8LTdctvIA5KbY8i/30yWhVOrua+JjjElsXKeRESaXrfx5hogGIzLYiVvQoaYO3L1EnNqamDkxMoS0TTGc60Cle7/U8Tl5cS8P0HyJhwX+cMUiY+QyJGJEnFxrE/XIDy5/kz9W2kfbGEZEDRv3lxeeOEFWb16tbRo0UKPHVAPdFU6KInKKNSuXVuuu+46PRbhgw8+0AGCOjdgwAB58cUX5ZZbbpGXX35ZjzVQgcKUKVN0OxU4ILDUdMAhlzeV8nF5cuZUhLhcnr/savpgnxbN5eTxSK/beHsNEGgR7cvpw8w29b+qRkTR38OIW+Mk4oYKHucib46TiF4Vzj7sKxjFLsjmzTWA4wOCmJgYfRTWp08fPSVQjQtQMwRUuv+JJ56QWbNmua9R/6dQaf2IiLNVDzXG4H//93/1zAFV81cP+Y8++sid6l+zZo08+eSTOnug7qlKDMOGDZOWLVsG8W+MU1nF11TV7IDMo1E+tfH1GiAYgwlL/F6soWceFDmvHvBx537Ie3MNwovLgSsVGiar9HhFjWVQGYrOcpNEGQzoQekUvbpmqLsABExOVrZ8et1r+kNjoMaFZf75rLjp4zslOi7GUl+XXPN6QPvqiEGFAAAguMJyDAEAAE7msrgfga9t82fOFaRK6r5kF8gQAABgM0uLEvkxQ2HMmDF6B+D69eu7j44dO/p0DzIEAACUAl27di1x9V1vEBAAAFBK1iFQC/mp2Xv+TE+lZAAAgMNLBspnn32mxwyoXYKvuuoq+f77731qT0AAAECYBgSFd91VGYDipKam6nKBWmdH7d2jVuVVu/yqFXq9RUAAAECYUjvtFtx5V+3EW5yhQ4fqACAqKkoPLnz99df1+bfeesvr92IMAQAANlO7sliZdpi/h6vaabfg1EG1Qq831HVqpsHvv//u9XuSIQAAIExLBoV33fU2IFArHG7fvl3q1q3rdZ8JCAAAcDg1iFDt37N7927ZuHGj3syvfPnycuedd3p9D0oGAAA4fNrhhAkT9PiCr7/+WmcSLr/8cpk7d65Ur17d63sQEAAA4PCAQO0K/N5774kVlAwAAAAZAgAASstKhVZQMgAAwGamaejDSvtgo2QAAADIEAAAYDe1KJGVhYmstPUXJQMAAGzGGAIAACCMIQAAAI5EyQAAAJtRMgAAAELJAAAAOBIlAwAAApAhcDlsYSICAgAAbGbqh7q19sHGSoUAAIAMAQAAdlMrDar/WWkfbJQMAACwGbMMAACAI5EhAADAZmqGgWFhpoCVGQr+IiAAAMBmaoaBpVkGIZhmQEAAAIDNGEMAAAAciQwBAAA2c2KGgIAAAACbOXFQISsVAgAAMgQAANiNWQYAAEDOBgRWxhAE/4dIyQAAAFAyAADAbswyAAAAojL+VrL+IagYUDIAAACUDAAAsB0lAwAAIE6sGbBSIQAAdrO4dLFqH2xMOwQAAGQIAACwGysVAgAAceKgQkoGAACAkgEAALZTn/AdNqiQWQYAANisVI8h6NWrl9c3Xbx4sb/9AQAAEsYBQZ06dQLbEwAASguzFC9MNGXKlMD2BACAUsIM4SyDEydOyDfffCM1a9aU1NRUr9sxywAAgFJkyJAh0rVrV3n++ed9audXQJCXlycTJ06Upk2bSmxsrPv8yJEjZefOnf7cEgCA0lk2MP04/DR9+nQ5cuSItG/f3ue2fgUEKhh49dVXZfTo0ZKdne0+37p1axk3bpw/twQAoNSVDEwLh682b94szz77rMydO1ciIiKCExDMnDlT5s+fL3feeafH+S5dusiSJUv8uSUAAKWHacMhIpmZmR7HmTNnin27P/74Q/r27SsvvfSSpKSk+NVlvwKC9PR0adasmf7aMP6KYsqXLy8nT570qyMAAMCTergnJia6j7S0NCnOAw88IG3bttVBQVAXJmrYsKFs2LBBrrzySo+AQGUNmjdv7ndnAAAoHYw/Dyvtz34AT0hIcJ8tOG4v38qVK+Wdd96R//u//5PVq1frcxkZGbJv3z79umPHjhIVFRWYgGDUqFEyaNAg93iBFStWyPLly2XatGkyZ84cf24JAEDpYdqzDoEKBgoGBMXJycmRiy++WF588UX3uV27dsnhw4fl6aeflqVLl0p8fHxgAgI1dkDNNBg7dqy4XC659tprpXbt2jJ16lTp37+/P7cEAAB+UM9gdRSksgIXXnih/Otf/wr8XgZDhw7Vx6FDh3RQUL16dX9vBQBA6WKW4pUKi3Pq1CkdECgqpaEGFQIAUOaZod3tUC0DULdu3cDPMlCBwIgRIyQpKUkPIlRH5cqV9cJEp0+f9ueWAADAJq+88opeKyjgGYJhw4bJqlWr9ADCdu3a6XMbN26UJ554Qq+hrNYpAACgrDJL8/bHBS1YsEDWrFkjbdq08ZiK2KRJE+ncuTMBAQCgbDOdN4bAr5JBxYoVpX79+kXOq3PqewAAwFn8Cgiuv/56GT9+vJ56mE99rc6p7wEAUKaZhvUjXEsGAwcOdH+tlidWcxvfffddPZLRNE357rvvZPfu3XLTTTcFqq8AADiCYZ49rLQP24Cg4LKHlSpVkttvv93j+2rvZQAAII4cQ+B1QMCSxAAAlF6WFiYCAADhtzBRUAMCtd7A2rVr9QYKubm5RdYpAACgzDJLccmgoG+++cY9m+DAgQNSr149vUWj2tOgcePGBAQAAJSFaYcPP/yw3HvvvbJ//379eseOHXqGwVVXXSX9+vWzu48AADgzQ2BaOJwQEKgphg8++KD+2jAMyc7Olpo1a8qMGTNk9uzZdvcRAABnMctIQJCZmak3NlKqVaumywVK1apV3bsfAgAA5/ArICjoiiuukMcff1xWr14tDz30kLRs2dKengEA4FSm81Yq9CsgePbZZ91fT5gwQWcIrr76avnyyy/l1VdftbN/AAA4dqVCw8LhiFkGY8aM8djQaN26dXovg8jISDv7BgAAnLYwEcEAAABlYB2CXr16eX3TxYsX+9sfAAAgYRwQ1KlTJ7A9AQCglDAs7lhohHNAMGXKlMD2BAAAhAybGwFwW9rkI34aKLUyT7jk7Ao6QWCWoc2NAABA6RlUaHlhIgAA4HxkCAAAsJsDMwQEBAAA2MzqaoOGU0oGalXCiRMnStOmTSU2NtZ9fuTIkbJz5047+wcAAMI1IFDBgNqzYPTo0Xrr43ytW7eWcePG2dk/AACcxywj2x/PnDlT5s+fL3feeafH+S5dusiSJUvs6hsAAM5klpGAQO1u2KxZM/21Yfw1V7J8+fJy8uRJ+3oHAADCNyBo2LChbNiwoUhAoLIGzZs3t693AAA4kFFWtj8eNWqUDBo0yD1eYMWKFbJ8+XKZNm2azJkzx+4+AgDgLGYZWalQjR1QMw3Gjh0rLpdLrr32Wqldu7ZMnTpV+vfvb38vAQBwErMMrUMwdOhQfRw6dEgHBdWrV7e3ZwAAwDkLE1WtWtWengAAUEoYDlyYyK+AQJUIzkWNJwAAoMwyy0jJoEWLFh6vVcngl19+kX//+99yxx132NU3AAAQzgGBWqmwODNmzJAvvvjCap8AAHA202La3ykLE5VEzTBQUxABACjTzDKyUmFJtm7dqqcjAgCAMlAyGDFiRJFzx44dkw8++EAGDhxoR78AAHAus4wMKty+fXuRc0lJSfLcc88V2fAIAICyxigr0w6XLl1qf08AAIDfDh48KKtWrZKMjAxp2rSpdOrUKfBjCBo3buxPMwAAEAAvv/yydOzYUT788EPZuHGj9O3bV6644grJysoKbIbgyJEjcvz4calUqZI/zQEAKN3M4I4haNOmjWzZskWios4+1g8cOCApKSmycOFCr9cH8itD0KdPH5kyZYo/TQEAKPWMIG9/rLID+cGAEhcXJ5GRkfoIaIZARR5qEaJ33nlHmjVrJjExMR7ff+utt/y5LQAAKCAzM7PgS4mNjdVHcfbs2SPz5s2TEydOyLJly2TAgAHSr18/8ZZPGYLOnTvrP1Wp4Pbbb5eLL75YKlSooKOSggcAAGWeaX1RIpX2T0xMdB9paWkl/lhzcnJk//79kp6erv9U6wLl5uZ6/Z/Bp6f3mjVr9J9z5swp8/+dAQAI9BgC9XBPSEhwny4pO6DUr1/fvbXA4cOH9b5D6vWTTz7p1VvycR4AgDClgoGCAYG3qlSporP43377rddtfA4IduzYcd5rVJQCAEBZZQR5YaKffvpJmjdv7n6tZgKqYGDw4MGBCwgaNGhw3mtMMwRLLAEAUEanHQ4ZMkTq1q0rLVu21IMK3333XalVq5aMHj06cAHBJ5984msTAAAQQOvXr5ePPvpIvv76a6levbq89tprcs0114hhGIELCK6++mpfmwAAUKYYQS4ZqAf/ddddpw9/MagQAAC7OXC3Q5/WIahdu3bgegIAAELGpwzB7t27A9cTAABKC9N5GQJKBgAAOHwMgR0ICAAAsJsDMwR+7XYIAABKFzIEAADYzYEZAgICAABs5sQxBJQMAAAAGQIAAGxHyQAAABiUDAAAgBMxqBAAALtRMgAAAOLAgIBZBgAAgJIBAAB2M/48rLQPNsYQAABgNweWDAgIAACwGdMOAQCAI5EhAADAbpQMAABAqMYBWMG0QwAAQMkAAAC7OXFQIWMIAACwmwPHEFAyAAAAZAgAALAbJQMAACCUDAAAgCMxqBAAAJtRMgAAAOLEkgEZAgAA7ObAgIBphwAAgAwBAAB2YwwBAAAQSgYAAMCRGFQIAIDNDNPUh5X2wUZAAACA3ZhlAAAAnIgMAQAANmOWAQAAECeWDMgQAABgMzIEAAAg6HJzc2XRokXy+eef69eXX3659O3bVyIivF+QmKWLAQAIVMnAyuGDiy66SBYvXiypqalywQUXyGOPPSbXX3+9uFwur+9ByQAAAIeXDJYtWyZ169Z1v+7SpYsOEtauXStXXnmlV/cgQwAAgMMVDAaUevXq6T+PHj3q9T3IEAAAEKazDDIzMz1Ox8bG6uN8pkyZIhUqVJAOHTp4/ZZkCAAACGDZwJ8jX0pKiiQmJrqPtLS0877vRx99JM8884xMnjxZqlWr5nV/yRAAABCm0tPTJSEhwf36fNmBzz77THr37i3jx4+Xu+++26f3IiAAAMBuanMiKxsU/dlWBQMFA4JzWbVqlfTs2VOefPJJefTRR31+SwICAAAcPstgzZo1csMNN8iYMWPk8ccf9+s9CQgAAHCwnJwcHQyocsKmTZukX79+7u/dfvvt0qNHD6/uQ0AAAICD9zKIjIyUmTNnFvu9hg0ben0fAgIEjWGYUqlKrmSdiJTs0xG2tfHnvoCdjuyPkpycor97MbEuqVwt95xtc3NEMo5GSaXkXImM8v8ahBfDdfaw0t5banniglkBf/GrhaC4rHuGDE/bLeUquCQ61pSP36ksU8fUFleeYamNP/cF7PbSqLqya1s5j3MH90TLpddkytOzfy+x3YKp1WTe5Ooif/66Dhq1X24ZesjnaxCGTHY79NuPP/4oK1asOOc1aqMGNScTzlKrwRl54tWdMmt8TVk8q4qkNDojE9/7VY4ejJK3X6rhdxt/7gsEwvi3fvN4vXNbrNzTual0uaXkVeLW/jtR5j5fQ8bN/U3aXHFSvvokQcbd1UBqNzgj7a/O9PoawC5hk189deqU7N+/331MmjRJ5syZ43EuOzs71N2EH3oMOKIf0otnVVWJMEnfXk6WvVVZrh98pMQQ2ps2/twXCIbl85IlMTlHLute8kN76RtVpH23TP2gVy7tlikXdTwhS+cm+3QNSt+iRIbFGQqOLxlccskl+sj31VdfSaNGjWTixInu5RtnzJghd911l6xfv162bdsm3bp1k8qVK8ubb74pw4cPdy/YoEZcqhWabrvtNqlZs6b7njt27JCVK1e6369ly5ZB/3uWRU3+dkr++3Wcx7mfNsTJgBEHpWqtHDm0N8avNv7cFwg0Ve9f+W6SdOtzTKJjSv5Xfdv3FWTgw/s9zrW4JEuWvF7Fp2tQutchKJMZgvNRGzSMHj1arrnmGnnuuef0w11lFdQqTuq8+jrfmTNn9LmdO3e6z02bNk3v/KRWcVLBhtoJSs3XROAlJudK5rFIj3NqgFT+9/xt4899gUBb93GiZByJlmsHqExV8bLPGPLHyUhJSPL8PU2onCuZf/4Oe3MNYCfH/Va1a9dOP9zzff311+dt89NPP8moUaNkw4YN0qJFC31O7RWtvlZLPLZu3bpIGxVUqCNf4Q0m4D3TpabFeJ6Lij4b/ZY0+M+bNv7cFwi0FfOSpeWlJ/WYlpJERp79Pc3L9fw9zcsxxIjw/hqELyPICxOVyYBg0KBBPrdZuHChLi18+umn8sknn4j5ZypGbRSxbt26YgMCtYGE2hwC1h3aFy1J1XI8ziVVPfup5/D+aL/b+HNfIJAO7Y2Wb1ZXlFGTd53zOjV1sFKVHDl6yPP39OihKKlSI8fraxDGTOfNMnBcnFm1qhpA5ps9e/ZIVFSU7N69W3+9d+9efQwcOFBSU1OLbaOWfszIyHAfqjQB//ywLl5aXZYlUdF/Tay9+KpM2bk11p36jI51SfU62RIZZXrdxptrgGD6eH5lqZCQJ52uP17ke1mZEXJg918P91aXndTBQ0Ffr0qQlped9OkawC6O/1dTPeiVvLw897msrCyPa5KTk/VKTvkDFL3h7Z7TOL+P3k6Wm+8+JI+8skvPqVaDAbv3OyrPDavnMVDqn/N/k3uuaiI7t5b3qo031wDBohKPKiDoessxiSlX9OOdmjHw5os1ZOnvP+jXfYcdlBE3NpY3JtSQDj0yZNX7SZL+SzkZ/fJf2QVvrkF4MhxYMnBchqCw/HUJ1DoG+ZYuXepxTa9eveS3336TRYsWeZxXGYMjR0oe+AN7ZGVGyujejfTXj03bJV1vPSoTHqgr//mwkvuaM6cjZH96tOT+udqbN228uQYIlm2byovpMqTHbcX/m6IyB9Vr/zV1ulHLU5I271fZ+l0F+X/31ZMdW8vJPxdsl/qpp326BmE+y8C0cASZ4zME6tN///79ZfDgwTJkyBDZt2+ffPnllx7XXHrppXo8gFraUV2r1nbeunWrfPPNN+5piAisvTti5f/dW7/E72/ZGCe3t2/mUxtvrwGCIfWiUzJ3w5YSv9/z9iP6KKjlpVnS8lLPRY0K8+YaoFRnCNSDu+AOTWoA4MMPPyxJSUlFrlXrEKhBgEqnTp3kiy++0NfWqlXLfc1TTz0l3333nZ5Z4HK55KabbtK7QtWpUydIfyMAQFlhOHBhIsPMH3KPc1LTDlVQ0llukiiDEewonVbs/T7UXQACJvOES5Ka/KYHiickJAT0WXHZteMkKtpzfwtf5OaclnXLnwpoX0tdyQAAgHBjMKgQAAA4ERkCAADs5jLPHlbaBxkBAQAAdmOlQgAA4ERkCAAAsJnaksrSSoUSfAQEAADYzepqgyFYESBsFyYCAADBQ4YAAACbOXEdAgICAADsxiwDAADgRGQIAACwmWGa+rDSPtgICAAAsJvrz8NK+yAjIAAAwGZOzBAw7RAAAJAhAADAdg6cZUDJAAAAu7FSIQAAcCIyBAAA2IyVCgEAgFAyAAAAjkTJAAAAmxmus4eV9sFGQAAAgN2YZQAAAJyIDAEAAHZjYSIAAGA4cC8DMgQAANiNMQQAAMCJ2O0QAAC7qYy/y8LhY8XANE1ZsWKF9OrVSxo1aiSrVq3yucuUDAAAcPgYgmeeeUbWrVsnAwYMkCVLlkhWVpbP70lAAACAwz3xxBMSExMjx48f9/seBAQAAARk2qGFmQI+NlXBgFUEBAAAhOksg8zMTI/TsbGx+ggEBhUCABCmUlJSJDEx0X2kpaUF7L3IEAAAYDc1U8Cw2F5E0tPTJSEhwX06UNkBhYAAAIAwnWWggoGCAUEgUTIAAAAEBAAABGxQoZXDB8uXL9cLErVp00a/vueee/Trf/7zn17fg5IBAAAO38ugU6dOOigoLCkpyet7EBAAAODwgCAuLk5nBKxgDAEAACBDAABAuE47DCZKBgAAOHxzIztQMgAAAGQIAABw+qBCO1AyAADAbi5T5f2ttQ8ySgYAAIAMAQAAtqNkAAAARCyOIVDtg4ySAQAAoGQAAIDtKBkAAADRswScNcuAaYcAANjNdJ09rLQPMsYQAAAAMgQAANiOMQQAAEAcOIaAkgEAAKBkAACA7SgZAAAA0RUDK7sdBv9nSMkAAABQMgAAwHaUDAAAgLjUwkIui+2Di5IBAACgZAAAgO0oGQAAACEgAAAArFQIAAAcie2PAQCwmWm69GGlfbAREAAAEIgxBFY2KLKyyqGfmHYIAADIEAAAYDv9Cd9ZGQJKBgAA2E2tNGhYGAcQgjEElAwAAAAZAgAAbEfJAAAAmC6XmIazph1SMgAAAJQMAACwHSUDAAAgalEig2mHAACUbaYKBqxMO2SlQgAAEAIsTAQAgM1MlymmhZKBaSFDcPr0aSlXrpzP7ZhlAACA3dS0QauHj9LS0iQ5OVni4+OlQYMGsnjxYp/aExAAAOBws2fPlvHjx8uCBQvk1KlTMmLECOnTp4/88MMPXt+DgAAAgECUDCwevpg0aZIMHDhQunbtKtHR0fLggw9KkyZNZNq0aV7fg4AAAAAHlwz++OMP+fHHH6VTp04e56+88kpZv3691/dhUKGPAzxyJcfSjpZAOMs8EfzlUoFgyTzpsjxgz1tWnxW6vepzZqbH+djYWH0UdPjwYf13qlKlisf5atWqycGDB71+TwICL504cUL/+bks8/qHCzhNUpNQ9wAIzr/niYmJAbl3TEyM1KhRQz7fb/1ZoQYHpqSkeJwbO3asPP3008Ve71JbLheQm5srhmF4/X4EBF6qVauWpKenS8WKFX36AcN/KjJW/2dQP/eEhAR+lCh1+B0PLvUpWgUD6t/zQClXrpz8/vvvkp2dbUt/Cz9vCmcHlOrVq0tkZKQcOHDA47zKDvjydyUg8FJERITUqVPH6x8s7KOCAQIClGb8jgdPoDIDhYMCf9YB8JcKEtq1aycrV66UIUOGuM9/8skncvPNN3t9HwICAAAc7vHHH5fevXvLVVddJV26dJFXXnlFjy0YPny41/dglgEAAA534403yhtvvCFTpkyRSy+9VL799ludIVALFHmLDAHClkqDqQE0xdXMgNKA33HYacCAAfrwl2EGY/4FAAAIa5QMAAAAAQEAACAgAAAABAQIR99//71Mnz5dj5BVjh49qhcnAkoDtWCN2pZ2woQJcuzYMX1u27Zteoc6IJSYZYCwomYVqH8o1eIh/fr1k27dusnp06fl6quvlk2bNgV1sQ/AbocOHdIbzqgg9/jx43LLLbdIUlKSLFy4UHJyckpckhYIBgYVImxs2bJFpk6dqvfvVots5FNLb7Zv317mz58f0v4BVqkHftu2bWX37t0ea9QPGzZMXn75Zb32PBAqBAQIGxs2bJCePXtK48aNi3wvNTVVBwyAk6mtaEeMGCFRUZ7JWZURU2sS7Nu3L2R9AwgIEFZUeUApvKHH9u3bpVKlSiHqFRDY33G1yZFaZpY9OxBKBAQIG2r97Y8++kg2b97s8Y+lGoD19ttvS48ePULaP8Cq7t27y/PPP6/HC+T/jqvd9+6++2693GwwNt4BSsJKhQgr06ZNk4cffliSk5P1dp7R0dHy66+/ylNPPSXPPPNMqLsHWHLy5Em55ppr9Pa4GRkZ0qxZM/nll1/0YNnPPvtMmjdvzk8YIUNAgLCjxgqoUddq4JUKDNSmHZdffnmouwXYQg0cfP/99+Xzzz/X5YOmTZvKoEGD9O86EEoEBAhrqra6d+9eadKkiUREUOECgEBhHQKElQceeED69u0rHTp0kJ9++kk6duyo52uruduffvppkdHZgNMW3cofVFic1q1bs7snQoYMAcKG2r/73nvv1dMPlSFDhuiBV0888YRewEUtWtS7d+9QdxPwW6NGjfSYmJKo8QTqGiAU+LiFsAoI1CekfGrpYjXrQP0DqbIGaqVCAgI4mVp0y+VyeZxTy3KrhbguuugiadiwYcj6BlCURdhQc7DzPz2p4ECt+d6iRQv9Wq35zpQsOF2FChUkPj7e41CDCtW02ilTpoS6eyjjCAgQVnO0VSDQtWtXXSIYPHiwLhmoT1QqW3DttdeGuotAQMTFxelptgcOHOAnjJChZICwoTIAX331lbz11lty0003yT/+8Q99/ueff9bTspijDadTixDl5eUVWZvgjTfekDNnzki1atVC1jeAQYUAEOJBhZUrV5aZM2fqzBgQKgQECPl2sHv27PHq2qpVq0rt2rUD3icgUNSy3IWnHVasWFEaNGggMTEx/OARUpQMEFJqMNVDDz3k1bUPPvigTJo0KeB9AgJFZQfUGBk1mBAIN2QIEFLq05KqoXqjfPnyevAV4FRqRsGSJUv0yptAuCFDgJBSm7qoAygLUlNT9XoaBAQIRwQEABAkaiXOoUOHSlZWlrRt21ZnvQqqV6+e3uETCAVKBggr27Zt01sdf/fdd3L06FExTdPjH9Px48eHtH+AP9avXy+tWrWSli1bsnQxwhYBAcJqZ0NVY1ULEKmxBWp1QrVYkVqXQO14+MEHH+hPVYATpxsuX75cZwRycnJKvK5OnTps4IWQoWSAsLFq1Sq9lvusWbP0bILff/9dzyy4//775fLLL5fdu3cTEMDRmDaLcMbSxQgbu3bt0mlVRc0mUBkDRW153LNnT512BQAEBhkChA21pKt6+CsXXHCBvPDCCzq9qgZZ/fTTT7r+CjjVo48+qhchOpcJEyawfDFChoAAYSMiIkJv8KJ07txZBwdq/wK1C6IKCMaNGxfqLgJ+27lz53mn2J5rfAEQaAwqRMip0kBubq5ez72g48eP6wGFGRkZ0rt3b7nwwgtD1kfAjkGF6k8gXJEhQMi9/vrrsmPHDveyxB9++KEcPHhQ7rrrLhk2bFiouwcAZQIBAcJyvXcVIAAAgodZBgAQYGlpaQwWRNgjQwAAAdanTx9+xgh7BAQICytWrJCBAwfqr3/++We91nv+63xqBcPC5wAA9iAgQMjVrVtXr+C2f/9+/bpSpUr6yH+d78SJEyHqIQCUfkw7BAAADCoEAAAEBAAAgIAAAAAQEAAAAI2FiQAAAAEB4CSffvqp/Pe//3W/VhvmbNu2LSz6Upg/fVP7WPz222+W+xbKnwvgVGQIAAuOHTsm77zzjj7mz5+vH5KF10+w05gxY2TJkiXu16NGjZJly5Z53V5d+8svvwSkL4X52jdl+PDh8tlnn1numz/vDZR1BASAxY2Y+vfvL2+88Ya8//77Mm7cOKlXr55euz4YevToIampqV5fP3LkSL0qJAAUxkqFgA2ef/55adGihf566tSp+pNur1695PTp03Ly5Elp27atfPnll/prdV7Jzc2Vr776So4ePSoXXnihNGnSpMh9jxw5Il988YVUr15dLrrooiLf79q1q1xwwQUe59R9N27cKIcPH9bvW6tWLX1+5cqVerXHb7/9Vmc0lL59+4phGLb05XxWr16tsyfq/dQ9WrduLYmJicVeq67btGmTlC9fXjp06CCRkZFF/o7n6y8A3xAQADZTD/xhw4bJDz/8IOvWrZOPP/5YTNOUOnXqSIMGDfT3Ve39xhtv1A+8+vXry/r166V79+4yZ84ciYg4m7hTqXN1rcoAxMXF6Qe82uOhcGr87rvvdj8Qt2zZottkZ2dL8+bN9fs89thjcs8998jatWt1QKAetH/88Ye+/u9//7veO8KOvpyPCiZ+/PFH/bPYuXOnLl2owKRbt24e16lzY8eOlb/97W86eGnUqJHOaqj3Vbz52QHwgwnAbxs3bjTV/41+/PFH97lVq1bpc2vWrDEffPBB0zAM8z//+Y/7+3l5eWbTpk3NZ5991n3u2LFjZv369c2ZM2fq1zk5OWbDhg3NkSNHuq+ZPn26vm9aWpr7XPPmzc2XXnpJf52bm2s2btzY7NOnj5mdna3PqT+XLVvmvj41NdV85ZVXAtKXwgr2rTiTJ0/W71NQvXr1zBo1apj79u3Trw8fPqzPjRs3zuv+evPeAIoinAZsoEa1q0+2L730kgwaNEinudWhqPR6p06d3NeqVLf6lKsyBu+++64sXLhQZxHUJ+FVq1bpa77++ms9PuGRRx5xtxs6dKgkJSWV2AdVklCfutX4hejoaH1O/anGGZQkUH0pyZ49e/T91QBMVTrYsWOHHDp0yOMataNljRo19NfJycly1113yYIFC7zuLwD/UDIAbKDq82qHRvWQVOnuwYMHu+veNWvW9LhWPQRValsFEQWph1+zZs3017t27ZJy5crpWns+dT+1M2RJVJuoqKgiYwrOJVB9KY4qXbzyyivSrl07qVq1quTk5OjzBw8e1K/zqTJAQarMokoM3vYXgH8ICACbBxUWpj4JF5SQkCAul0smT57s8ZAt/IBTAxJPnTqla+UFpzmWRAUkarBdRkaG/tobgepLYWpNgOeee06PX2jVqpU+t3nzZj1tUY0pKKjwfdXrKlWqeN1fAP6hZAAEWceOHfUAuddee83jvHrQ5a9hoEbgq2sKzvP/5ptv9Kf1kqgSRYUKFWTu3Lke5wum5OPj4/XDPdB9KUzdS32yb9y4sfucSvkXp3CQ8N5777nLL970F4B/yBAAQaY+vU+fPl3Xxn///Xf9sNu3b59ex0Cl1dXI/8qVK+uvVa1e1e/VQ3DSpEn6E/K57vvyyy/Lfffdpz+Rq7ELGzZs0GWEadOm6WsuvvhiefPNN3WKPjY2Vk87DERfCsuf/njrrbdK7969PaY+FqbKAmoWQc+ePeWTTz7RwceMGTO8/tkB8A8ZAsAC9bBUD9WSUvRt2rSRK664osh5NfBQPRTV+AI1HVCl+tWDuuADTa0EOHPmTNm+fbv+9Lto0SJ54IEHPGrlhRcmUg9KNbhQPezVALz27dvrun0+lbZXCympAXiLFy/Wn8Tt6kthBfumggg1BVOVC9R6BCog+fzzz4v87FQQoAKFW265RfdJDR5UQU3BzII3/fV1wSYAIoaaasAPAgCAso0MAQAAICAAAAAEBAAAgIAAAAAQEAAAAI1BhQAAgIAAAAAQEAAAAAICAABAQAAAADQGFQIAAAICAAAE8v8B1eJ3vj+I7jwAAAAASUVORK5CYII=", "text/plain": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "y_predicted = model.predict(X_test)\n", "print(\n", " sklearn.metrics.classification_report(\n", " [y > 0 for y in y_test], [y > 0 for y in y_predicted], zero_division=0\n", " )\n", ")\n", "sklearn.metrics.ConfusionMatrixDisplay.from_predictions(\n", " [y > 0 for y in y_test],\n", " [y > 0 for y in y_predicted],\n", " xticks_rotation=\"vertical\",\n", " values_format=\".2f\",\n", ")\n", "None" ] }, { "cell_type": "markdown", "id": "cell-16", "metadata": {}, "source": [ "The report above describes the active dataset. The synthetic demo cannot\n", "establish the feasibility or quality of a real summarisation system.\n", "\n", "Next: [Part 2](train.ipynb)" ] } ], "metadata": { "kernelspec": { "display_name": ".venv (3.13.5)", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.13.5" } }, "nbformat": 4, "nbformat_minor": 5 }