{ "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "# Swedish SAT example\n", "Here we provide a usage example of the IRTorch package using a sample of data from the Swedish scholastic aptitude test (SAT). The test is used for admission to university programs and consists solely of multiple choice items. It has a quantitative and a verbal part. In this example, we will analyze the quantitative part. We will not do an in-depth analysis of the data, but rather showcase some of the main features of IRTorch to enable the user to analyze their own data.\n", "\n", "Users are referred to the API reference section of the documentation for more detailed information of different functions and classes. Note that the results might vary slightly from those presented here due to differences in the computing hardware (CPU or GPU), the operating system, and the versions of the packages used.\n", "\n", "If you prefer to run the code directly, you can download this example Jupyter notebook from the [GitHub repository](https://github.com/joakimwallmark/irtorch/blob/main/docs/source/notebooks/swedish_sat.ipynb)." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Load the libraries\n", "We start by loading the libraries and modules that we will use for this example." ] }, { "cell_type": "code", "execution_count": 10, "metadata": {}, "outputs": [], "source": [ "import copy\n", "import torch\n", "import irtorch\n", "from irtorch.models import NestedLogit, ThreeParameterLogistic\n", "from irtorch.estimation_algorithms import MML" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "
" ] }, { "cell_type": "code", "execution_count": 11, "metadata": {}, "outputs": [ { "data": { "text/html": [ " \n", " " ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "import plotly\n", "plotly.offline.init_notebook_mode() " ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "
" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## The test data\n", "The package requires the data to be in a PyTorch tensor with test takers as rows and items as columns. For an example on how to convert a pandas dataframe to a PyTorch tensor, check out the [National Mathematics example](./national_mathematics.ipynb).\n", "\n", "In this example, we will load the data directly from within the package. For multiple choice data, we need a list containing the correct response options for the items. Each list element should correspond to one item. Note that for a 4 option item, the responses are coded 0, 1, 2, 3, and thus if the first option is correct, the item corresponding element in the list should be 0. Below we read both the item responses and the correct response options directly from the package." ] }, { "cell_type": "code", "execution_count": 12, "metadata": {}, "outputs": [], "source": [ "data_sat, correct_responses = irtorch.load_dataset.swedish_sat_quantitative()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "We recommend splitting the test data into a training and a test set. The training set will be used to fit the model, and the test set to ensure we are not overfitting the model to the training data." ] }, { "cell_type": "code", "execution_count": 13, "metadata": {}, "outputs": [], "source": [ "irtorch.set_seed(42)\n", "train_data, test_data = irtorch.split_data(data_sat, 0.8)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Initializing and fitting models\n", "Details on available IRT models can be found under the [IRT Models](./../irt_models.rst) section. We will start by showcasing how to use the package to analyze correct vs. incorrect responses using a three-parameter logistic (3PL) model, then we will move on to models that can handle each incorrect response category separately. We start by initializing a 3PL model instance by supplying the number of items." ] }, { "cell_type": "code", "execution_count": 14, "metadata": {}, "outputs": [], "source": [ "threepl = ThreeParameterLogistic(items = data_sat.shape[1])" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "For the 3PL, we need code the data as correct/incorrect:" ] }, { "cell_type": "code", "execution_count": 15, "metadata": {}, "outputs": [], "source": [ "train_data_binary = (train_data == torch.tensor(correct_responses)).float()\n", "test_data_binary = (test_data == torch.tensor(correct_responses)).float()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "The model can now be fit using the `fit()` instance method. `fit()` requires the model training data as a tensor, as well as an instance of the fitting algorithm. The [Estimation algorithms](./../estimation_algorithms.rst) section contains all available fitting algorithms. Here we will use marginal maximum likelihood (MML). Since fitting can take some time, it can be useful to save the parameters of the fitted model to disk for later use using `save_model()` with the filename of choice.\n", "\n", "Fitting will be done using the GPU if available, otherwise the CPU will be used. This can also be specified using the `device` argument, i.e. `nr.fit(train_data=train_data, algorithm=AE(), device = \"cpu\")`." ] }, { "cell_type": "code", "execution_count": 16, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "Epoch: 99. Loss: 181164.1562 " ] }, { "name": "stderr", "output_type": "stream", "text": [ "INFO: Stopping training after 2 learning rate updates.\n", "INFO: Best model found at iteration 99 with loss 181164.1562.\n" ] } ], "source": [ "irtorch.set_seed(42)\n", "threepl.fit(train_data=train_data_binary, algorithm=MML())\n", "threepl.save_model(\"swesat_3pl.pt\")" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "We can load the saved model parameters to a new model instance using `load_model()`. Note that the instance needs to be created in the same way as for the original model for `load_model()` to work." ] }, { "cell_type": "code", "execution_count": 17, "metadata": {}, "outputs": [], "source": [ "threepl = ThreeParameterLogistic(items = data_sat.shape[1])\n", "threepl.load_model(\"swesat_3pl.pt\")" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "The `plot` property of our model contains methods for visualization. We can plot the training history to check if we appear to have converged to a good solution. We see that the loss function appear to have stopped decreasing. In our experience, there is usually slight improvements from training for more iterations even when the loss appears relatively flat. This is especially true for more flexible models. Refer to the [Plotting](./../plotter.rst) section for more information on the available plotting methods." ] }, { "cell_type": "code", "execution_count": 18, "metadata": {}, "outputs": [ { "data": { "application/vnd.plotly.v1+json": { "config": { "plotlyServerURL": "https://plot.ly" }, "data": [ { "hovertemplate": "Type=Training
Iteration=%{x}
Loss=%{y}", "legendgroup": "Training", "line": { "color": "#636efa", "dash": "solid" }, "marker": { "symbol": "circle" }, "mode": "lines", "name": "Training", "orientation": "v", "showlegend": true, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100 ], "xaxis": "x", "y": [ 195409.90625, 188837.109375, 185254.09375, 183777.75, 183387.25, 183346.5, 183310.0625, 183197.171875, 183028.5625, 182837.9375, 182649.84375, 182484.484375, 182353.9375, 182258.6875, 182187.859375, 182126.421875, 182066.53125, 182010.09375, 181963.65625, 181930.484375, 181904.875, 181876.96875, 181841, 181798.625, 181755.359375, 181715.359375, 181680.28125, 181649.9375, 181622.796875, 181596.171875, 181567.8125, 181536.6875, 181503.015625, 181468.34375, 181435.59375, 181408.09375, 181387.15625, 181371.4375, 181358.625, 181347.5625, 181338.515625, 181331.71875, 181325.9375, 181319.03125, 181309.84375, 181299.15625, 181288.65625, 181279.0625, 181270.1875, 181262.078125, 181254.953125, 181248.40625, 181241.6875, 181234.84375, 181228.65625, 181223.65625, 181219.84375, 181216.8125, 181214.15625, 181211.59375, 181209.0625, 181206.546875, 181204.0625, 181201.65625, 181199.375, 181197.15625, 181194.90625, 181192.578125, 181190.328125, 181188.328125, 181186.65625, 181185.21875, 181183.875, 181182.53125, 181181.15625, 181179.75, 181178.34375, 181177.09375, 181176.015625, 181175.046875, 181174.109375, 181173.21875, 181172.34375, 181171.5, 181170.65625, 181169.796875, 181168.984375, 181168.25, 181167.84375, 181167.4375, 181167.03125, 181166.65625, 181166.3125, 181165.96875, 181165.640625, 181165.328125, 181165.015625, 181164.71875, 181164.4375, 181164.15625 ], "yaxis": "y" } ], "layout": { "legend": { "title": { "text": "Type" }, "tracegroupgap": 0 }, "showlegend": false, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "white", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "white", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "#C8D4E3", "linecolor": "#C8D4E3", "minorgridcolor": "#C8D4E3", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "#C8D4E3", "linecolor": "#C8D4E3", "minorgridcolor": "#C8D4E3", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "sequentialminus": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "white", "showlakes": true, "showland": true, "subunitcolor": "#C8D4E3" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "white", "polar": { "angularaxis": { "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "" }, "bgcolor": "white", "radialaxis": { "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "white", "gridcolor": "#DFE8F3", "gridwidth": 2, "linecolor": "#EBF0F8", "showbackground": true, "ticks": "", "zerolinecolor": "#EBF0F8" }, "yaxis": { "backgroundcolor": "white", "gridcolor": "#DFE8F3", "gridwidth": 2, "linecolor": "#EBF0F8", "showbackground": true, "ticks": "", "zerolinecolor": "#EBF0F8" }, "zaxis": { "backgroundcolor": "white", "gridcolor": "#DFE8F3", "gridwidth": 2, "linecolor": "#EBF0F8", "showbackground": true, "ticks": "", "zerolinecolor": "#EBF0F8" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "#DFE8F3", "linecolor": "#A2B1C6", "ticks": "" }, "baxis": { "gridcolor": "#DFE8F3", "linecolor": "#A2B1C6", "ticks": "" }, "bgcolor": "white", "caxis": { "gridcolor": "#DFE8F3", "linecolor": "#A2B1C6", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "#EBF0F8", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "#EBF0F8", "zerolinewidth": 2 } } }, "title": { "text": "Training History" }, "xaxis": { "anchor": "y", "domain": [ 0, 1 ], "title": { "text": "Iteration" } }, "yaxis": { "anchor": "x", "domain": [ 0, 1 ], "title": { "text": "Loss" } } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "threepl.plot.training_history().show()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Estimation of latent traits\n", "We can estimate the latent trait scores $\\theta$ of the test takers using the `latent_scores()` method. If we set the `standard_errors` parameter to `True`, we can also obtain the standard errors of the latent trait scores. By default, the method uses maximum likelihood (ML) to estimate the latent trait scores, but other methods can be used as well by setting the `theta_estimation` argument." ] }, { "cell_type": "code", "execution_count": 19, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "INFO: Optimizing theta scores...\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Iteration 9: Current Loss = 176718.828125 " ] }, { "name": "stderr", "output_type": "stream", "text": [ "INFO: Converged at iteration 9.\n", "INFO: Computing Jacobian for all items and item categories...\n", "INFO: Optimizing theta scores...\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Iteration 7: Current Loss = 44074.78125 " ] }, { "name": "stderr", "output_type": "stream", "text": [ "INFO: Converged at iteration 7.\n", "INFO: Computing Jacobian for all items and item categories...\n" ] } ], "source": [ "theta_train_threepl, theta_se_train_threepl = threepl.latent_scores(train_data_binary, standard_errors=True)\n", "theta_test_threepl, theta_se_test_threepl = threepl.latent_scores(test_data_binary, standard_errors=True)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "We can plot the latent variable distribution get an overview of the test takers' abilities. Since MML makes the implicit assumption of normality, the overall distribution is close to normal. There is a large amount of test takers mostly guessing, and they appear to be spread out in the lower end of the distribution." ] }, { "cell_type": "code", "execution_count": 20, "metadata": {}, "outputs": [ { "data": { "application/vnd.plotly.v1+json": { "config": { "plotlyServerURL": "https://plot.ly" }, "data": [ { "alignmentgroup": "True", "bingroup": "x", "hovertemplate": "values=%{x}
count=%{y}", "legendgroup": "", "marker": { "color": "#636efa", "pattern": { "shape": "" } }, "name": "", "offsetgroup": "", "orientation": "v", "showlegend": false, "type": "histogram", "x": [ 1.6701021194458008, -0.4013443887233734, -0.9621886014938354, -0.47427892684936523, 0.22102996706962585, 0.4871429204940796, -1.0090556144714355, -0.3365063965320587, 0.015682965517044067, -0.23902232944965363, -0.7504948377609253, 1.6775753498077393, 1.2425397634506226, -0.05195920169353485, 0.7474790215492249, 0.23467408120632172, -0.4946284592151642, -0.809894323348999, -0.8427773714065552, -1.7870934009552002, -1.3359959125518799, -0.17393502593040466, -0.39147764444351196, 2.7278945446014404, 0.3609798848628998, -0.6060501337051392, 0.29202133417129517, -1.9618695974349976, -2.0516014099121094, 1.1275523900985718, -0.26453688740730286, 1.9543646574020386, -0.853431761264801, -0.18094973266124725, -0.3713285028934479, -0.32224372029304504, -0.0972270742058754, -0.02444693259894848, 0.1357625275850296, 0.4412049949169159, 1.1827431917190552, -0.3586912453174591, -2.2241251468658447, 0.16488255560398102, -1.663999080657959, 0.449679970741272, 2.059107780456543, -0.7460053563117981, -0.01420207042247057, -0.04653787985444069, -1.9546797275543213, 0.23938044905662537, 1.231762409210205, -0.10200554132461548, 0.7896058559417725, -0.5800328254699707, -1.5143728256225586, -0.06695964187383652, 0.005820273421704769, -0.3919655382633209, 1.2854429483413696, 0.48105064034461975, -0.982657253742218, -0.896655261516571, 1.185926079750061, 3.310927152633667, -0.9850367307662964, 0.0887068435549736, -0.3137270510196686, 0.3208761215209961, 0.307151198387146, -1.202414631843567, -0.08377671986818314, 2.798823595046997, -0.5184486508369446, -0.7540435194969177, -0.053321484476327896, -0.045243095606565475, 0.9450845718383789, 0.5719929337501526, 0.4085516333580017, -1.1501076221466064, -0.7832776308059692, -1.0598313808441162, 0.1470499485731125, 0.05275135859847069, -1.2318018674850464, -0.2056867629289627, -0.4140729308128357, 1.0660831928253174, -1.3285843133926392, 0.6625528335571289, 1.880814790725708, 0.48769411444664, 0.37352749705314636, -0.9868625998497009, 1.3906347751617432, 0.8515202403068542, 1.227536678314209, -0.7386914491653442, -0.7515754699707031, 0.5239247679710388, -0.504108190536499, -0.3288980722427368, -0.1262723207473755, -0.7424002885818481, -1.6300336122512817, -0.5042734742164612, 0.10349484533071518, 1.1317331790924072, 0.851218581199646, 1.3460415601730347, 0.17510375380516052, -0.30845606327056885, -0.29186853766441345, 0.6372880935668945, 1.0798319578170776, 0.7486704587936401, 1.297742247581482, 0.024422302842140198, 0.49205461144447327, -1.5723001956939697, -0.10158171504735947, -0.7191416621208191, -1.2347818613052368, -0.6859269142150879, 1.720120906829834, 1.3952622413635254, -1.2722333669662476, -1.5565712451934814, -1.045629620552063, -0.3137485086917877, 0.3677847385406494, 0.7124619483947754, 0.08606154471635818, 2.440657615661621, 0.39491820335388184, 2.665715456008911, 1.725279688835144, 1.20916748046875, -0.5529546737670898, -2.7873787879943848, -1.871337890625, -1.6178300380706787, -0.9796927571296692, -0.6309326887130737, 0.09900343418121338, -0.2808751165866852, 0.702878475189209, 0.030469762161374092, 0.736494243144989, 0.37604472041130066, 0.7889389991760254, 2.27284836769104, 0.0811658576130867, -1.7717777490615845, 0.014142432250082493, 0.8775602579116821, 0.14944997429847717, 0.8356919288635254, 0.5881122946739197, 0.5638540983200073, 1.6143510341644287, -0.8334043622016907, -0.39386844635009766, 0.6840412616729736, -0.020431281998753548, -0.7029045224189758, 0.30511602759361267, 0.5421063303947449, -0.24129465222358704, 1.091206669807434, -0.9701244235038757, -0.0032988605089485645, -0.9537899494171143, 0.9001896977424622, -0.19718530774116516, 1.3883377313613892, -1.131880521774292, -1.0903867483139038, 0.34568509459495544, 0.06424009054899216, -0.029672497883439064, -0.1973988264799118, 0.8406216502189636, -1.054208755493164, 0.4676947295665741, -0.6342087388038635, -0.2011122703552246, -0.8901128768920898, 0.25545981526374817, 0.1606757640838623, 1.150004506111145, 0.9259425401687622, 0.12635618448257446, 0.2295258790254593, -0.023738333955407143, 0.8329809308052063, -1.0473930835723877, 0.30106255412101746, -1.4681336879730225, -1.2356473207473755, 0.23106035590171814, 0.8302143216133118, -1.006901741027832, 0.8498257994651794, -1.4491419792175293, 1.3971779346466064, 0.23915357887744904, 0.7658546566963196, 0.33915677666664124, -1.7814501523971558, -0.9943373799324036, -0.06154148653149605, -1.524379849433899, 2.0898194313049316, -0.45564132928848267, 0.8971486687660217, -2.247019052505493, -0.4891301393508911, 1.477277159690857, -0.11950957030057907, -0.06553694605827332, -0.23414532840251923, -0.1275406777858734, 1.9680017232894897, -1.7695839405059814, -0.42279112339019775, -0.4757702052593231, -1.1997061967849731, -0.3917473256587982, -0.7782420516014099, -0.7033922076225281, 0.015912029892206192, -0.8420393466949463, -0.22783786058425903, -2.8647220134735107, 2.3452816009521484, -0.8205171823501587, -0.2527005970478058, 0.45561861991882324, -1.1391414403915405, -0.7033369541168213, -0.9325356483459473, -1.007163643836975, -0.1260230988264084, -0.8441455960273743, 0.41502508521080017, -1.7505724430084229, -1.3454792499542236, -18.561378479003906, 0.45526063442230225, 0.7719040513038635, -1.8467204570770264, -1.203978180885315, 0.04198182374238968, 1.0340683460235596, -3.3149166107177734, -1.3984414339065552, 0.2506398558616638, 0.30007606744766235, -0.2259044200181961, -1.1965210437774658, 0.8548542857170105, 0.6952174305915833, 0.1439109444618225, -1.276268482208252, 0.779871940612793, 1.2837059497833252, -0.22430329024791718, -15.69243335723877, 0.09098983556032181, 0.054780129343271255, 0.013822135515511036, -16.887598037719727, 1.3931845426559448, -1.4460207223892212, 0.8899747729301453, 1.269865870475769, 2.2147388458251953, -1.5153170824050903, -1.160542368888855, -1.2565346956253052, 1.0910873413085938, 1.1865499019622803, -0.15063150227069855, 1.0028040409088135, 0.10176906734704971, 0.7706958651542664, -3.2673051357269287, 0.31890133023262024, 0.8665199279785156, 0.5073079466819763, -0.28038206696510315, -0.15489964187145233, 1.1499871015548706, -0.5694733262062073, 0.08702875673770905, -2.1933624744415283, -1.8294596672058105, -2.0498313903808594, 2.0738790035247803, -0.44648119807243347, -1.1907368898391724, 0.8377540111541748, -1.2731952667236328, 1.0126307010650635, -1.0396976470947266, 0.5797311067581177, -0.8053640723228455, -0.6111481189727783, 0.9277380704879761, -1.4594125747680664, -15.622920036315918, 1.9608590602874756, 0.34828779101371765, -0.3424518406391144, -0.18499262630939484, 1.1142141819000244, 1.4390747547149658, 0.7323889136314392, 1.692148208618164, 0.4153400659561157, -0.758794367313385, 0.18620595335960388, -0.5630350708961487, 0.7188352942466736, -0.6978166699409485, -0.3663800060749054, 0.5032320022583008, 0.12521736323833466, 1.1371996402740479, -0.08562123775482178, -0.37477564811706543, 0.7937425374984741, 0.7313529849052429, -0.4860881567001343, -0.056155867874622345, -0.3369532823562622, -0.3640773892402649, -0.8226471543312073, -0.9237383008003235, 1.2452576160430908, -0.2009589672088623, -1.4261597394943237, -0.9209190607070923, -0.28980499505996704, 0.7018173933029175, 1.2340797185897827, -1.2665975093841553, -0.11654222011566162, 0.3435021936893463, -0.9028292298316956, -0.683616578578949, 0.8974573612213135, -0.09804262965917587, 0.20730619132518768, -0.04262269288301468, 0.067946657538414, -18.108901977539062, -0.4829972982406616, -1.6804038286209106, 1.4129853248596191, 0.8982717990875244, -1.1676197052001953, -1.4078724384307861, -0.241227924823761, -0.24875906109809875, -16.927207946777344, 0.38561898469924927, 1.1138570308685303, -0.05873959884047508, -1.3985689878463745, 1.7894014120101929, -0.8071817755699158, 0.8316658735275269, 0.2618773281574249, -0.4162651300430298, 0.9132717251777649, 1.3696205615997314, 2.017789840698242, 1.7733960151672363, 0.40511956810951233, -0.8494532108306885, -0.22686578333377838, -0.19234955310821533, -2.0322468280792236, 0.22754180431365967, -1.011629581451416, 1.6815457344055176, -0.2477475255727768, 0.6750609874725342, 0.13874435424804688, 0.5562552213668823, -1.6167917251586914, 1.175965666770935, 0.3250761926174164, -0.046716343611478806, 2.279827356338501, -0.25412634015083313, -0.4099774658679962, -0.12063657492399216, 0.4340805113315582, 0.1110650822520256, -0.002476111287251115, -0.42279160022735596, -0.4696209728717804, -0.36353373527526855, -0.06401994079351425, -0.11585085093975067, 0.9132018089294434, 0.8281629681587219, 1.2548766136169434, -0.0634513646364212, 0.6874685883522034, -1.2803689241409302, -0.5831207633018494, -0.05613207817077637, -12.737375259399414, -2.779745578765869, -0.7805660367012024, -0.37352874875068665, -0.03583333641290665, 1.7654777765274048, 2.107759475708008, 0.5707927346229553, 1.3850563764572144, 1.394569993019104, 0.7113397121429443, 0.46787747740745544, 0.9517487287521362, -0.8409066796302795, -0.9611682295799255, 0.06813447177410126, 2.619811534881592, 0.9559094309806824, -0.5950199365615845, 0.430792897939682, -0.23610487580299377, -13.439101219177246, -1.2987312078475952, 0.2991483807563782, -0.7488812208175659, 2.208608627319336, 0.29483914375305176, 0.4674071967601776, 0.14203934371471405, 1.0089898109436035, 0.0009707655408419669, -0.8302242159843445, -0.5877621173858643, 1.0831350088119507, -0.0851081907749176, -0.13201890885829926, 0.7690086364746094, 0.599500834941864, -0.43251243233680725, 0.6897672414779663, 0.08398095518350601, 1.2728101015090942, 0.334959477186203, -0.25499194860458374, 0.2218245565891266, 0.17316502332687378, -0.46388453245162964, 0.41276419162750244, 0.17071542143821716, -0.6557283401489258, 0.20664140582084656, 1.2475416660308838, 0.5941089391708374, -0.1644948571920395, 1.7246779203414917, 0.060729287564754486, 0.05769626423716545, -0.2838590145111084, 0.3785691261291504, 0.6046236753463745, 0.8459674119949341, 0.6800540685653687, -0.5285106897354126, -1.706848382949829, -0.12022071331739426, 0.1765863597393036, 2.2328689098358154, -0.17776761949062347, 0.09358503669500351, -0.17655342817306519, -0.5202522277832031, -0.8813592195510864, -0.05805975943803787, 0.31376126408576965, -1.1943591833114624, -0.015882207080721855, 0.2008516490459442, -9.347285270690918, -0.569974958896637, -0.23516906797885895, -0.35812076926231384, -1.2899173498153687, -0.8601201772689819, 0.385479599237442, -0.16057497262954712, -0.29398635029792786, -0.13203340768814087, 0.36877888441085815, -0.8655543923377991, 0.663767397403717, 0.5852406620979309, -0.4609851539134979, 1.1741054058074951, -0.7165546417236328, -2.3762502670288086, 1.0318294763565063, -0.611397922039032, 0.5411325693130493, 0.9259071946144104, 0.5514629483222961, -0.7992487549781799, 1.1960837841033936, 0.1367790251970291, 0.1252211332321167, -1.507036566734314, 0.01600639708340168, 0.33279281854629517, -0.58061283826828, -0.7834358811378479, 1.052857756614685, -0.9058774709701538, -1.7517919540405273, 1.925586462020874, 0.9062283039093018, -2.0205578804016113, 0.8126953840255737, 0.0499160960316658, -0.1966859996318817, 0.2728426456451416, 1.6356881856918335, 1.7337945699691772, -1.7686190605163574, 0.5873236656188965, 0.8721005320549011, 0.2527526915073395, 0.030415307730436325, 0.4402143657207489, 0.6167499423027039, -1.3077737092971802, 0.5512112379074097, -0.4745350480079651, 0.9157301187515259, 0.03961589187383652, -0.38683003187179565, -0.1726664900779724, 0.89200359582901, -0.03352867439389229, 0.11550401896238327, 0.10051723569631577, -0.7350569367408752, -0.479885071516037, 1.0447297096252441, -1.198862075805664, 0.9896156787872314, 0.16808858513832092, 0.5775546431541443, -0.9140392541885376, -2.015496015548706, 0.9109838604927063, 0.5913926959037781, -1.4647895097732544, -1.0044174194335938, -0.054608944803476334, -0.5681459903717041, 0.15467070043087006, 0.7826933264732361, -0.24484850466251373, -0.44560426473617554, -3.110074281692505, 0.7586746215820312, 0.5355629920959473, 1.7600325345993042, 1.2780053615570068, 0.30196502804756165, -0.23653706908226013, 0.7283837795257568, -0.6094091534614563, -0.6655275225639343, -0.046601198613643646, -0.5366504192352295, -0.23508433997631073, -0.358513742685318, 1.8448803424835205, 0.21936693787574768, -0.6611652374267578, -0.9577195644378662, 0.6308346390724182, -0.4946279525756836, -0.24059957265853882, 0.5811743140220642, -0.8085638880729675, 0.49540573358535767, 2.1480908393859863, -0.22482013702392578, -1.7660865783691406, -3.200334072113037, 0.49359941482543945, 0.13692285120487213, 0.7778846621513367, 0.5252137184143066, -0.10016755014657974, -2.2446844577789307, -0.4358745217323303, -10.894821166992188, -0.20592689514160156, -0.7099545001983643, -1.5485506057739258, -1.6770657300949097, 0.6528546810150146, -1.4778858423233032, 1.3865599632263184, -0.07230344414710999, 0.44155532121658325, 0.2253604531288147, 1.4651511907577515, 0.8264480233192444, -1.074456810951233, -1.4203940629959106, 1.5893157720565796, 0.1599459946155548, -1.7769204378128052, -1.3568865060806274, -0.35283327102661133, -2.5785365104675293, 0.17958927154541016, -0.09670332819223404, -18.22732925415039, 2.110806465148926, -0.2972424030303955, -0.222786545753479, 1.159976601600647, -0.28520992398262024, 0.0732957273721695, -0.3923517167568207, -0.09228190034627914, 0.33259743452072144, 0.1965779960155487, 1.301517128944397, 0.1898757666349411, 0.28715747594833374, -1.162158489227295, 0.16818523406982422, 0.41557615995407104, -0.6018446087837219, 0.42732933163642883, -1.4398561716079712, -1.2395107746124268, -0.38418498635292053, 1.6702946424484253, -0.19590814411640167, 1.164395809173584, 0.9613975882530212, 0.5642630457878113, 0.8458976149559021, -0.23589792847633362, -1.4722265005111694, -0.8705275654792786, -0.38195833563804626, -1.049065113067627, -1.349847435951233, -0.5302889347076416, 0.27434661984443665, 1.795946478843689, 0.18532507121562958, 0.3846076428890228, -0.15348033607006073, 1.7178632020950317, -0.7672904133796692, -0.5191990733146667, -0.891994059085846, 0.9352000951766968, -0.8211413025856018, -0.640424370765686, -0.6935401558876038, 0.3865292966365814, 0.19553060829639435, -0.7163758277893066, -0.469620943069458, -0.8588986992835999, -0.27736032009124756, 0.1417139619588852, -1.948276400566101, 0.8240102529525757, 0.9409766793251038, -2.061589241027832, 3.1733040809631348, -0.7712946534156799, -0.3056074380874634, -0.6221938729286194, -3.076613664627075, -0.8934381604194641, -0.03244141489267349, 1.2541425228118896, 0.34388628602027893, -0.7004550695419312, -1.0085731744766235, 0.9633119106292725, 0.3665636479854584, 0.10162024945020676, -0.8132174611091614, -2.266779661178589, -0.5635631084442139, -1.2580170631408691, -0.10357130318880081, -1.0834674835205078, 1.4864423274993896, -2.4173150062561035, -0.09391482174396515, 0.4235823154449463, 0.12415008991956711, 0.8981422185897827, 1.189937949180603, 0.7115863561630249, 0.038795217871665955, 1.3632597923278809, 0.6373701691627502, 0.38278165459632874, 0.7284129858016968, -1.5215989351272583, 0.7115475535392761, 0.2888809144496918, -0.5229651927947998, 1.1179436445236206, 1.2731096744537354, -0.7542174458503723, 1.1135857105255127, 0.6874525547027588, -0.16312631964683533, 0.5903967022895813, -0.6977152824401855, 0.8635366559028625, 1.733234167098999, -0.7100813388824463, -0.3510550260543823, 0.2810482680797577, 1.316776156425476, -0.002193765714764595, 0.6387234330177307, 0.5361548662185669, 1.8864244222640991, 0.629464328289032, -1.2792402505874634, -0.1431824117898941, 0.5214776992797852, -0.3618578612804413, -0.8666455149650574, 1.5448659658432007, -2.061894655227661, 0.7982968688011169, -0.35796838998794556, -0.6197317242622375, 0.7246381044387817, 0.21233443915843964, -0.48837822675704956, -0.17550240457057953, 0.9505169987678528, -0.021790994331240654, -1.0330415964126587, 0.10861173272132874, 0.1493970900774002, 1.4069769382476807, 0.8096254467964172, 0.9679690599441528, -0.5173286199569702, 0.4969790577888489, -0.4176102578639984, -0.369778573513031, 1.221616268157959, -0.48464423418045044, 0.4854068160057068, -0.02460417151451111, -1.2322564125061035, -1.2582907676696777, -0.7781865000724792, -0.4101702868938446, 0.774931788444519, 0.5377013087272644, 0.3382035493850708, 0.4062962532043457, 0.20838674902915955, -0.7511599659919739, -1.6446398496627808, -0.04055004566907883, 1.7735809087753296, 1.4474974870681763, 0.0015542799374088645, -1.306888222694397, 0.475982666015625, -0.8328532576560974, -1.0355862379074097, 0.3105166554450989, 1.5472925901412964, 0.1519278585910797, -0.38545483350753784, 0.2576889097690582, -0.6782562732696533, -1.21970534324646, 0.15682798624038696, -17.68878173828125, -1.6243798732757568, -0.6978943347930908, 0.3514051139354706, -0.1255016326904297, 0.3267347514629364, 0.6052844524383545, -0.1590433567762375, -0.28607794642448425, 0.15484708547592163, -0.8476271033287048, -18.48040008544922, 0.992392361164093, -0.17992645502090454, 0.5546315312385559, -0.8057576417922974, -0.7111413478851318, 0.27621954679489136, -0.15420858561992645, 1.0491560697555542, -0.2887669503688812, 0.714509904384613, 2.086008071899414, 1.0160568952560425, 0.7278507351875305, -0.7935178875923157, 1.321682095527649, -0.31209269165992737, 1.2296608686447144, -0.5092487931251526, -1.8001086711883545, 0.5065715909004211, -0.9296392798423767, -0.4705468714237213, -0.450061559677124, 1.174973487854004, -0.38533154129981995, -0.11026748269796371, -2.377784013748169, 1.8371105194091797, 0.20793674886226654, 1.1918940544128418, 0.4893058240413666, -1.079595923423767, 0.42174625396728516, 0.9930372834205627, 0.24691474437713623, -1.0034939050674438, -0.295966237783432, 0.6490249633789062, 0.74452143907547, 0.9255961179733276, 0.3652676045894623, -2.1806581020355225, -1.573177456855774, 1.4450488090515137, 0.3481215834617615, 0.5551604628562927, -0.3919450640678406, -1.3154048919677734, -0.36773067712783813, -0.09180362522602081, 0.6685121059417725, -0.9206292629241943, 2.0572030544281006, -1.3375929594039917, 1.9689433574676514, 1.636672019958496, 0.9563421010971069, -0.8903577923774719, 0.48069775104522705, 0.714354395866394, -1.0945488214492798, 1.720470666885376, -0.5284701585769653, 0.9851301908493042, -0.7820979356765747, -0.6584305167198181, 0.751590371131897, 1.0809680223464966, 0.0713401511311531, -2.714054584503174, 1.5848642587661743, -0.48084938526153564, -0.1950523853302002, -2.4062323570251465, 1.3321781158447266, 0.24272017180919647, 1.1856253147125244, -0.5046140551567078, 0.5617100596427917, 0.6351315975189209, 0.3272918462753296, -8.63271713256836, 0.3120584785938263, 0.433687686920166, -0.5225779414176941, -9.63778018951416, -1.9300737380981445, -1.395961046218872, 1.3522876501083374, -1.1455764770507812, 1.871329665184021, 0.9556055068969727, -0.38365212082862854, -0.05679599568247795, 0.5027085542678833, -0.9312928318977356, -0.6049668192863464, -1.3873244524002075, -0.25923123955726624, -1.474943995475769, 0.32233431935310364, -0.9227566123008728, -1.0589202642440796, 0.4018787741661072, -0.6275861263275146, -0.2554340958595276, -0.3865153193473816, -0.3402632176876068, 0.9757081270217896, 0.5386762022972107, 1.144869327545166, -0.009907171130180359, -0.4492989480495453, 0.30730584263801575, 0.2528379559516907, -0.07145872712135315, -1.8564921617507935, -0.9903160929679871, 1.449090838432312, 1.2542698383331299, -0.14999371767044067, 0.756141722202301, -0.988964855670929, 0.5560907125473022, 1.7225345373153687, -1.313504934310913, -0.4798528254032135, -1.851694107055664, -2.536792039871216, -0.2833492159843445, 1.3383780717849731, 1.208353042602539, 1.5850768089294434, 0.975443959236145, 1.8928745985031128, -0.0779191330075264, -0.9501805901527405, -0.6668849587440491, 0.24569815397262573, 0.10261604934930801, -0.27412641048431396, 1.049669861793518, -1.5270373821258545, -16.555545806884766, 1.5236058235168457, 1.0709689855575562, -0.47718632221221924, -1.5688496828079224, 0.3628869354724884, 0.3491596281528473, -2.341299533843994, -0.4635755121707916, -1.8166100978851318, 0.2912503480911255, 0.8249494433403015, 1.891697883605957, -14.13697624206543, -0.9318851828575134, 2.732956647872925, 0.18393541872501373, -0.8581054210662842, 0.28514763712882996, 1.6945873498916626, -1.2541266679763794, 0.6158757209777832, -2.6760151386260986, -0.02654569037258625, 1.3870435953140259, 0.6651208996772766, 0.440669447183609, 2.054332733154297, 0.4732533395290375, 1.3265336751937866, -0.5780155062675476, 1.0294849872589111, 1.3138023614883423, 0.1236850917339325, -0.8734272718429565, 0.5216870307922363, 0.40526145696640015, -1.7804031372070312, 0.42995893955230713, 2.3188278675079346, -0.9045697450637817, -0.35995835065841675, -0.43122240900993347, 0.4354318678379059, -1.2191975116729736, -0.582687258720398, 0.5666539669036865, 1.1317603588104248, -2.347419500350952, -0.5929030179977417, -1.6753724813461304, -0.47017309069633484, -1.1294077634811401, -1.6177488565444946, 1.737892985343933, -0.07061543315649033, -0.49465441703796387, -1.0978721380233765, -1.2479020357131958, 0.579322338104248, 0.6117019057273865, -0.17980287969112396, 0.10182101279497147, -0.8570054173469543, 0.6969802379608154, -3.3973796367645264, 1.5719692707061768, 1.8220865726470947, -0.15468502044677734, 0.692903459072113, -0.20346136391162872, 0.3402431309223175, 0.6851188540458679, 1.0033559799194336, 0.25565773248672485, -17.551660537719727, -1.1231187582015991, -1.7658491134643555, 0.6836843490600586, -0.09327664226293564, -0.7927486896514893, 0.2969335913658142, 0.8689334988594055, 0.07719546556472778, -0.60657799243927, 0.4797537624835968, 0.30627623200416565, -0.1813601851463318, 0.21057212352752686, 0.4829871654510498, -0.29848429560661316, -0.1946725845336914, 1.9129509925842285, 0.04311142861843109, 0.6757611036300659, 0.5900170207023621, 1.9361557960510254, -0.8819527626037598, 0.2630491256713867, -0.32421353459358215, -0.7416873574256897, 0.03801117464900017, -0.8422570824623108, -0.8802772760391235, 0.526776909828186, -0.5300173759460449, 0.046918660402297974, 0.5835791230201721, 0.06044864282011986, -0.03229252249002457, 0.01152496226131916, -1.4099135398864746, -0.3587759733200073, 0.3882387578487396, 1.648189663887024, 0.9655547738075256, -0.4172990620136261, 1.0962326526641846, 1.3549200296401978, 0.647868275642395, 1.3742644786834717, -0.3355538547039032, 0.531290590763092, -0.7283146381378174, -0.9839438796043396, 0.15423773229122162, 0.4090573191642761, 0.5062742829322815, 1.101725697517395, -0.5192512273788452, 0.6189517378807068, -0.2181977927684784, -1.1105461120605469, 0.6281615495681763, 0.8046212196350098, 1.9061917066574097, 0.4869554936885834, 0.21340195834636688, -0.06276455521583557, -0.13509702682495117, 1.5386848449707031, -1.3860963582992554, 1.5619537830352783, 1.4004981517791748, -0.9704268574714661, 0.7954816222190857, 0.3862946331501007, -0.2737136483192444, -0.06512704491615295, 1.2787353992462158, 0.9740951657295227, 0.1273132562637329, 1.6968238353729248, -0.21221742033958435, -0.0704682394862175, 0.01407607737928629, 1.4157263040542603, -1.748478651046753, -0.030343294143676758, 1.5329188108444214, 0.1295459270477295, 0.7555338144302368, -0.2756985127925873, 0.8167482614517212, -0.22961539030075073, 1.0578993558883667, -0.2841269075870514, -1.7051807641983032, -0.31631678342819214, 0.622871994972229, 0.8862636089324951, 0.37082260847091675, 1.3035632371902466, -1.6916730403900146, 0.02106674201786518, -0.14553457498550415, 1.336930513381958, -0.5815532207489014, 0.821649968624115, 0.789959728717804, -2.3783793449401855, -1.452402949333191, 0.3065665364265442, 0.24794498085975647, 0.2879219353199005, 0.6650593280792236, -0.4677283465862274, -0.7634111642837524, 0.42963743209838867, -0.032515835016965866, 0.01625615358352661, -1.3814244270324707, 0.2703244686126709, -0.5796584486961365, 0.786151111125946, 0.044357724487781525, -1.4012622833251953, 1.4893568754196167, 1.1690175533294678, 0.06779883056879044, 0.5933158993721008, -0.9227010607719421, -0.8230164647102356, -0.0356287881731987, -0.33521077036857605, -1.5847917795181274, 0.401574969291687, 0.5336413979530334, -1.333629846572876, -0.3846014738082886, -0.5823929309844971, -0.9770989418029785, 0.5072863101959229, 0.8622807860374451, 0.022712409496307373, 0.08692825585603714, -0.3274986445903778, 0.2683415412902832, -0.09876793622970581, -0.5113011002540588, -0.14377477765083313, -0.2745492160320282, -0.4230002760887146, 1.6605991125106812, -0.3873354494571686, 0.7060688734054565, -0.09750630706548691, -0.6125768423080444, 0.040544457733631134, -0.5006402730941772, -0.8554370403289795, 0.0873190313577652, -1.1361472606658936, 1.8587087392807007, 0.3811686933040619, -0.7053834199905396, 0.47429463267326355, 0.7457582354545593, 1.1685612201690674, -1.3541486263275146, -1.0990809202194214, 0.1500275433063507, 0.30305254459381104, -0.35590890049934387, -0.2235572636127472, -1.2427244186401367, -12.65786075592041, -0.7408867478370667, 0.034456998109817505, 0.6470891833305359, -0.51402747631073, -0.051295600831508636, 0.414023220539093, -0.2843106985092163, -0.611854612827301, 2.4070563316345215, -1.9100760221481323, -1.5357072353363037, -2.018958330154419, -0.6762449741363525, 0.037274908274412155, -0.6020921468734741, 0.6553258895874023, 0.305675208568573, -0.7068540453910828, -1.6182398796081543, 0.015265834517776966, -0.9406511783599854, 0.31132686138153076, -1.22738778591156, -0.6861801743507385, 0.1783296912908554, 1.2678431272506714, -1.4514343738555908, -0.9503175616264343, -0.48018255829811096, -1.1727020740509033, 0.35109540820121765, 0.7464498281478882, 0.8238241672515869, 0.450074702501297, -1.4109500646591187, -1.2889310121536255, -0.7699221968650818, -1.5307692289352417, 0.23774920403957367, -0.07771093398332596, 0.7041813135147095, 1.9395525455474854, -0.001761731575243175, 0.22280462086200714, 1.0757728815078735, 2.393787384033203, -1.201690912246704, 0.10750351846218109, 1.6287927627563477, -0.1046762615442276, -0.5813273191452026, 0.899783730506897, -0.4647679328918457, 0.6153604388237, -1.344923496246338, -0.9450937509536743, 2.2140491008758545, -0.24963030219078064, -0.5032914876937866, 0.2652854025363922, -16.81472396850586, -0.4756350517272949, 0.7113402485847473, -0.8328512907028198, 0.17580841481685638, 1.6338189840316772, -0.22323040664196014, 1.4692378044128418, -0.16850684583187103, 0.19754184782505035, -1.595724105834961, 0.03009255975484848, 1.0276246070861816, 1.255689263343811, -1.1055618524551392, 1.0406453609466553, 1.234370470046997, -0.0025478946045041084, -0.7914472818374634, -0.7274397015571594, -1.759128212928772, 0.7964094877243042, 0.8784973621368408, -1.2100622653961182, -1.0531880855560303, 1.2671010494232178, -1.47098970413208, 1.0124670267105103, -16.27277183532715, 0.9429258108139038, 0.3543539047241211, -0.3368174731731415, 0.026631223037838936, -0.264556884765625, -0.12332679331302643, 0.68418949842453, 0.5326535701751709, 1.221169352531433, 1.4491039514541626, 0.9974815249443054, 1.008873701095581, -0.9212483167648315, 0.5853275656700134, 0.680463969707489, -0.762165367603302, -0.9082788825035095, -0.8651331663131714, 0.8764491081237793, 0.6322692632675171, -0.4257327616214752, -1.4812343120574951, 0.6692575216293335, 0.35522472858428955, 0.020784063264727592, 0.3926061689853668, 0.5592367649078369, -2.2321250438690186, 0.44866377115249634, -1.5884472131729126, 0.9680243134498596, -0.042712125927209854, -0.04479517415165901, -0.5223777890205383, 0.11090266704559326, 2.8795735836029053, -0.059410255402326584, 1.367696762084961, 1.0104109048843384, 1.0485363006591797, 2.280346155166626, -1.6145436763763428, 0.7226240634918213, -1.0606352090835571, -1.0492459535598755, 2.1789565086364746, 1.049917221069336, -2.12003493309021, -0.1969192624092102, 0.025027424097061157, -1.4242974519729614, -0.07011451572179794, -0.9909799695014954, 0.1936083287000656, -0.47714152932167053, -0.17193001508712769, 1.528804063796997, 1.4526723623275757, 0.23142899572849274, 0.8413364887237549, 0.25608840584754944, 0.1312517672777176, -0.5519106388092041, -1.6724668741226196, -1.38156259059906, -0.12558193504810333, 1.2957631349563599, -0.9844071865081787, 0.2856094539165497, 0.19206856191158295, 0.8077535033226013, -0.1917864978313446, -0.9130072593688965, 0.5451112985610962, 1.0855880975723267, 0.6751934289932251, 0.5115293860435486, -0.7866637110710144, -2.014498710632324, -1.6756293773651123, -16.1190128326416, -0.8957995176315308, -0.6321252584457397, 0.8952350616455078, -1.7079795598983765, 0.46583837270736694, 0.1668320894241333, 0.5923327207565308, -0.2137543112039566, -0.6828585863113403, -0.5758954286575317, 0.5124872922897339, -1.6894354820251465, -0.7290725708007812, -0.8144559860229492, 0.7050476670265198, 0.4893008768558502, -2.182929754257202, 1.27292799949646, -0.06247672066092491, 0.8009005188941956, 0.2561218738555908, 0.8117763996124268, 0.19486039876937866, 0.23540756106376648, -0.31352195143699646, 0.8294742703437805, -0.1739511638879776, 0.052081093192100525, 0.41162678599357605, -0.6452885866165161, -0.1748160421848297, -17.841047286987305, 0.46518006920814514, 1.4374712705612183, -1.605621576309204, -0.746814489364624, 0.41871553659439087, 2.005842924118042, 0.33892789483070374, 0.12383391708135605, -1.204506754875183, 0.48322609066963196, -0.9528567790985107, -1.1776970624923706, -1.5957107543945312, -15.995158195495605, 0.3059085011482239, -1.1981648206710815, -1.0372120141983032, 0.335614413022995, -0.8478152751922607, 1.6385632753372192, 0.33678799867630005, 1.4130855798721313, 0.8152469396591187, -0.22295336425304413, 1.9964346885681152, -0.17147403955459595, 1.0351945161819458, 0.8039893507957458, 0.47053855657577515, 1.0400878190994263, -1.4221049547195435, 0.39339298009872437, 2.476269245147705, 1.3608121871948242, 0.8574216961860657, 1.3060193061828613, -0.4877121150493622, -0.8420104384422302, -0.21766172349452972, -0.1476130485534668, 0.9214089512825012, -1.3684483766555786, -0.2799336612224579, 0.8721266984939575, 0.9733870029449463, -0.4510214626789093, 0.1301327794790268, 1.7030187845230103, 1.4757856130599976, -0.08572908490896225, -0.27936917543411255, -2.1799514293670654, 0.9235376715660095, 0.7374180555343628, -1.5378103256225586, -0.0783860981464386, 0.8235894441604614, 0.7584936022758484, -0.40754595398902893, -0.7514529824256897, -0.45264002680778503, -0.01025415025651455, -0.06798487901687622, -0.08892176300287247, 1.554559350013733, 0.2436915636062622, 1.137917160987854, -0.6013755798339844, 1.2564067840576172, 0.5166884660720825, -0.44693344831466675, 1.2904760837554932, 0.6261120438575745, 1.3044620752334595, 0.2227696180343628, 0.9963104724884033, -0.7709411978721619, -0.2784344255924225, -0.43644392490386963, -0.11753425747156143, 0.74483323097229, 0.6001580357551575, 0.9330437183380127, -0.4621613323688507, 0.43371570110321045, 1.4557440280914307, 0.7685015797615051, 1.4841842651367188, -0.9003505706787109, -1.2768909931182861, 0.4806360602378845, -0.8975182771682739, 0.5874520540237427, -1.7340352535247803, -0.5077062249183655, 1.190496563911438, 0.5600138902664185, 0.7466943860054016, -0.04488654434680939, -1.3145887851715088, -0.722804069519043, 2.3811278343200684, 0.1669309139251709, -0.6201352477073669, -1.1645114421844482, -1.1166659593582153, 0.34250780940055847, 1.3767229318618774, -0.7110116481781006, 0.7190184593200684, -0.07678399235010147, -0.8146811127662659, 0.7209041714668274, 0.895696759223938, 1.084598422050476, -0.2019471526145935, -0.5789644122123718, -0.8840939402580261, 0.6187095046043396, -1.3864963054656982, 2.070247173309326, 1.7565488815307617, 1.4677296876907349, -0.35704877972602844, 2.320906162261963, -0.36335334181785583, -0.08777927607297897, 1.438997507095337, 2.046210289001465, -0.6693236231803894, 1.5056686401367188, -1.442528247833252, 0.7850504517555237, -0.553475022315979, 0.8326556086540222, -0.0836772695183754, 1.0649988651275635, -0.003643062897026539, -2.7051169872283936, -0.05984551087021828, -0.06576738506555557, 0.833958089351654, 1.3557671308517456, -0.3374423384666443, -0.1963731050491333, 0.19842824339866638, 0.5977802276611328, -0.13203245401382446, 0.27870410680770874, -0.5952009558677673, -2.76741886138916, -1.6012834310531616, 0.3394635021686554, 1.6694308519363403, 2.243549108505249, -0.8280346989631653, 1.4482253789901733, -0.9859783053398132, 1.1359801292419434, 0.19358403980731964, 0.00034424697514623404, 0.6478182673454285, 0.11425662040710449, -1.6442830562591553, -3.2436001300811768, 0.17008014023303986, 0.36674079298973083, 0.3181275725364685, 1.4179480075836182, -1.1387507915496826, -0.28027981519699097, 1.1032465696334839, 0.9986934065818787, -0.014459697529673576, -1.296858310699463, -2.2033865451812744, 0.7776454091072083, -0.0779646709561348, 0.3479868173599243, 0.4866902530193329, 0.9375062584877014, 1.9371817111968994, 0.39532092213630676, -0.4601958692073822, -0.5223142504692078, -0.2802289128303528, 0.9544676542282104, -0.9836066365242004, 0.3328557014465332, 0.2569635510444641, 1.5853337049484253, 1.7339459657669067, 1.124327301979065, 0.5836928486824036, 0.17328248918056488, 0.10099083930253983, -1.484749436378479, -0.07502461224794388, -0.7740309238433838, 0.7142006754875183, -0.028070762753486633, -0.1274649202823639, 0.16630563139915466, 0.29330846667289734, 0.009991300292313099, -0.3142090439796448, 2.164044141769409, -0.2787639796733856, 2.0730974674224854, -1.1931761503219604, -1.4785491228103638, -0.2547783851623535, 0.8330868482589722, -1.082543134689331, -2.0119872093200684, 0.7014238834381104, 1.6178847551345825, 0.6112331748008728, 0.7232083082199097, -1.0272164344787598, 0.7205721735954285, 1.2688850164413452, 1.7985633611679077, 0.07439373433589935, -0.6258048415184021, 0.4012311100959778, 0.9112706780433655, -0.16046790778636932, 1.4745912551879883, -0.04451070725917816, 1.0460928678512573, 0.25341930985450745, -0.22225041687488556, 2.3163344860076904, -0.018689151853322983, -1.090415358543396, -1.494855284690857, 1.5369490385055542, 0.7350398302078247, -1.5981546640396118, 0.6086006760597229, 0.6991204619407654, 0.7388693690299988, -0.25497984886169434, 0.04092460125684738, -0.094046950340271, 0.5575379133224487, -0.3047392666339874, -0.9736171960830688, -0.5364423990249634, 0.6701542139053345, -0.6270133256912231, -1.817793607711792, -0.02539786323904991, 0.4445766806602478, -0.6043509840965271, -0.9321532249450684, -0.3684554398059845, 1.3188347816467285, -2.147470235824585, -0.9807696342468262, 0.7160242795944214, -1.1919763088226318, 1.2071247100830078, 1.7753151655197144, -0.7245526313781738, -0.2872799038887024, 0.9234757423400879, -0.14636528491973877, 0.8924117684364319, -1.0945273637771606, 0.32743343710899353, 1.392268180847168, 0.35581785440444946, -1.1224915981292725, 0.07003988325595856, 1.5685561895370483, -0.5784863233566284, 0.9411221742630005, -0.6314911842346191, -1.4099501371383667, -1.6790157556533813, -0.9715328812599182, 0.2605281174182892, 1.072912335395813, -0.32148656249046326, 0.04497804492712021, -0.15955588221549988, 1.2642651796340942, 0.6036859154701233, 0.6972323656082153, -1.1037428379058838, 0.3604259192943573, -0.33086007833480835, 1.5716382265090942, -0.25446826219558716, 1.4697771072387695, 0.6139386892318726, -1.020544409751892, 2.537602424621582, 0.8845472931861877, -1.7031573057174683, 2.3164570331573486, -1.353914499282837, -10.378015518188477, 2.815650463104248, 0.7328245639801025, -0.2879813313484192, 0.8418683409690857, -1.1191067695617676, -1.4463146924972534, -0.24359211325645447, 0.5683329701423645, 0.8327547907829285, 0.5158776044845581, 1.5648314952850342, 1.835124135017395, -0.8047173023223877, -0.29429560899734497, -0.23190566897392273, -0.21611684560775757, 0.5168071389198303, -1.0362200736999512, -0.440332293510437, 0.4190625846385956, 0.30957794189453125, -0.47781386971473694, 2.481504440307617, 0.23530493676662445, 1.3036249876022339, -2.159163475036621, -0.581569254398346, -5.433287620544434, 1.4209409952163696, 0.528868556022644, 0.1241907924413681, -1.0265674591064453, 1.2221848964691162, -1.7742794752120972, 2.076120138168335, 1.3131903409957886, -0.1608954221010208, -0.17757129669189453, -2.8277077674865723, -0.5678718686103821, -1.788385033607483, -0.9937219023704529, -0.752764880657196, -3.037280321121216, 0.05599171668291092, -0.5337303280830383, 0.8946186304092407, 0.7590159773826599, -0.9130062460899353, 0.10859932005405426, 0.7076029777526855, -1.09146249294281, -0.8140619993209839, 0.2421218603849411, -1.5965911149978638, -0.33654335141181946, 0.23827028274536133, 0.32572141289711, -0.03473755344748497, -2.0085337162017822, -1.6713262796401978, -2.0646865367889404, -0.9501588344573975, -2.0937085151672363, -0.3493105471134186, 1.5513554811477661, 2.8225018978118896, 0.7044260501861572, 0.5933002829551697, 2.330284833908081, -0.350949227809906, -3.8495283126831055, -0.029960550367832184, 1.6004738807678223, 0.4136434495449066, 0.5793569087982178, -0.5036476850509644, 2.7832021713256836, 1.0875496864318848, -0.23068654537200928, -0.3102140426635742, -1.8469874858856201, 1.6488765478134155, 0.056168895214796066, -1.2632560729980469, 0.6850100755691528, -1.388835072517395, -0.9959481954574585, 0.7459391951560974, -0.2684158682823181, 0.9559957385063171, 0.42467108368873596, -0.23955221474170685, -1.691096305847168, 0.6897087097167969, 1.0976282358169556, -0.8715881705284119, -0.5778602957725525, 0.9335210919380188, -0.09698528796434402, -1.8375887870788574, 0.022812288254499435, -1.077928066253662, -0.1851189136505127, -0.38787752389907837, 1.671531319618225, 0.2916472852230072, -0.45621758699417114, 0.15477509796619415, -0.5092825889587402, 0.24753594398498535, -0.5241860151290894, 0.04958239570260048, -0.6226125359535217, 0.3963027596473694, 0.0696180909872055, -0.41744813323020935, -0.8592033982276917, 0.3856823444366455, 0.5560957193374634, -0.8068913817405701, 0.2790158987045288, -0.7129802107810974, -0.17531628906726837, 2.0369060039520264, -1.8029893636703491, 1.5662579536437988, 0.15087324380874634, 1.5248433351516724, 1.0311506986618042, 0.12273179739713669, -0.06446129828691483, 0.7943485975265503, 0.7219656109809875, 0.429450660943985, -0.47537723183631897, 1.8052990436553955, -1.0725960731506348, 0.1880982369184494, -0.8828526139259338, 0.10751473158597946, -0.506808340549469, -0.6035768389701843, -1.114205002784729, 0.13896918296813965, 0.3404039442539215, -0.574296236038208, 0.14585141837596893, -1.3629764318466187, 1.0821032524108887, 2.3850715160369873, 0.15888796746730804, 0.2881679832935333, -1.3206462860107422, 0.24685414135456085, -0.0028596254996955395, -0.9693610072135925, -1.0902482271194458, -0.3112451136112213, 0.6642235517501831, 0.23652541637420654, 0.4780943989753723, 0.33063989877700806, 0.5106430053710938, -0.8584216833114624, -1.6349581480026245, 0.03824375942349434, 0.17019903659820557, 0.7222962975502014, 0.04280532896518707, -0.6173800230026245, 0.5227164626121521, 1.2668834924697876, 0.42091789841651917, 1.4242950677871704, -0.0756620317697525, 0.8512700200080872, -13.035858154296875, -0.5484738349914551, 1.340429425239563, -1.8342939615249634, -0.5822285413742065, -14.395211219787598, -0.24219103157520294, -0.30885323882102966, -0.5169720649719238, 0.02916080877184868, 1.679809331893921, -0.49800407886505127, 0.8072046041488647, 0.05431241914629936, -0.6489418745040894, -0.4586397707462311, -0.16002821922302246, -0.7214706540107727, -0.6242067217826843, -1.0067099332809448, 0.9090010523796082, -0.7896755933761597, -1.223612904548645, 0.1937488168478012, 0.6677128672599792, 0.2522946298122406, -0.09466107189655304, -0.6786940097808838, 1.1850227117538452, 0.1540394127368927, 0.4015050530433655, -1.198108434677124, 0.4012439250946045, -1.2102842330932617, -0.6701326966285706, -0.8988478183746338, 1.1040626764297485, 0.902169406414032, -0.891193151473999, -0.9487868547439575, -1.7172187566757202, 0.7706246972084045, 0.2017737627029419, -0.397836297750473, 0.22104600071907043, -0.17315040528774261, -0.43517133593559265, 2.789371967315674, -0.4947224259376526, 2.1381988525390625, -0.1334267556667328, -2.316788673400879, 0.9174936413764954, 1.379286289215088, -0.9487485885620117, 0.8908724784851074, 0.032758768647909164, 1.4348994493484497, 1.1514085531234741, 0.1770613193511963, -0.1355336457490921, -8.528979301452637, -0.030753016471862793, 0.2829327881336212, -0.5718193650245667, -0.9413595199584961, 0.09313500672578812, 1.5108909606933594, 1.1195300817489624, 1.9688118696212769, 0.3853084444999695, 0.24633657932281494, -0.1264820396900177, 0.0491187646985054, 0.1171201840043068, -2.2252190113067627, -0.07937432825565338, 1.6214256286621094, -0.2237236499786377, 0.7718801498413086, -0.06230146810412407, 0.540649950504303, -0.7543508410453796, -2.0481557846069336, -0.8805294036865234, -0.6706892848014832, 1.5336519479751587, -14.976629257202148, -0.4306672215461731, -1.3345446586608887, -0.09574656188488007, -0.0631290078163147, -0.09476922452449799, 1.3543332815170288, 0.4976467192173004, -0.12491096556186676, 0.684242844581604, 0.09167739748954773, 1.8080880641937256, -0.18669475615024567, 1.1828924417495728, -0.6292058825492859, -0.42312872409820557, -0.33301424980163574, -0.35450229048728943, 0.5073098540306091, 0.36232373118400574, -1.6447889804840088, -0.21958909928798676, 1.5666335821151733, 1.403896689414978, -1.7889955043792725, 0.4854350686073303, -0.3794035315513611, 0.7633276581764221, -0.39117223024368286, -2.1034185886383057, 1.7694284915924072, 0.31606751680374146, 0.1720627099275589, 0.35632428526878357, 0.10686042159795761, -1.6658391952514648, -0.4720253050327301, -14.066549301147461, 1.862431287765503, -0.020748263224959373, 1.186438798904419, -0.053098734468221664, -1.1223556995391846, 0.6722441911697388, -1.1477198600769043, -0.7559611201286316, 0.5350112318992615, -0.06506924331188202, 1.0160545110702515, 0.013905627653002739, -0.7726896405220032, 1.0372580289840698, 0.22857694327831268, -0.14428403973579407, 0.16219563782215118, 0.8546177744865417, -0.0029818438924849033, 0.07215508073568344, -1.1474395990371704, -0.13490192592144012, -1.6201989650726318, -1.0758795738220215, -1.1990020275115967, -0.26391512155532837, 0.31985703110694885, 0.31163179874420166, -0.10845039039850235, 1.2694720029830933, 0.07296031713485718, -0.24907273054122925, 0.05222496762871742, 1.5927375555038452, -0.5503891706466675, 17.654451370239258, -0.32949602603912354, 2.0230350494384766, 0.36366552114486694, -1.8993747234344482, -0.1630266010761261, -0.05467938631772995, 1.115005612373352, -13.109701156616211, 1.0954816341400146, -0.6118172407150269, 1.3035340309143066, 0.10535354912281036, -0.305643767118454, -0.47870203852653503, 0.280754029750824, 0.43934541940689087, -0.5638266205787659, -2.5092289447784424, 0.45033231377601624, -0.8232510685920715, -0.607451856136322, -0.1402508169412613, -0.20493027567863464, -0.35434454679489136, 1.213202714920044, 0.7718878388404846, -0.6896661520004272, -0.894406259059906, 0.061743900179862976, 1.126186490058899, -0.5950273275375366, 0.4011070728302002, -1.8809897899627686, -0.7321900129318237, 1.633370280265808, 1.2150603532791138, -1.0372966527938843, -0.9410250782966614, -0.4209635853767395, -0.05703616514801979, -1.0543177127838135, -1.2701748609542847, 0.2601165175437927, -0.15998044610023499, 0.6695264577865601, -0.4947260320186615, 0.5982447266578674, -1.1181352138519287, -0.8558754920959473, 1.2345069646835327, -1.8866870403289795, 2.286816120147705, 1.0825996398925781, 0.17978574335575104, -0.9339504837989807, 1.9441200494766235, 0.9553858041763306, 0.5414735674858093, -0.18554240465164185, -0.08535893261432648, 0.6493269205093384, 0.13637638092041016, -1.4415183067321777, -0.9448647499084473, 0.13010573387145996, 1.3937077522277832, -0.09139358997344971, -1.9775652885437012, -0.6902911067008972, -0.29119911789894104, -0.4073745608329773, 0.39427638053894043, 0.22448068857192993, 1.5178422927856445, -0.8654325008392334, 1.7306067943572998, -0.2161431461572647, 0.5929462313652039, -0.998562753200531, 0.09069707244634628, -1.329700231552124, 0.3325282335281372, -1.1582615375518799, -0.086154505610466, 0.6415342092514038, 1.2859805822372437, 0.20250403881072998, 0.5200018882751465, -0.5138454437255859, 0.35696032643318176, 0.4212842583656311, 1.5117391347885132, 1.282814860343933, -0.7025047540664673, 1.6587698459625244, 0.027712173759937286, 0.5884730219841003, 1.560989260673523, -1.3832226991653442, -1.0168832540512085, -0.986527144908905, -15.616085052490234, -1.195932388305664, 1.5562121868133545, -0.5910977125167847, -0.0803278312087059, 1.0250804424285889, 1.2890678644180298, 1.343786597251892, -0.5825350284576416, 1.0040615797042847, -0.34046900272369385, 1.6401185989379883, 0.576945424079895, -1.0398982763290405, 0.03183569759130478, 1.202683448791504, -0.7917919158935547, -1.4305193424224854, -0.8436723351478577, 0.19243191182613373, -0.9080973863601685, 0.41194942593574524, -0.5918930172920227, -0.016402101144194603, -0.8484784364700317, 1.7396475076675415, 0.37869104743003845, -0.5124624967575073, 0.6521408557891846, -1.3678990602493286, -1.1515439748764038, 2.490232229232788, 1.168036937713623, -0.43216732144355774, 1.2971546649932861, -0.5716459155082703, -0.6945483684539795, 0.17257602512836456, -0.37215593457221985, -0.056403134018182755, -0.8163371086120605, 1.0243500471115112, -1.5736056566238403, 0.09937037527561188, -1.6000322103500366, 0.5962218046188354, 1.0127381086349487, 1.0177726745605469, -8.537287712097168, 0.7434054017066956, 1.3574084043502808, 1.25550377368927, -0.5816182494163513, -1.2965337038040161, 0.3532499074935913, -1.073146104812622, 0.10436688363552094, -0.7650768756866455, -2.059004545211792, 0.646730899810791, -0.6649861931800842, -0.4549941122531891, -0.6329873204231262, 1.7939516305923462, -2.816739082336426, -0.7044534683227539, 0.5675078630447388, 0.8222969770431519, -0.9015437960624695, -0.21509253978729248, -1.9019112586975098, 0.95953369140625, -0.09633567184209824, -0.6322488784790039, -0.669911801815033, 0.7206664085388184, -1.0647083520889282, -1.2252411842346191, 0.17738905549049377, 0.7078015208244324, -0.32561081647872925, 0.597207248210907, -2.114741802215576, 1.475508213043213, 0.20737779140472412, -0.9283602237701416, 0.20439264178276062, 0.3790736794471741, 0.306873619556427, -0.3203161954879761, 0.1920856088399887, -1.233883023262024, 1.1247987747192383, 0.7667765021324158, 0.12624159455299377, 0.0810849517583847, 1.758081316947937, 0.518388569355011, 0.5950789451599121, 1.1666510105133057, -0.15198160707950592, 1.4171665906906128, 3.2120416164398193, -0.9335529804229736, 0.9220122694969177, -1.0696237087249756, 0.3414382338523865, -1.9705979824066162, 1.3305031061172485, 1.0418074131011963, -0.3065810799598694, -0.54291832447052, 1.3716752529144287, 0.28641003370285034, -0.3895299732685089, 0.7069809436798096, 2.195507049560547, -1.1988015174865723, 0.8874413967132568, -0.3337860405445099, -0.9457858800888062, 0.977327287197113, 1.0391780138015747, -2.7172675132751465, -1.0479652881622314, 1.703545331954956, -1.8857994079589844, 0.7434396743774414, -0.22589921951293945, 0.5080916285514832, -0.7942342758178711, -0.7158393859863281, 0.6265300512313843, -0.33986514806747437, -0.38339826464653015, 0.2608870565891266, 0.3786708116531372, 0.10844673961400986, 0.30154114961624146, 1.0136983394622803, 1.4352492094039917, 0.509244978427887, 0.6342450976371765, 0.6975390911102295, -0.24401986598968506, 1.0945762395858765, -1.0535699129104614, -0.345050185918808, 0.5153366923332214, 0.06146484240889549, 1.9911527633666992, 0.4812977910041809, 0.008555023930966854, 0.48025912046432495, 0.8199244141578674, 0.8867685198783875, 0.9009782671928406, -2.026609420776367, 0.18357013165950775, -2.8296959400177, 2.0732791423797607, -0.3791671097278595, -0.19618579745292664, -0.5270445346832275, -0.2277485877275467, 0.48678404092788696, 0.20635397732257843, -1.4937849044799805, -1.520634651184082, 0.3571586310863495, 0.23143036663532257, 0.6613379716873169, -0.9919701218605042, -0.0036317193880677223, -0.39521607756614685, 0.8691772818565369, 0.9167015552520752, 1.2709802389144897, 0.4912343919277191, -0.5811675190925598, 0.372188925743103, -0.4690937399864197, 1.7639840841293335, 1.0055655241012573, 0.8153069615364075, 1.1979727745056152, 0.07230478525161743, -0.2838611304759979, -0.09414654970169067, -0.17530639469623566, 0.3677337169647217, -1.0603389739990234, 0.15675923228263855, 1.9492597579956055, 0.5237636566162109, -0.8631822466850281, -11.874322891235352, 0.6379782557487488, 1.828825831413269, -1.0120792388916016, -0.4765055775642395, -0.05846289545297623, -1.3966317176818848, -0.8646023869514465, 1.8977097272872925, 1.353115200996399, -1.5334625244140625, -0.8815521597862244, -0.15798012912273407, -0.058337870985269547, 0.532469630241394, 1.5556018352508545, 0.939849317073822, -0.49883103370666504, 0.9025881290435791, -0.3857099413871765, -0.5224379301071167, -1.8398271799087524, -2.1516895294189453, -1.0726217031478882, -0.032650209963321686, 0.21180963516235352, 0.03989814594388008, -2.2702670097351074, 2.0250144004821777, 1.1389107704162598, -0.6634626388549805, 1.451834797859192, -0.6886111497879028, -0.22495216131210327, 0.46994081139564514, -0.13183219730854034, -10.68085765838623, 1.705812931060791, 2.4371471405029297, 0.03659787029027939, -1.2681840658187866, 0.2993476688861847, 0.9006182551383972, -2.5290324687957764, 1.969557762145996, 0.2336641401052475, -2.621241807937622, -1.3490240573883057, -1.0380618572235107, -0.26493528485298157, -1.2399587631225586, 2.094379186630249, -0.9386415481567383, 1.3708484172821045, 0.5132824778556824, -0.23952452838420868, 2.829627752304077, 0.9184777140617371, -0.6117316484451294, 1.4034119844436646, -1.3066439628601074, -0.9897106885910034, 0.8861128687858582, -1.7173433303833008, 1.0813006162643433, -0.44475921988487244, 0.291791170835495, 1.3480756282806396, -1.5808035135269165, 0.36117061972618103, -0.39915093779563904, 0.7748870253562927, 0.02196236327290535, 0.808763861656189, -0.37516021728515625, 0.8324567675590515, -1.8867981433868408, 1.8456076383590698, 0.006246994249522686, 0.39245906472206116, -0.4499349296092987, -0.7608712315559387, 1.4366445541381836, 0.4797314405441284, 1.2725962400436401, 0.770415186882019, 2.3158822059631348, -1.2942320108413696, -0.5230917930603027, -0.060336604714393616, -17.262590408325195, 0.2358059585094452, 0.44950518012046814, -0.6680936217308044, -1.0465143918991089, -0.46627506613731384, 2.601900100708008, 0.3522307574748993, -0.43491077423095703, 0.44225186109542847, 0.18784479796886444, -0.16664060950279236, -0.40807926654815674, -0.030797472223639488, -1.4427006244659424, 1.8951914310455322, -2.453676462173462, 0.6833840608596802, 0.7280128002166748, 0.09816546738147736, -2.8006484508514404, 0.7583257555961609, 2.1683781147003174, -1.0402206182479858, -0.27723243832588196, 1.0004363059997559, 0.4058937132358551, 1.5861258506774902, 0.04444229602813721, -0.9595088362693787, -0.35009944438934326, 0.04174785315990448, -1.110657811164856, -0.8913745880126953, -1.3062598705291748, 0.3104453980922699, -1.6932774782180786, 1.1429738998413086, -0.8669798374176025, -0.07972117513418198, -0.3884810507297516, 1.8499462604522705, -2.2935118675231934, -2.099231004714966, -0.8037652969360352, 0.438490629196167, 0.6817114353179932, 1.5372031927108765, -1.037184715270996, -2.68843412399292, 0.029729895293712616, 0.6439306735992432, -0.2949749231338501, 0.06198018044233322, 0.6057364344596863, 0.48707306385040283, 0.33853623270988464, 0.03353973850607872, 0.2692946195602417, 1.0887633562088013, -0.025638630613684654, -0.15723833441734314, -0.32857993245124817, -1.4267617464065552, -0.8466893434524536, 0.18526354432106018, 0.37843871116638184, 0.8204169273376465, -1.263515830039978, 0.1337158977985382, -14.703717231750488, 0.03464154154062271, -0.2942408323287964, 0.949377179145813, 1.0656063556671143, 0.980219841003418, 1.0590176582336426, -1.887660026550293, 1.673553228378296, 1.095031976699829, 0.1254546046257019, 1.0642516613006592, 0.4628940224647522, -0.3368959128856659, 0.8888725638389587, -0.6418585181236267, -1.0775847434997559, 0.061481229960918427, -0.21802808344364166, 1.2205787897109985, -2.7521138191223145, -0.0763612762093544, 0.2510630488395691, -1.4967186450958252, -1.5163602828979492, 0.6181238889694214, -0.9156143665313721, 0.6192349791526794, 0.673225462436676, 0.832312285900116, 0.3664748966693878, -0.6315797567367554, 0.9274417757987976, 0.4650891125202179, 1.0079208612442017, 1.1135789155960083, -0.5551636219024658, -0.43321046233177185, 0.8271651864051819, -13.358097076416016, -0.30065596103668213, -0.20922382175922394, -0.5492241978645325, 1.147196888923645, 0.5248516201972961, -1.1587306261062622, -2.3946309089660645, 1.4031367301940918, -0.7095744609832764, -0.8379448056221008, 0.014636813662946224, 1.0228456258773804, 1.439949870109558, -0.8192696571350098, 0.7681215405464172, -1.1877321004867554, 0.8651378750801086, -0.9717968106269836, -2.124981164932251, 0.6493049263954163, -0.7810777425765991, 0.6589838266372681, 0.5480828285217285, 1.2455652952194214, -0.8006664514541626, -0.026155348867177963, -0.939895510673523, 0.6888488531112671, 1.9560863971710205, 1.7880043983459473, -0.15943260490894318, -0.014856056310236454, 0.4859602749347687, 1.867674469947815, 0.12963111698627472, -0.546897828578949, -1.0576752424240112, -0.109074167907238, 0.760177493095398, 1.6701346635818481, -0.2398177534341812, -0.44233274459838867, -0.7103861570358276, 0.1658346801996231, -0.17658893764019012, -17.71272850036621, -0.07871290296316147, -0.8339056372642517, -0.8376621007919312, -0.9907053709030151, 0.10343385487794876, 0.023988977074623108, 0.11007966101169586, 0.3371148109436035, 0.7046290636062622, 0.9184283018112183, -0.8428018689155579, -0.5823182463645935, -0.4474068880081177, -0.7202632427215576, -4.00836706161499, 1.1784884929656982, 0.823794424533844, -0.4540175199508667, 1.6336270570755005, -0.48928508162498474, -0.2623986601829529, -0.36412885785102844, 0.3599531650543213, 0.980114758014679, -1.422319769859314, -0.9408910274505615, 0.053181201219558716, 1.852401852607727, -0.25005069375038147, -0.01865793764591217, -1.0440806150436401, 0.6152093410491943, 3.2362136840820312, -0.5908492207527161, -0.886317789554596, -0.0648660808801651, 0.4047950208187103, 1.190183162689209, 0.26027506589889526, 0.7767653465270996, -1.9637037515640259, -0.5915114283561707, -0.09389512985944748, -1.76845383644104, -1.1382228136062622, 0.12791016697883606, -0.00883052870631218, -1.0569487810134888, -0.9579132795333862, -0.8632407188415527, -0.2618480920791626, -0.396801233291626, -18.178020477294922, -0.9774775505065918, -0.366274893283844, 0.7461230754852295, -0.600890576839447, -1.7841830253601074, -0.47392019629478455, 0.603165864944458, 0.5163179039955139, -10.992321014404297, 0.05847696587443352, -0.592343270778656, 1.5862246751785278, 0.8122441172599792, 1.881186604499817, -0.0818980261683464, 0.4402371942996979, -2.6661839485168457, 0.9894747734069824, -0.054225511848926544, 0.12464079260826111, 0.6589090824127197, 2.2001771926879883, 0.313066691160202, 0.7375079989433289, 0.41681814193725586, 0.6376863718032837, 2.157684564590454, -1.2273969650268555, 1.1872786283493042, -0.4573284685611725, 0.9494034647941589, 0.7902413010597229, 1.2716025114059448, -0.462176114320755, 0.22423149645328522, 0.5235453844070435, 0.03857520967721939, -0.6611140966415405, -0.12166392803192139, 0.03991016000509262, 0.8005797266960144, 0.1749304234981537, -0.622341513633728, -0.8815299868583679, -0.2119225114583969, -0.23364098370075226, -0.7931767702102661, 0.15945646166801453, -17.028030395507812, 0.005897479131817818, 0.5356499552726746, 0.42887505888938904, 0.7870733737945557, -0.7234447598457336, -0.9870204329490662, -0.0773141160607338, 0.9821524024009705, 1.1649806499481201, -0.12016602605581284, -2.43200421333313, -1.0437577962875366, -0.11741319298744202, 0.9171713590621948, -0.7017033100128174, 1.222437858581543, 0.7034915685653687, 1.9196767807006836, -0.8819275498390198, 0.21667349338531494, 1.2941006422042847, -0.27463066577911377, -1.1863218545913696, -1.1033430099487305, -9.332086563110352, 1.4458307027816772, 0.25789228081703186, 0.535156786441803, -2.0031635761260986, 1.0826808214187622, -0.3361513316631317, 0.5581792593002319, 0.03784014284610748, 0.5145555734634399, 1.3542276620864868, 0.506960928440094, -0.731766402721405, 1.2969634532928467, 0.6230394244194031, -0.374491810798645, -0.5775874257087708, -1.060779333114624, 0.9071971774101257, -0.7867053747177124, -0.7898997664451599, -0.7902092337608337, -0.30557358264923096, 1.4898964166641235, -0.13154630362987518, 0.36201420426368713, -11.6278657913208, -0.7838272452354431, 0.5117935538291931, 1.4351812601089478, 3.589482069015503, 0.5996702313423157, 0.009487634524703026, 0.7710534334182739, -0.15626490116119385, 0.9651121497154236, -0.6725803017616272, 0.040934979915618896, 1.0634393692016602, -1.0089812278747559, 1.3621327877044678, 0.8973782658576965, 0.027787597849965096, -0.4637056887149811, -0.2552837133407593, 0.26068222522735596, 1.768730640411377, -0.09331463277339935, 1.2852144241333008, 1.9812726974487305, -0.1229957565665245, -8.998945236206055, 0.9613778591156006, -0.5659896731376648, -0.1479998379945755, -0.5458599328994751, 0.6614067554473877, -0.6111403703689575, -0.9215565323829651, -0.8023243546485901, -1.3198460340499878, 0.7303836941719055, 0.28218385577201843, 0.01903741993010044, 0.5154340267181396, 0.8165992498397827, -1.4467154741287231, -13.183234214782715, -0.46268683671951294, 1.672405481338501, -0.14179681241512299, -0.8717766404151917, 0.7382022738456726, 0.6462942957878113, 1.059098243713379, -0.12975145876407623, -1.6001648902893066, 1.37491774559021, -0.9902151226997375, 0.9252652525901794, -1.6897380352020264, 0.45038798451423645, -1.3305766582489014, -0.7576790452003479, 0.1494760364294052, 0.7529374361038208, 1.2413376569747925, 1.0127135515213013, 0.9586888551712036, -0.8108838200569153, -2.5177032947540283, -0.2921208143234253, 0.42712390422821045, -0.3690865635871887, -0.8415383696556091, -1.3813799619674683, -0.05412294715642929, -1.3543334007263184, -0.6816694140434265, 0.28382015228271484, -0.7125266790390015, 0.6809104681015015, 1.8081843852996826, -0.5256606936454773, 1.2910276651382446, -2.8103644847869873, -0.007727497722953558, -1.5950288772583008, -0.016249587759375572, 1.2788645029067993, 0.8427976369857788, 0.8032383322715759, -1.419708490371704, 0.21402595937252045, 0.13663731515407562, -0.7478765845298767, 0.8583692908287048, 0.8433430194854736, 0.44367989897727966, 0.05933360382914543, 0.27476394176483154, -0.47082504630088806, -0.6086178421974182, 1.4247770309448242, 1.044184684753418, 0.27080950140953064, -0.9133725762367249, -0.2002360224723816, 1.3023815155029297, 0.2640337347984314, 1.3978850841522217, -2.4831926822662354, 0.17869111895561218, -1.3552063703536987, -0.6490508317947388, 1.4834926128387451, 1.1455827951431274, 0.6718537211418152, 1.4731433391571045, 0.3169265687465668, 1.3375550508499146, 0.966291069984436, 2.2469418048858643, 0.608099102973938, 0.35112494230270386, -0.49248236417770386, 0.32013359665870667, -0.5333873629570007, -2.706244707107544, 0.2822834849357605, 0.4001067280769348, -1.6755260229110718, 0.33172377943992615, -1.258212924003601, 0.44957679510116577, -0.35861778259277344, -0.2339956909418106, 0.1301838755607605, -0.09033642709255219, 0.987113356590271, 0.1525719165802002, 0.6331485509872437, 0.26770463585853577, 0.1216874048113823, -1.213758111000061, -0.9156219959259033, -0.7004855275154114, -0.3114033043384552, -1.6661114692687988, 0.2788669168949127, -0.6388514041900635, -1.1861014366149902, 0.0015040644211694598, 0.006108640227466822, -0.1413079798221588, -0.7120456695556641, -1.6792235374450684, -1.002279281616211, -0.602512776851654, -0.9231656789779663, 1.0999276638031006, -0.6823145747184753, 0.7205862998962402, -0.5939916372299194, 1.6157293319702148, -0.13535518944263458, -11.591750144958496, -0.34134742617607117, 1.7528249025344849, 1.308028221130371, -0.19935105741024017, -0.4654484987258911, -2.1405692100524902, -0.11464904248714447, 0.2545086741447449, 1.6193416118621826, 1.611379861831665, -3.045799970626831, 0.200917050242424, 1.4972009658813477, 0.3802821934223175, 0.6186553239822388, 1.1586490869522095, 0.6650059819221497, -0.060789208859205246, 0.019895093515515327, -2.2126572132110596, 0.2729663848876953, 1.333056092262268, -0.015412886627018452, 0.10189667344093323, -1.644769549369812, -4.416031837463379, -0.7558957934379578, 0.06842377036809921, -0.5892367959022522, 0.3151935040950775, 1.942173719406128, 0.2508658170700073, 1.0734959840774536, 0.988368570804596, -1.3014321327209473, -1.6809593439102173, 0.3224863111972809, 0.13087302446365356, 0.47470858693122864, -0.39842697978019714, -0.8063485026359558, 2.6841530799865723, 1.3365929126739502, 0.2819811999797821, -1.4120151996612549, -9.753790855407715, 0.9397339224815369, -0.3843245506286621, -0.2943519651889801, -0.29341042041778564, 1.6760634183883667, 2.5923261642456055, -0.6896306872367859, 0.42720454931259155, -0.0950261801481247, 0.9743184447288513, 0.10570753365755081, -1.5005143880844116, 1.9842597246170044, 0.840787947177887, -0.13817238807678223, 0.09227923303842545, 0.06360599398612976, -0.4867922067642212, -1.2949665784835815, -0.15764589607715607, 0.0009439492132514715, 0.10398363322019577, -0.9455431699752808, -0.44982680678367615, 1.0367921590805054, 0.021096521988511086, -0.061760064214468, 0.19567517936229706, -0.6506775617599487, 0.6867721676826477, 1.0509916543960571, 1.288507342338562, -0.5204434990882874, -1.3244214057922363, -0.19473925232887268, -1.8324904441833496, -0.4944448471069336, -1.3192551136016846, -0.652898907661438, -9.334442138671875, -0.25213488936424255, 0.6400492191314697, -3.4672858715057373, -0.47468140721321106, 0.3361824154853821, -0.20823362469673157, -0.6683828830718994, -1.193593978881836, -0.32731491327285767, 1.004419207572937, -0.5275686979293823, -0.317466676235199, 0.10949072241783142, -0.12290702015161514, -1.3155577182769775, 0.366690456867218, 0.771801769733429, 0.44662413001060486, -1.5276638269424438, -1.3230669498443604, 0.20462195575237274, 1.8637510538101196, 0.14475853741168976, -1.1575771570205688, 0.4982936382293701, 1.1362082958221436, -0.915822446346283, -2.0589284896850586, 0.23083434998989105, -0.21585200726985931, 0.8680292963981628, 1.0821572542190552, -0.6637921333312988, 0.3594973683357239, 0.43652600049972534, -1.0417991876602173, 0.4782133102416992, -0.3308417499065399, 0.07928723096847534, 0.3300573527812958, 0.6143463253974915, -0.16104091703891754, -0.08327235281467438, -0.9025706648826599, 2.0935311317443848, 0.25402209162712097, 0.11729621887207031, 1.1430819034576416, -0.017969880253076553, -0.07272127270698547, -1.0794461965560913, -16.385643005371094, -2.1354007720947266, 0.7724785208702087, 1.3257800340652466, -0.49635976552963257, -0.8218998312950134, -0.1938534379005432, -16.838359832763672, -1.291990041732788, 0.3394698202610016, -0.8392615914344788, 0.7495627999305725, -0.436113566160202, 0.018475987017154694, -2.1119918823242188, -0.2827478349208832, -1.5352637767791748, 1.4986728429794312, 0.011971302330493927, 0.6356011629104614, -0.9305954575538635, -0.6863175630569458, -0.5862239599227905, 0.1491260826587677, -0.16878502070903778, -1.9704045057296753, 1.7435494661331177, -0.08720678091049194, -1.9521324634552002, -0.820746123790741, 1.1895002126693726, -18.609771728515625, -1.683104395866394, 2.2372658252716064, 2.192441940307617, 0.6087211966514587, 1.9873595237731934, -1.1079953908920288, -0.6279205083847046, 0.08987024426460266, 0.8234704732894897, -0.8581265211105347, 0.5055385231971741, -1.39246666431427, 1.227686882019043, 1.3600412607192993, 0.5339385271072388, 0.591687798500061, 0.686722993850708, -0.25401824712753296, 0.4140390157699585, -0.8115792274475098, -1.5952458381652832, -0.5557762384414673, -1.023980736732483, -1.4318197965621948, -0.9455269575119019, 0.6015426516532898, 0.9530626535415649, 0.4517519176006317, 0.8183997869491577, 0.38313189148902893, 1.34036123752594, 0.8329271078109741, -1.0345044136047363, 0.633255124092102, -0.20929963886737823, -0.5633736252784729, 0.8527390360832214, 0.5890200734138489, -0.29031533002853394, -0.06800195574760437, 1.4182853698730469, -1.03180992603302, -0.7187442779541016, 0.6732690930366516, 0.05404302477836609, -0.5124194622039795, -1.791397213935852, 0.9855877161026001, 0.24904637038707733, -1.2164089679718018, -0.6871855854988098, -0.36452245712280273, 1.9152164459228516, 0.6008225679397583, 1.1885716915130615, -0.7017045021057129, -0.47994565963745117, 1.389529824256897, -0.192158043384552, 0.8286932110786438, 0.050339799374341965, 1.050615668296814, 0.016554944217205048, -0.6626673936843872, -0.9870953559875488, -12.272773742675781, -1.1102540493011475, -0.9634755253791809, -1.5194646120071411, -1.7228291034698486, -0.48310473561286926, -0.11560092121362686, -1.4221833944320679, 1.2484804391860962, 1.8492896556854248, 0.40925633907318115, 1.0893160104751587, -1.8937686681747437, 1.4166431427001953, -1.2006103992462158, 1.3748785257339478, 0.34814268350601196, 1.6126476526260376, 0.07080751657485962, 0.5719590783119202, -2.583897352218628, 0.46210289001464844, -0.4542282521724701, -1.1000218391418457, 0.6777184009552002, 0.3948290944099426, -0.39540162682533264, 1.1171735525131226, -0.5896574854850769, 0.1378585398197174, 1.6064022779464722, 0.8298493027687073, -0.8885389566421509, -0.7487128973007202, -1.6580864191055298, -0.6079308986663818, 0.5462265610694885, -0.09078237414360046, -0.7328747510910034, 1.0542813539505005, 0.07263560593128204, 0.5840127468109131, -0.2723083198070526, 1.0916297435760498, -0.023943312466144562, -1.608084797859192, -0.9478822946548462, 4.097755432128906, 0.754935622215271, -1.6707977056503296, -1.768013596534729, 2.4985146522521973, 0.4609963893890381, 0.2254994660615921, -0.5997695326805115, 0.2663823962211609, -1.5753557682037354, -1.9005944728851318, 0.08838502317667007, -0.8547964692115784, 0.3518548905849457, -0.8043453097343445, -0.4917120933532715, -1.697338342666626, -15.886241912841797, 1.5200271606445312, 0.648853600025177, -1.2194517850875854, -0.352075457572937, -0.21894274652004242, -0.2037838250398636, 1.428331732749939, -0.17719011008739471, 0.7220346331596375, 1.1887094974517822, 0.34387117624282837, 0.2096169888973236, 1.7991570234298706, -19.12592887878418, 0.11784517019987106, 0.03504600003361702, -1.1068487167358398, 1.2433149814605713, 0.5037469267845154, 1.460373044013977, -1.0574524402618408, -0.8707849979400635, -0.6321248412132263, -1.0092201232910156, -0.1045871376991272, -0.11383743584156036, -0.7745609879493713, 0.2229544222354889, 0.5107433795928955, 0.40015479922294617, -0.4272984564304352, 0.4391399919986725, 0.9033997654914856, -0.08745209872722626, -0.047908950597047806, -1.2374008893966675, 0.8028226494789124, -0.2880227267742157, -1.708505630493164, 1.8216394186019897, -0.03664517402648926, 0.46321386098861694, 0.4514177739620209, -0.4165317118167877, -0.2750873267650604, 1.1730079650878906, 0.38189226388931274, -1.3885000944137573, -0.6833122372627258, 1.5425814390182495, 0.900534987449646, 0.3547249138355255, -0.9408061504364014, -0.3191920816898346, -0.208198681473732, 0.18019205331802368, -0.6936740279197693, 0.2567315399646759, 0.45563480257987976, 1.295593500137329, 0.5649889707565308, 0.6486383080482483, 0.10432802140712738, 1.2701290845870972, -1.171460509300232, -0.31150874495506287, -2.1924524307250977, -11.243882179260254, -0.9561916589736938, 0.9338107109069824, -1.676492691040039, -1.075951099395752, 0.6965413689613342, -0.6273104548454285, 1.3912124633789062, -0.3852638006210327, -1.0924687385559082, 0.5274346470832825, 0.43794864416122437, -0.8971821665763855, -0.5900952816009521, -1.375219702720642, 0.7951874136924744, 0.1399318426847458, -0.11909165978431702, -0.32631903886795044, 0.4973292052745819, 1.287940263748169, 1.3332505226135254, 0.49347689747810364, -0.23171299695968628, -0.661846935749054, -0.23038898408412933, -0.7198752164840698, 0.21290123462677002, -0.7478870749473572, 0.18586432933807373, -0.17336922883987427, 1.3099095821380615, -0.6046044826507568, 0.7625049352645874, 0.9056687951087952, -0.8040850758552551, -2.453808069229126, -0.1667967289686203, 1.61802077293396, 0.2976312041282654, -0.8554096221923828, 0.5850481390953064, 0.44604721665382385, 1.0360820293426514, 0.13123105466365814, 0.5335934162139893, 1.1243692636489868, -0.7103925943374634, 2.033247470855713, -0.9186311960220337, -0.9991725087165833, 0.9588359594345093, -0.5253349542617798, -0.42549416422843933, 1.3353759050369263, 1.3132144212722778, -2.691941976547241, -0.9921488165855408, 0.7021850943565369, -0.4437614381313324, 1.831813097000122, -0.897921085357666, 0.08243731409311295, -0.2972126007080078, -0.015692247077822685, -0.3046613037586212, 0.17079675197601318, -0.5543441772460938, -0.16293545067310333, -0.45309510827064514, 0.5948633551597595, -1.3141350746154785, -0.8180609345436096, 1.07797372341156, 0.25544455647468567, -0.24732044339179993, 0.8681055903434753, -0.9679771661758423, -2.011136531829834, 0.19357092678546906, -1.0069055557250977, 0.28675734996795654, -1.456719160079956, -2.0247840881347656, -1.3389852046966553, 0.4818994104862213, -0.1925569325685501, -0.07477831840515137, -0.10200166702270508, -0.36873847246170044, 0.4178783595561981, 0.9173585772514343, 0.5476903319358826, 0.10589233785867691, -1.4295706748962402, 0.3812950849533081, 1.1422775983810425, -1.5404411554336548, 0.15804408490657806, -0.027258535847067833, -1.5441958904266357, 0.530143678188324, -1.8975328207015991, 0.11439377069473267, -13.470813751220703, -0.3250695765018463, 0.40884941816329956, 0.07851608842611313, -0.509496808052063, -2.241229772567749, 0.2651583254337311, -0.01863010972738266, -2.318288803100586, 0.5395304560661316, -0.08849252015352249, 0.6474907994270325, 1.0633405447006226, 0.6064977049827576, 0.08463200181722641, 0.0794164389371872, 1.173852562904358, 1.617604374885559, 0.24672189354896545, 0.25601890683174133, -0.4201355278491974, 0.9109470248222351, -0.8128572702407837, 0.4055442214012146, -0.5244698524475098, 0.6318066716194153, -0.7815129160881042, -1.2605040073394775, 0.8069818615913391, -1.8360077142715454, 0.11599717289209366, 1.6079845428466797, 0.7481235861778259, 0.5424730777740479, -0.5510713458061218, 0.07720369100570679, 1.6889923810958862, -1.6622122526168823, 0.7861592769622803, -1.4140233993530273, 0.6123657822608948, 0.05609796568751335, -0.6263421773910522, 1.2904086112976074, -0.02849038876593113, 1.6969753503799438, -0.415805846452713, -2.9410207271575928, 0.438997358083725, -1.4465101957321167, 1.3539537191390991, -0.6784656643867493, -0.45337072014808655, -0.33921530842781067, -16.58462142944336, 1.785503625869751, 0.5998018980026245, 1.1685023307800293, -0.5735059976577759, -0.5603251457214355, -1.5997467041015625, 0.627341628074646, 0.8962162733078003, 1.1138818264007568, -0.9937226176261902, 1.3836156129837036, 1.183530330657959, 1.072898030281067, 1.35843825340271, -0.5624852776527405, -0.9815428853034973, -1.1750625371932983, -1.2904752492904663, -0.47290703654289246, -1.7018187046051025, 0.7761130332946777, 0.297639399766922, -0.17601913213729858, -1.2699922323226929, -0.01427271869033575, 1.4170005321502686, -0.4286218285560608, 1.5938568115234375, 0.1587366908788681, 0.2235109508037567, -0.22610224783420563, -0.04864472150802612, -0.010096819140017033, 0.1866348385810852, 0.2562811076641083, -1.1757793426513672, 1.6230769157409668, 0.36518600583076477, -2.3950390815734863, 0.049291983246803284, 0.855854332447052, -1.657624363899231, 0.22888433933258057, 0.16863910853862762, 0.163735032081604, 0.1645907759666443, -7.5017476081848145, 0.5795133709907532, 0.3906889259815216, -1.9530481100082397, 1.0512198209762573, 0.43352439999580383, 0.6173216104507446, -1.7841030359268188, 0.6206581592559814, 0.6602708697319031, -0.12453953176736832, -0.9193007946014404, 0.5091692805290222, 0.972853422164917, 0.4904070198535919, -0.4056907892227173, 0.8583158254623413, 0.07033558934926987, -0.6620189547538757, -0.5833189487457275, 0.03515750542283058, 0.8736786246299744, 0.3414675295352936, 0.41244661808013916, -1.856811285018921, 0.027426673099398613, -0.07816249132156372, -0.101031094789505, -0.5226196050643921, -0.32892391085624695, -0.5353442430496216, -0.8906430602073669, 0.8701900243759155, 0.35267242789268494, -0.023927126079797745, -0.18461808562278748, -0.20101697742938995, 0.16526095569133759, -0.6035911440849304, 0.5383392572402954, -0.8296316862106323, -0.49258533120155334, 0.5070053935050964, 0.9473684430122375, -0.0019687521271407604, 1.4451231956481934, -0.9395120143890381, -2.6568219661712646, 0.3285970389842987, -4.519965171813965, -2.3319010734558105, 0.8041282296180725, 0.12010469287633896, 1.9186261892318726, -0.1642039716243744, -0.10289707034826279, -0.6730673313140869, -1.722672462463379, 0.8153150677680969, 2.356168270111084, -0.704069197177887, 1.102880597114563, 0.2719346284866333, 1.0842972993850708, 0.08395206928253174, -1.103307843208313, -0.1257409304380417, -1.3694572448730469, -1.286466121673584, 2.537715435028076, -0.25850480794906616, 1.0022869110107422, -0.3861854076385498, 1.3205922842025757, -0.9315071702003479, -1.0757404565811157, 1.436858892440796, -2.0289437770843506, 0.345335990190506, -0.9553184509277344, 0.07327638566493988, 0.5601541996002197, -2.0086710453033447, 0.3126887381076813, 0.19446907937526703, 1.08391273021698, 0.08631329238414764, 0.17812372744083405, 0.8586124181747437, -1.280415654182434, 0.7807736396789551, -1.0907211303710938, -0.16701266169548035, 0.6986004710197449, 0.4711739122867584, 0.9451526403427124, 0.8766873478889465, -1.9877954721450806, 1.8770915269851685, 0.2386150360107422, -1.8115222454071045, 0.5555476546287537, 1.0244938135147095, 0.35637736320495605, -0.6298149228096008, 0.6278781294822693, -0.5069499015808105, -1.36543607711792, 2.2914962768554688, -0.26946568489074707, 0.8161654472351074, -0.1826997846364975, 1.0046436786651611, -0.26747241616249084, 1.2943543195724487, -0.5807296633720398, -0.025480622425675392, 0.8258765339851379, 1.8437373638153076, -2.210911989212036, 0.4711938798427582, 0.920976459980011, -1.7232012748718262, -0.040234144777059555, -0.4640252888202667, 1.0796090364456177, 1.9979884624481201, -1.2312064170837402, 1.1071994304656982, -0.3696371912956238, 0.24536290764808655, 0.5908113121986389, 0.9369366765022278, -0.0886145755648613, -0.10122349113225937, -0.5456220507621765, -0.07582391053438187, -0.1160968542098999, -0.5961167216300964, -0.32117679715156555, 1.5716841220855713, -0.22175957262516022, -0.4305983781814575, 1.013382911682129, -1.020555019378662, 0.5565817356109619, -1.5072479248046875, 1.1280759572982788, -1.6181201934814453, 0.26593536138534546, -1.8243982791900635, 0.0529070720076561, 0.30430832505226135, -0.8573086261749268, 1.4696507453918457, 0.4637570381164551, -1.507346272468567, -0.312030166387558, -0.9141648411750793, 0.13352805376052856, -0.7318568229675293, -0.34911438822746277, 0.33682259917259216, -0.40777355432510376, -0.3973061740398407, -0.6639308929443359, 0.8942137360572815, 0.5137659907341003, 0.3906639516353607, -1.0738976001739502, -0.3680728077888489, 0.641219973564148, 0.39488324522972107, 0.031150110065937042, -0.04853415861725807, 0.9057925343513489, 0.49391651153564453, 0.8569917678833008, -0.22517021000385284, 4.097755432128906, 0.7885909676551819, 0.15721948444843292, -0.267106294631958, 3.0356945991516113, -0.11450093984603882, -1.4952099323272705, 0.5610188245773315, -1.7376254796981812, 0.3650616407394409, 0.35234934091567993, 0.1741698980331421, 0.18872451782226562, -0.3063614070415497, -1.675121784210205, -0.26364555954933167, -17.12749481201172, -1.3017197847366333, -0.1590338498353958, -0.389167845249176, -0.13265517354011536, -0.6187953948974609, 0.3102993071079254, 0.9743372201919556, -0.015941614285111427, -0.5912570357322693, 1.6271518468856812, 1.127139925956726, 0.4236678183078766, -0.48470747470855713, 1.0042219161987305, 1.38899564743042, -0.8606571555137634, -0.13236302137374878, 0.8333430290222168, -0.8237043023109436, -0.5301413536071777, 1.482857346534729, 0.7655964493751526, -0.09069719910621643, 1.553743600845337, -1.0619739294052124, -0.23924942314624786, 0.36596769094467163, 0.8436725735664368, -0.5112578868865967, -0.6867060661315918, 0.5088785886764526, 2.2833213806152344, 0.42580297589302063, -0.5044949650764465, 1.115968108177185, 1.1712149381637573, 0.3639342486858368, 0.45476117730140686, -16.067914962768555, 2.0585505962371826, -0.4915136992931366, -0.5914280414581299, 0.19145984947681427, 0.8830695748329163, 0.5585391521453857, 0.7041908502578735, 0.7071318030357361, -1.3127553462982178, 0.7672927379608154, -0.6602600812911987, 0.2458207607269287, 0.648349404335022, -1.0216134786605835, 0.2148456573486328, -2.6997852325439453, -0.47525861859321594, 0.24141128361225128, 0.041436709463596344, -0.9450514316558838, 0.3409941792488098, 1.6932251453399658, -0.9034672379493713, 2.1707329750061035, 0.07826439291238785, -0.6966630220413208, 0.6391975283622742, -0.22908426821231842, 1.3748096227645874, 1.367271900177002, -0.8960849046707153, -0.5149982571601868, -0.44686004519462585, -1.7423492670059204, 0.9024530053138733, 0.4774550199508667, -0.08760865777730942, -2.29356050491333, 1.243320107460022, 1.4654875993728638, 0.2533523142337799, -0.8315621614456177, -0.35930633544921875, -0.31531134247779846, 0.1018218845129013, -0.4263482391834259, 1.5981526374816895, -1.8442964553833008, -1.4389301538467407, -1.081494927406311, -1.7417842149734497, -1.5854517221450806, 0.3624005913734436, 0.6111950278282166, 0.8963255882263184, 0.8030410408973694, -0.49223846197128296, 0.0703914612531662, 1.580844759941101, -0.5400506854057312, 0.09753093868494034, 0.7311423420906067, 1.2765120267868042, -0.47490638494491577, 0.7620760202407837, -0.43761247396469116, 1.3264931440353394, 0.3905019164085388, 0.665174126625061, -0.6093280911445618, -0.1799653172492981, -0.8639873266220093, -0.1487802416086197, 0.13492000102996826, 0.33444011211395264, -1.6434049606323242, 1.1612548828125, -0.8917189836502075, 0.13554176688194275, 1.3991459608078003, 1.0846086740493774, -16.267044067382812, -1.7387374639511108, 0.22193162143230438, 0.171903595328331, 0.2662603557109833, 0.0895361602306366, -0.27136534452438354, -1.2375074625015259, 2.259626626968384, 2.545830488204956, -0.011364289559423923, -0.6528089046478271, 0.07985985279083252, -3.1301910877227783, -0.31641441583633423, -1.2609848976135254, -0.30440062284469604, -0.9973298907279968, -0.36072778701782227, 0.19978512823581696, 0.5435221195220947, -0.7013300061225891, -1.6763224601745605, -0.12047260999679565, -0.8762654662132263, -1.1071069240570068, 0.3526572585105896, 0.1482481062412262, 0.7031402587890625, -0.40737080574035645, 1.2377313375473022, -0.3166641891002655, 1.0460313558578491, -0.814848005771637, 1.7492494583129883, -0.5587565302848816, -0.19189968705177307, 0.5021796226501465, 0.12312682718038559, -1.6402490139007568, 0.014937927946448326, -0.5710797309875488, 1.2347917556762695, 1.0545520782470703, 0.6843260526657104, 0.04530419409275055, 0.17619848251342773, 0.8522592186927795, -0.11262507736682892, -1.5153450965881348, 0.6131868958473206, -0.31468817591667175, -0.1401522308588028, 1.5082919597625732, 0.5847020745277405, 1.6839102506637573, -1.2684574127197266, -0.9323864579200745, 0.485810786485672, -0.6423563957214355, -1.892232894897461, -0.3803088068962097, 0.6103200316429138, 0.11989666521549225, -0.8710960745811462, 0.6862249970436096, 0.21813145279884338, -0.9414797425270081, 1.758217215538025, -0.3605915606021881, 0.2687808573246002, 0.19541139900684357, 0.5997894406318665, 0.8308013081550598, 0.5830529928207397, 0.6395601034164429, 0.9806798100471497, 0.26266413927078247, -0.26175689697265625, 0.9959012269973755, -1.4034717082977295, -1.6303800344467163, -0.35350990295410156, -1.0851609706878662, -0.8399578928947449, 0.5273087024688721, -0.6095067262649536, -0.7701442837715149, 1.1645333766937256, 0.31334322690963745, 1.545762538909912, -0.40891942381858826, -2.258057117462158, -2.0563933849334717, -1.2818671464920044, 1.2223533391952515, -1.639946460723877, -0.3828103244304657, -0.3349155783653259, -0.361346960067749, -0.8787715435028076, 0.12672068178653717, -1.6309186220169067, -1.9368233680725098, 1.2708075046539307, -0.5488868355751038, 1.6343708038330078, 0.16928113996982574, -0.29747429490089417, 0.25166016817092896, 1.0808526277542114, -0.7498931884765625, -0.51644366979599, -0.6494140028953552, 0.1782035380601883, 1.4399577379226685, -0.12726753950119019, -0.28312137722969055, -0.3636869490146637, -0.13372519612312317, -1.7051843404769897, 0.9462634921073914, -1.0984152555465698, -0.15726709365844727, 0.7964584827423096, -1.01930832862854, -0.41765713691711426, -0.35035642981529236, 0.20764029026031494, 0.9393301010131836, 0.02121954970061779, 0.03803255781531334, -1.1647007465362549, 0.04685520380735397, 0.7176241278648376, -2.0762643814086914, 0.2501579821109772, -0.9459984302520752, 0.567242443561554, 1.6101291179656982, 0.3279980421066284, -2.325330972671509, -0.13353431224822998, 0.31216633319854736, 0.4560348093509674, 0.06661753356456757, -0.8246954083442688, -0.05680987611413002, 1.4002212285995483, 0.8972690105438232, -0.8520643711090088, 0.23236942291259766, 0.2030249983072281, 0.07700525224208832, 0.18451698124408722, 0.464886873960495, 0.27116215229034424, 1.4561004638671875, -0.5599481463432312, 0.8225253224372864, 0.18187622725963593, 1.0455220937728882, -1.7773300409317017, -0.07274187356233597, 1.2804505825042725, -0.3196893334388733, 1.3474454879760742, 1.512327790260315, -0.4141712188720703, 1.2755308151245117, -0.5187236666679382, 0.2190275937318802, 0.2971757650375366, 1.2870184183120728, -1.0029478073120117, -0.3486124873161316, 0.6026456952095032, 0.6433351635932922, -0.5846070647239685, 0.719911515712738, -0.03537369519472122, 0.021572330966591835, 1.0182969570159912, 0.7044039964675903, 1.4048126935958862, -0.49457111954689026, 1.6692771911621094, 0.9081430435180664, -0.18567579984664917, 1.655480980873108, 0.09501083940267563, -0.4156680703163147, 0.4644431173801422, 1.9177820682525635, 0.9531696438789368, 0.467302143573761, 0.32767871022224426, -1.1922551393508911, 0.27503588795661926, 0.16604742407798767, -0.2949604094028473, 1.6554467678070068, -0.9537938833236694, 3.426973342895508 ], "xaxis": "x", "yaxis": "y" }, { "alignmentgroup": "True", "hovertemplate": "values=%{x}", "legendgroup": "", "marker": { "color": "#636efa" }, "name": "", "notched": true, "offsetgroup": "", "showlegend": false, "type": "box", "x": [ 1.6701021194458008, -0.4013443887233734, -0.9621886014938354, -0.47427892684936523, 0.22102996706962585, 0.4871429204940796, -1.0090556144714355, -0.3365063965320587, 0.015682965517044067, -0.23902232944965363, -0.7504948377609253, 1.6775753498077393, 1.2425397634506226, -0.05195920169353485, 0.7474790215492249, 0.23467408120632172, -0.4946284592151642, -0.809894323348999, -0.8427773714065552, -1.7870934009552002, -1.3359959125518799, -0.17393502593040466, -0.39147764444351196, 2.7278945446014404, 0.3609798848628998, -0.6060501337051392, 0.29202133417129517, -1.9618695974349976, -2.0516014099121094, 1.1275523900985718, -0.26453688740730286, 1.9543646574020386, -0.853431761264801, -0.18094973266124725, -0.3713285028934479, -0.32224372029304504, -0.0972270742058754, -0.02444693259894848, 0.1357625275850296, 0.4412049949169159, 1.1827431917190552, -0.3586912453174591, -2.2241251468658447, 0.16488255560398102, -1.663999080657959, 0.449679970741272, 2.059107780456543, -0.7460053563117981, -0.01420207042247057, -0.04653787985444069, -1.9546797275543213, 0.23938044905662537, 1.231762409210205, -0.10200554132461548, 0.7896058559417725, -0.5800328254699707, -1.5143728256225586, -0.06695964187383652, 0.005820273421704769, -0.3919655382633209, 1.2854429483413696, 0.48105064034461975, -0.982657253742218, -0.896655261516571, 1.185926079750061, 3.310927152633667, -0.9850367307662964, 0.0887068435549736, -0.3137270510196686, 0.3208761215209961, 0.307151198387146, -1.202414631843567, -0.08377671986818314, 2.798823595046997, -0.5184486508369446, -0.7540435194969177, -0.053321484476327896, -0.045243095606565475, 0.9450845718383789, 0.5719929337501526, 0.4085516333580017, -1.1501076221466064, -0.7832776308059692, -1.0598313808441162, 0.1470499485731125, 0.05275135859847069, -1.2318018674850464, -0.2056867629289627, -0.4140729308128357, 1.0660831928253174, -1.3285843133926392, 0.6625528335571289, 1.880814790725708, 0.48769411444664, 0.37352749705314636, -0.9868625998497009, 1.3906347751617432, 0.8515202403068542, 1.227536678314209, -0.7386914491653442, -0.7515754699707031, 0.5239247679710388, -0.504108190536499, -0.3288980722427368, -0.1262723207473755, -0.7424002885818481, -1.6300336122512817, -0.5042734742164612, 0.10349484533071518, 1.1317331790924072, 0.851218581199646, 1.3460415601730347, 0.17510375380516052, -0.30845606327056885, -0.29186853766441345, 0.6372880935668945, 1.0798319578170776, 0.7486704587936401, 1.297742247581482, 0.024422302842140198, 0.49205461144447327, -1.5723001956939697, -0.10158171504735947, -0.7191416621208191, -1.2347818613052368, -0.6859269142150879, 1.720120906829834, 1.3952622413635254, -1.2722333669662476, -1.5565712451934814, -1.045629620552063, -0.3137485086917877, 0.3677847385406494, 0.7124619483947754, 0.08606154471635818, 2.440657615661621, 0.39491820335388184, 2.665715456008911, 1.725279688835144, 1.20916748046875, -0.5529546737670898, -2.7873787879943848, -1.871337890625, -1.6178300380706787, -0.9796927571296692, -0.6309326887130737, 0.09900343418121338, -0.2808751165866852, 0.702878475189209, 0.030469762161374092, 0.736494243144989, 0.37604472041130066, 0.7889389991760254, 2.27284836769104, 0.0811658576130867, -1.7717777490615845, 0.014142432250082493, 0.8775602579116821, 0.14944997429847717, 0.8356919288635254, 0.5881122946739197, 0.5638540983200073, 1.6143510341644287, -0.8334043622016907, -0.39386844635009766, 0.6840412616729736, -0.020431281998753548, -0.7029045224189758, 0.30511602759361267, 0.5421063303947449, -0.24129465222358704, 1.091206669807434, -0.9701244235038757, -0.0032988605089485645, -0.9537899494171143, 0.9001896977424622, -0.19718530774116516, 1.3883377313613892, -1.131880521774292, -1.0903867483139038, 0.34568509459495544, 0.06424009054899216, -0.029672497883439064, -0.1973988264799118, 0.8406216502189636, -1.054208755493164, 0.4676947295665741, -0.6342087388038635, -0.2011122703552246, -0.8901128768920898, 0.25545981526374817, 0.1606757640838623, 1.150004506111145, 0.9259425401687622, 0.12635618448257446, 0.2295258790254593, -0.023738333955407143, 0.8329809308052063, -1.0473930835723877, 0.30106255412101746, -1.4681336879730225, -1.2356473207473755, 0.23106035590171814, 0.8302143216133118, -1.006901741027832, 0.8498257994651794, -1.4491419792175293, 1.3971779346466064, 0.23915357887744904, 0.7658546566963196, 0.33915677666664124, -1.7814501523971558, -0.9943373799324036, -0.06154148653149605, -1.524379849433899, 2.0898194313049316, -0.45564132928848267, 0.8971486687660217, -2.247019052505493, -0.4891301393508911, 1.477277159690857, -0.11950957030057907, -0.06553694605827332, -0.23414532840251923, -0.1275406777858734, 1.9680017232894897, -1.7695839405059814, -0.42279112339019775, -0.4757702052593231, -1.1997061967849731, -0.3917473256587982, -0.7782420516014099, -0.7033922076225281, 0.015912029892206192, -0.8420393466949463, -0.22783786058425903, -2.8647220134735107, 2.3452816009521484, -0.8205171823501587, -0.2527005970478058, 0.45561861991882324, -1.1391414403915405, -0.7033369541168213, -0.9325356483459473, -1.007163643836975, -0.1260230988264084, -0.8441455960273743, 0.41502508521080017, -1.7505724430084229, -1.3454792499542236, -18.561378479003906, 0.45526063442230225, 0.7719040513038635, -1.8467204570770264, -1.203978180885315, 0.04198182374238968, 1.0340683460235596, -3.3149166107177734, -1.3984414339065552, 0.2506398558616638, 0.30007606744766235, -0.2259044200181961, -1.1965210437774658, 0.8548542857170105, 0.6952174305915833, 0.1439109444618225, -1.276268482208252, 0.779871940612793, 1.2837059497833252, -0.22430329024791718, -15.69243335723877, 0.09098983556032181, 0.054780129343271255, 0.013822135515511036, -16.887598037719727, 1.3931845426559448, -1.4460207223892212, 0.8899747729301453, 1.269865870475769, 2.2147388458251953, -1.5153170824050903, -1.160542368888855, -1.2565346956253052, 1.0910873413085938, 1.1865499019622803, -0.15063150227069855, 1.0028040409088135, 0.10176906734704971, 0.7706958651542664, -3.2673051357269287, 0.31890133023262024, 0.8665199279785156, 0.5073079466819763, -0.28038206696510315, -0.15489964187145233, 1.1499871015548706, -0.5694733262062073, 0.08702875673770905, -2.1933624744415283, -1.8294596672058105, -2.0498313903808594, 2.0738790035247803, -0.44648119807243347, -1.1907368898391724, 0.8377540111541748, -1.2731952667236328, 1.0126307010650635, -1.0396976470947266, 0.5797311067581177, -0.8053640723228455, -0.6111481189727783, 0.9277380704879761, -1.4594125747680664, -15.622920036315918, 1.9608590602874756, 0.34828779101371765, -0.3424518406391144, -0.18499262630939484, 1.1142141819000244, 1.4390747547149658, 0.7323889136314392, 1.692148208618164, 0.4153400659561157, -0.758794367313385, 0.18620595335960388, -0.5630350708961487, 0.7188352942466736, -0.6978166699409485, -0.3663800060749054, 0.5032320022583008, 0.12521736323833466, 1.1371996402740479, -0.08562123775482178, -0.37477564811706543, 0.7937425374984741, 0.7313529849052429, -0.4860881567001343, -0.056155867874622345, -0.3369532823562622, -0.3640773892402649, -0.8226471543312073, -0.9237383008003235, 1.2452576160430908, -0.2009589672088623, -1.4261597394943237, -0.9209190607070923, -0.28980499505996704, 0.7018173933029175, 1.2340797185897827, -1.2665975093841553, -0.11654222011566162, 0.3435021936893463, -0.9028292298316956, -0.683616578578949, 0.8974573612213135, -0.09804262965917587, 0.20730619132518768, -0.04262269288301468, 0.067946657538414, -18.108901977539062, -0.4829972982406616, -1.6804038286209106, 1.4129853248596191, 0.8982717990875244, -1.1676197052001953, -1.4078724384307861, -0.241227924823761, -0.24875906109809875, -16.927207946777344, 0.38561898469924927, 1.1138570308685303, -0.05873959884047508, -1.3985689878463745, 1.7894014120101929, -0.8071817755699158, 0.8316658735275269, 0.2618773281574249, -0.4162651300430298, 0.9132717251777649, 1.3696205615997314, 2.017789840698242, 1.7733960151672363, 0.40511956810951233, -0.8494532108306885, -0.22686578333377838, -0.19234955310821533, -2.0322468280792236, 0.22754180431365967, -1.011629581451416, 1.6815457344055176, -0.2477475255727768, 0.6750609874725342, 0.13874435424804688, 0.5562552213668823, -1.6167917251586914, 1.175965666770935, 0.3250761926174164, -0.046716343611478806, 2.279827356338501, -0.25412634015083313, -0.4099774658679962, -0.12063657492399216, 0.4340805113315582, 0.1110650822520256, -0.002476111287251115, -0.42279160022735596, -0.4696209728717804, -0.36353373527526855, -0.06401994079351425, -0.11585085093975067, 0.9132018089294434, 0.8281629681587219, 1.2548766136169434, -0.0634513646364212, 0.6874685883522034, -1.2803689241409302, -0.5831207633018494, -0.05613207817077637, -12.737375259399414, -2.779745578765869, -0.7805660367012024, -0.37352874875068665, -0.03583333641290665, 1.7654777765274048, 2.107759475708008, 0.5707927346229553, 1.3850563764572144, 1.394569993019104, 0.7113397121429443, 0.46787747740745544, 0.9517487287521362, -0.8409066796302795, -0.9611682295799255, 0.06813447177410126, 2.619811534881592, 0.9559094309806824, -0.5950199365615845, 0.430792897939682, -0.23610487580299377, -13.439101219177246, -1.2987312078475952, 0.2991483807563782, -0.7488812208175659, 2.208608627319336, 0.29483914375305176, 0.4674071967601776, 0.14203934371471405, 1.0089898109436035, 0.0009707655408419669, -0.8302242159843445, -0.5877621173858643, 1.0831350088119507, -0.0851081907749176, -0.13201890885829926, 0.7690086364746094, 0.599500834941864, -0.43251243233680725, 0.6897672414779663, 0.08398095518350601, 1.2728101015090942, 0.334959477186203, -0.25499194860458374, 0.2218245565891266, 0.17316502332687378, -0.46388453245162964, 0.41276419162750244, 0.17071542143821716, -0.6557283401489258, 0.20664140582084656, 1.2475416660308838, 0.5941089391708374, -0.1644948571920395, 1.7246779203414917, 0.060729287564754486, 0.05769626423716545, -0.2838590145111084, 0.3785691261291504, 0.6046236753463745, 0.8459674119949341, 0.6800540685653687, -0.5285106897354126, -1.706848382949829, -0.12022071331739426, 0.1765863597393036, 2.2328689098358154, -0.17776761949062347, 0.09358503669500351, -0.17655342817306519, -0.5202522277832031, -0.8813592195510864, -0.05805975943803787, 0.31376126408576965, -1.1943591833114624, -0.015882207080721855, 0.2008516490459442, -9.347285270690918, -0.569974958896637, -0.23516906797885895, -0.35812076926231384, -1.2899173498153687, -0.8601201772689819, 0.385479599237442, -0.16057497262954712, -0.29398635029792786, -0.13203340768814087, 0.36877888441085815, -0.8655543923377991, 0.663767397403717, 0.5852406620979309, -0.4609851539134979, 1.1741054058074951, -0.7165546417236328, -2.3762502670288086, 1.0318294763565063, -0.611397922039032, 0.5411325693130493, 0.9259071946144104, 0.5514629483222961, -0.7992487549781799, 1.1960837841033936, 0.1367790251970291, 0.1252211332321167, -1.507036566734314, 0.01600639708340168, 0.33279281854629517, -0.58061283826828, -0.7834358811378479, 1.052857756614685, -0.9058774709701538, -1.7517919540405273, 1.925586462020874, 0.9062283039093018, -2.0205578804016113, 0.8126953840255737, 0.0499160960316658, -0.1966859996318817, 0.2728426456451416, 1.6356881856918335, 1.7337945699691772, -1.7686190605163574, 0.5873236656188965, 0.8721005320549011, 0.2527526915073395, 0.030415307730436325, 0.4402143657207489, 0.6167499423027039, -1.3077737092971802, 0.5512112379074097, -0.4745350480079651, 0.9157301187515259, 0.03961589187383652, -0.38683003187179565, -0.1726664900779724, 0.89200359582901, -0.03352867439389229, 0.11550401896238327, 0.10051723569631577, -0.7350569367408752, -0.479885071516037, 1.0447297096252441, -1.198862075805664, 0.9896156787872314, 0.16808858513832092, 0.5775546431541443, -0.9140392541885376, -2.015496015548706, 0.9109838604927063, 0.5913926959037781, -1.4647895097732544, -1.0044174194335938, -0.054608944803476334, -0.5681459903717041, 0.15467070043087006, 0.7826933264732361, -0.24484850466251373, -0.44560426473617554, -3.110074281692505, 0.7586746215820312, 0.5355629920959473, 1.7600325345993042, 1.2780053615570068, 0.30196502804756165, -0.23653706908226013, 0.7283837795257568, -0.6094091534614563, -0.6655275225639343, -0.046601198613643646, -0.5366504192352295, -0.23508433997631073, -0.358513742685318, 1.8448803424835205, 0.21936693787574768, -0.6611652374267578, -0.9577195644378662, 0.6308346390724182, -0.4946279525756836, -0.24059957265853882, 0.5811743140220642, -0.8085638880729675, 0.49540573358535767, 2.1480908393859863, -0.22482013702392578, -1.7660865783691406, -3.200334072113037, 0.49359941482543945, 0.13692285120487213, 0.7778846621513367, 0.5252137184143066, -0.10016755014657974, -2.2446844577789307, -0.4358745217323303, -10.894821166992188, -0.20592689514160156, -0.7099545001983643, -1.5485506057739258, -1.6770657300949097, 0.6528546810150146, -1.4778858423233032, 1.3865599632263184, -0.07230344414710999, 0.44155532121658325, 0.2253604531288147, 1.4651511907577515, 0.8264480233192444, -1.074456810951233, -1.4203940629959106, 1.5893157720565796, 0.1599459946155548, -1.7769204378128052, -1.3568865060806274, -0.35283327102661133, -2.5785365104675293, 0.17958927154541016, -0.09670332819223404, -18.22732925415039, 2.110806465148926, -0.2972424030303955, -0.222786545753479, 1.159976601600647, -0.28520992398262024, 0.0732957273721695, -0.3923517167568207, -0.09228190034627914, 0.33259743452072144, 0.1965779960155487, 1.301517128944397, 0.1898757666349411, 0.28715747594833374, -1.162158489227295, 0.16818523406982422, 0.41557615995407104, -0.6018446087837219, 0.42732933163642883, -1.4398561716079712, -1.2395107746124268, -0.38418498635292053, 1.6702946424484253, -0.19590814411640167, 1.164395809173584, 0.9613975882530212, 0.5642630457878113, 0.8458976149559021, -0.23589792847633362, -1.4722265005111694, -0.8705275654792786, -0.38195833563804626, -1.049065113067627, -1.349847435951233, -0.5302889347076416, 0.27434661984443665, 1.795946478843689, 0.18532507121562958, 0.3846076428890228, -0.15348033607006073, 1.7178632020950317, -0.7672904133796692, -0.5191990733146667, -0.891994059085846, 0.9352000951766968, -0.8211413025856018, -0.640424370765686, -0.6935401558876038, 0.3865292966365814, 0.19553060829639435, -0.7163758277893066, -0.469620943069458, -0.8588986992835999, -0.27736032009124756, 0.1417139619588852, -1.948276400566101, 0.8240102529525757, 0.9409766793251038, -2.061589241027832, 3.1733040809631348, -0.7712946534156799, -0.3056074380874634, -0.6221938729286194, -3.076613664627075, -0.8934381604194641, -0.03244141489267349, 1.2541425228118896, 0.34388628602027893, -0.7004550695419312, -1.0085731744766235, 0.9633119106292725, 0.3665636479854584, 0.10162024945020676, -0.8132174611091614, -2.266779661178589, -0.5635631084442139, -1.2580170631408691, -0.10357130318880081, -1.0834674835205078, 1.4864423274993896, -2.4173150062561035, -0.09391482174396515, 0.4235823154449463, 0.12415008991956711, 0.8981422185897827, 1.189937949180603, 0.7115863561630249, 0.038795217871665955, 1.3632597923278809, 0.6373701691627502, 0.38278165459632874, 0.7284129858016968, -1.5215989351272583, 0.7115475535392761, 0.2888809144496918, -0.5229651927947998, 1.1179436445236206, 1.2731096744537354, -0.7542174458503723, 1.1135857105255127, 0.6874525547027588, -0.16312631964683533, 0.5903967022895813, -0.6977152824401855, 0.8635366559028625, 1.733234167098999, -0.7100813388824463, -0.3510550260543823, 0.2810482680797577, 1.316776156425476, -0.002193765714764595, 0.6387234330177307, 0.5361548662185669, 1.8864244222640991, 0.629464328289032, -1.2792402505874634, -0.1431824117898941, 0.5214776992797852, -0.3618578612804413, -0.8666455149650574, 1.5448659658432007, -2.061894655227661, 0.7982968688011169, -0.35796838998794556, -0.6197317242622375, 0.7246381044387817, 0.21233443915843964, -0.48837822675704956, -0.17550240457057953, 0.9505169987678528, -0.021790994331240654, -1.0330415964126587, 0.10861173272132874, 0.1493970900774002, 1.4069769382476807, 0.8096254467964172, 0.9679690599441528, -0.5173286199569702, 0.4969790577888489, -0.4176102578639984, -0.369778573513031, 1.221616268157959, -0.48464423418045044, 0.4854068160057068, -0.02460417151451111, -1.2322564125061035, -1.2582907676696777, -0.7781865000724792, -0.4101702868938446, 0.774931788444519, 0.5377013087272644, 0.3382035493850708, 0.4062962532043457, 0.20838674902915955, -0.7511599659919739, -1.6446398496627808, -0.04055004566907883, 1.7735809087753296, 1.4474974870681763, 0.0015542799374088645, -1.306888222694397, 0.475982666015625, -0.8328532576560974, -1.0355862379074097, 0.3105166554450989, 1.5472925901412964, 0.1519278585910797, -0.38545483350753784, 0.2576889097690582, -0.6782562732696533, -1.21970534324646, 0.15682798624038696, -17.68878173828125, -1.6243798732757568, -0.6978943347930908, 0.3514051139354706, -0.1255016326904297, 0.3267347514629364, 0.6052844524383545, -0.1590433567762375, -0.28607794642448425, 0.15484708547592163, -0.8476271033287048, -18.48040008544922, 0.992392361164093, -0.17992645502090454, 0.5546315312385559, -0.8057576417922974, -0.7111413478851318, 0.27621954679489136, -0.15420858561992645, 1.0491560697555542, -0.2887669503688812, 0.714509904384613, 2.086008071899414, 1.0160568952560425, 0.7278507351875305, -0.7935178875923157, 1.321682095527649, -0.31209269165992737, 1.2296608686447144, -0.5092487931251526, -1.8001086711883545, 0.5065715909004211, -0.9296392798423767, -0.4705468714237213, -0.450061559677124, 1.174973487854004, -0.38533154129981995, -0.11026748269796371, -2.377784013748169, 1.8371105194091797, 0.20793674886226654, 1.1918940544128418, 0.4893058240413666, -1.079595923423767, 0.42174625396728516, 0.9930372834205627, 0.24691474437713623, -1.0034939050674438, -0.295966237783432, 0.6490249633789062, 0.74452143907547, 0.9255961179733276, 0.3652676045894623, -2.1806581020355225, -1.573177456855774, 1.4450488090515137, 0.3481215834617615, 0.5551604628562927, -0.3919450640678406, -1.3154048919677734, -0.36773067712783813, -0.09180362522602081, 0.6685121059417725, -0.9206292629241943, 2.0572030544281006, -1.3375929594039917, 1.9689433574676514, 1.636672019958496, 0.9563421010971069, -0.8903577923774719, 0.48069775104522705, 0.714354395866394, -1.0945488214492798, 1.720470666885376, -0.5284701585769653, 0.9851301908493042, -0.7820979356765747, -0.6584305167198181, 0.751590371131897, 1.0809680223464966, 0.0713401511311531, -2.714054584503174, 1.5848642587661743, -0.48084938526153564, -0.1950523853302002, -2.4062323570251465, 1.3321781158447266, 0.24272017180919647, 1.1856253147125244, -0.5046140551567078, 0.5617100596427917, 0.6351315975189209, 0.3272918462753296, -8.63271713256836, 0.3120584785938263, 0.433687686920166, -0.5225779414176941, -9.63778018951416, -1.9300737380981445, -1.395961046218872, 1.3522876501083374, -1.1455764770507812, 1.871329665184021, 0.9556055068969727, -0.38365212082862854, -0.05679599568247795, 0.5027085542678833, -0.9312928318977356, -0.6049668192863464, -1.3873244524002075, -0.25923123955726624, -1.474943995475769, 0.32233431935310364, -0.9227566123008728, -1.0589202642440796, 0.4018787741661072, -0.6275861263275146, -0.2554340958595276, -0.3865153193473816, -0.3402632176876068, 0.9757081270217896, 0.5386762022972107, 1.144869327545166, -0.009907171130180359, -0.4492989480495453, 0.30730584263801575, 0.2528379559516907, -0.07145872712135315, -1.8564921617507935, -0.9903160929679871, 1.449090838432312, 1.2542698383331299, -0.14999371767044067, 0.756141722202301, -0.988964855670929, 0.5560907125473022, 1.7225345373153687, -1.313504934310913, -0.4798528254032135, -1.851694107055664, -2.536792039871216, -0.2833492159843445, 1.3383780717849731, 1.208353042602539, 1.5850768089294434, 0.975443959236145, 1.8928745985031128, -0.0779191330075264, -0.9501805901527405, -0.6668849587440491, 0.24569815397262573, 0.10261604934930801, -0.27412641048431396, 1.049669861793518, -1.5270373821258545, -16.555545806884766, 1.5236058235168457, 1.0709689855575562, -0.47718632221221924, -1.5688496828079224, 0.3628869354724884, 0.3491596281528473, -2.341299533843994, -0.4635755121707916, -1.8166100978851318, 0.2912503480911255, 0.8249494433403015, 1.891697883605957, -14.13697624206543, -0.9318851828575134, 2.732956647872925, 0.18393541872501373, -0.8581054210662842, 0.28514763712882996, 1.6945873498916626, -1.2541266679763794, 0.6158757209777832, -2.6760151386260986, -0.02654569037258625, 1.3870435953140259, 0.6651208996772766, 0.440669447183609, 2.054332733154297, 0.4732533395290375, 1.3265336751937866, -0.5780155062675476, 1.0294849872589111, 1.3138023614883423, 0.1236850917339325, -0.8734272718429565, 0.5216870307922363, 0.40526145696640015, -1.7804031372070312, 0.42995893955230713, 2.3188278675079346, -0.9045697450637817, -0.35995835065841675, -0.43122240900993347, 0.4354318678379059, -1.2191975116729736, -0.582687258720398, 0.5666539669036865, 1.1317603588104248, -2.347419500350952, -0.5929030179977417, -1.6753724813461304, -0.47017309069633484, -1.1294077634811401, -1.6177488565444946, 1.737892985343933, -0.07061543315649033, -0.49465441703796387, -1.0978721380233765, -1.2479020357131958, 0.579322338104248, 0.6117019057273865, -0.17980287969112396, 0.10182101279497147, -0.8570054173469543, 0.6969802379608154, -3.3973796367645264, 1.5719692707061768, 1.8220865726470947, -0.15468502044677734, 0.692903459072113, -0.20346136391162872, 0.3402431309223175, 0.6851188540458679, 1.0033559799194336, 0.25565773248672485, -17.551660537719727, -1.1231187582015991, -1.7658491134643555, 0.6836843490600586, -0.09327664226293564, -0.7927486896514893, 0.2969335913658142, 0.8689334988594055, 0.07719546556472778, -0.60657799243927, 0.4797537624835968, 0.30627623200416565, -0.1813601851463318, 0.21057212352752686, 0.4829871654510498, -0.29848429560661316, -0.1946725845336914, 1.9129509925842285, 0.04311142861843109, 0.6757611036300659, 0.5900170207023621, 1.9361557960510254, -0.8819527626037598, 0.2630491256713867, -0.32421353459358215, -0.7416873574256897, 0.03801117464900017, -0.8422570824623108, -0.8802772760391235, 0.526776909828186, -0.5300173759460449, 0.046918660402297974, 0.5835791230201721, 0.06044864282011986, -0.03229252249002457, 0.01152496226131916, -1.4099135398864746, -0.3587759733200073, 0.3882387578487396, 1.648189663887024, 0.9655547738075256, -0.4172990620136261, 1.0962326526641846, 1.3549200296401978, 0.647868275642395, 1.3742644786834717, -0.3355538547039032, 0.531290590763092, -0.7283146381378174, -0.9839438796043396, 0.15423773229122162, 0.4090573191642761, 0.5062742829322815, 1.101725697517395, -0.5192512273788452, 0.6189517378807068, -0.2181977927684784, -1.1105461120605469, 0.6281615495681763, 0.8046212196350098, 1.9061917066574097, 0.4869554936885834, 0.21340195834636688, -0.06276455521583557, -0.13509702682495117, 1.5386848449707031, -1.3860963582992554, 1.5619537830352783, 1.4004981517791748, -0.9704268574714661, 0.7954816222190857, 0.3862946331501007, -0.2737136483192444, -0.06512704491615295, 1.2787353992462158, 0.9740951657295227, 0.1273132562637329, 1.6968238353729248, -0.21221742033958435, -0.0704682394862175, 0.01407607737928629, 1.4157263040542603, -1.748478651046753, -0.030343294143676758, 1.5329188108444214, 0.1295459270477295, 0.7555338144302368, -0.2756985127925873, 0.8167482614517212, -0.22961539030075073, 1.0578993558883667, -0.2841269075870514, -1.7051807641983032, -0.31631678342819214, 0.622871994972229, 0.8862636089324951, 0.37082260847091675, 1.3035632371902466, -1.6916730403900146, 0.02106674201786518, -0.14553457498550415, 1.336930513381958, -0.5815532207489014, 0.821649968624115, 0.789959728717804, -2.3783793449401855, -1.452402949333191, 0.3065665364265442, 0.24794498085975647, 0.2879219353199005, 0.6650593280792236, -0.4677283465862274, -0.7634111642837524, 0.42963743209838867, -0.032515835016965866, 0.01625615358352661, -1.3814244270324707, 0.2703244686126709, -0.5796584486961365, 0.786151111125946, 0.044357724487781525, -1.4012622833251953, 1.4893568754196167, 1.1690175533294678, 0.06779883056879044, 0.5933158993721008, -0.9227010607719421, -0.8230164647102356, -0.0356287881731987, -0.33521077036857605, -1.5847917795181274, 0.401574969291687, 0.5336413979530334, -1.333629846572876, -0.3846014738082886, -0.5823929309844971, -0.9770989418029785, 0.5072863101959229, 0.8622807860374451, 0.022712409496307373, 0.08692825585603714, -0.3274986445903778, 0.2683415412902832, -0.09876793622970581, -0.5113011002540588, -0.14377477765083313, -0.2745492160320282, -0.4230002760887146, 1.6605991125106812, -0.3873354494571686, 0.7060688734054565, -0.09750630706548691, -0.6125768423080444, 0.040544457733631134, -0.5006402730941772, -0.8554370403289795, 0.0873190313577652, -1.1361472606658936, 1.8587087392807007, 0.3811686933040619, -0.7053834199905396, 0.47429463267326355, 0.7457582354545593, 1.1685612201690674, -1.3541486263275146, -1.0990809202194214, 0.1500275433063507, 0.30305254459381104, -0.35590890049934387, -0.2235572636127472, -1.2427244186401367, -12.65786075592041, -0.7408867478370667, 0.034456998109817505, 0.6470891833305359, -0.51402747631073, -0.051295600831508636, 0.414023220539093, -0.2843106985092163, -0.611854612827301, 2.4070563316345215, -1.9100760221481323, -1.5357072353363037, -2.018958330154419, -0.6762449741363525, 0.037274908274412155, -0.6020921468734741, 0.6553258895874023, 0.305675208568573, -0.7068540453910828, -1.6182398796081543, 0.015265834517776966, -0.9406511783599854, 0.31132686138153076, -1.22738778591156, -0.6861801743507385, 0.1783296912908554, 1.2678431272506714, -1.4514343738555908, -0.9503175616264343, -0.48018255829811096, -1.1727020740509033, 0.35109540820121765, 0.7464498281478882, 0.8238241672515869, 0.450074702501297, -1.4109500646591187, -1.2889310121536255, -0.7699221968650818, -1.5307692289352417, 0.23774920403957367, -0.07771093398332596, 0.7041813135147095, 1.9395525455474854, -0.001761731575243175, 0.22280462086200714, 1.0757728815078735, 2.393787384033203, -1.201690912246704, 0.10750351846218109, 1.6287927627563477, -0.1046762615442276, -0.5813273191452026, 0.899783730506897, -0.4647679328918457, 0.6153604388237, -1.344923496246338, -0.9450937509536743, 2.2140491008758545, -0.24963030219078064, -0.5032914876937866, 0.2652854025363922, -16.81472396850586, -0.4756350517272949, 0.7113402485847473, -0.8328512907028198, 0.17580841481685638, 1.6338189840316772, -0.22323040664196014, 1.4692378044128418, -0.16850684583187103, 0.19754184782505035, -1.595724105834961, 0.03009255975484848, 1.0276246070861816, 1.255689263343811, -1.1055618524551392, 1.0406453609466553, 1.234370470046997, -0.0025478946045041084, -0.7914472818374634, -0.7274397015571594, -1.759128212928772, 0.7964094877243042, 0.8784973621368408, -1.2100622653961182, -1.0531880855560303, 1.2671010494232178, -1.47098970413208, 1.0124670267105103, -16.27277183532715, 0.9429258108139038, 0.3543539047241211, -0.3368174731731415, 0.026631223037838936, -0.264556884765625, -0.12332679331302643, 0.68418949842453, 0.5326535701751709, 1.221169352531433, 1.4491039514541626, 0.9974815249443054, 1.008873701095581, -0.9212483167648315, 0.5853275656700134, 0.680463969707489, -0.762165367603302, -0.9082788825035095, -0.8651331663131714, 0.8764491081237793, 0.6322692632675171, -0.4257327616214752, -1.4812343120574951, 0.6692575216293335, 0.35522472858428955, 0.020784063264727592, 0.3926061689853668, 0.5592367649078369, -2.2321250438690186, 0.44866377115249634, -1.5884472131729126, 0.9680243134498596, -0.042712125927209854, -0.04479517415165901, -0.5223777890205383, 0.11090266704559326, 2.8795735836029053, -0.059410255402326584, 1.367696762084961, 1.0104109048843384, 1.0485363006591797, 2.280346155166626, -1.6145436763763428, 0.7226240634918213, -1.0606352090835571, -1.0492459535598755, 2.1789565086364746, 1.049917221069336, -2.12003493309021, -0.1969192624092102, 0.025027424097061157, -1.4242974519729614, -0.07011451572179794, -0.9909799695014954, 0.1936083287000656, -0.47714152932167053, -0.17193001508712769, 1.528804063796997, 1.4526723623275757, 0.23142899572849274, 0.8413364887237549, 0.25608840584754944, 0.1312517672777176, -0.5519106388092041, -1.6724668741226196, -1.38156259059906, -0.12558193504810333, 1.2957631349563599, -0.9844071865081787, 0.2856094539165497, 0.19206856191158295, 0.8077535033226013, -0.1917864978313446, -0.9130072593688965, 0.5451112985610962, 1.0855880975723267, 0.6751934289932251, 0.5115293860435486, -0.7866637110710144, -2.014498710632324, -1.6756293773651123, -16.1190128326416, -0.8957995176315308, -0.6321252584457397, 0.8952350616455078, -1.7079795598983765, 0.46583837270736694, 0.1668320894241333, 0.5923327207565308, -0.2137543112039566, -0.6828585863113403, -0.5758954286575317, 0.5124872922897339, -1.6894354820251465, -0.7290725708007812, -0.8144559860229492, 0.7050476670265198, 0.4893008768558502, -2.182929754257202, 1.27292799949646, -0.06247672066092491, 0.8009005188941956, 0.2561218738555908, 0.8117763996124268, 0.19486039876937866, 0.23540756106376648, -0.31352195143699646, 0.8294742703437805, -0.1739511638879776, 0.052081093192100525, 0.41162678599357605, -0.6452885866165161, -0.1748160421848297, -17.841047286987305, 0.46518006920814514, 1.4374712705612183, -1.605621576309204, -0.746814489364624, 0.41871553659439087, 2.005842924118042, 0.33892789483070374, 0.12383391708135605, -1.204506754875183, 0.48322609066963196, -0.9528567790985107, -1.1776970624923706, -1.5957107543945312, -15.995158195495605, 0.3059085011482239, -1.1981648206710815, -1.0372120141983032, 0.335614413022995, -0.8478152751922607, 1.6385632753372192, 0.33678799867630005, 1.4130855798721313, 0.8152469396591187, -0.22295336425304413, 1.9964346885681152, -0.17147403955459595, 1.0351945161819458, 0.8039893507957458, 0.47053855657577515, 1.0400878190994263, -1.4221049547195435, 0.39339298009872437, 2.476269245147705, 1.3608121871948242, 0.8574216961860657, 1.3060193061828613, -0.4877121150493622, -0.8420104384422302, -0.21766172349452972, -0.1476130485534668, 0.9214089512825012, -1.3684483766555786, -0.2799336612224579, 0.8721266984939575, 0.9733870029449463, -0.4510214626789093, 0.1301327794790268, 1.7030187845230103, 1.4757856130599976, -0.08572908490896225, -0.27936917543411255, -2.1799514293670654, 0.9235376715660095, 0.7374180555343628, -1.5378103256225586, -0.0783860981464386, 0.8235894441604614, 0.7584936022758484, -0.40754595398902893, -0.7514529824256897, -0.45264002680778503, -0.01025415025651455, -0.06798487901687622, -0.08892176300287247, 1.554559350013733, 0.2436915636062622, 1.137917160987854, -0.6013755798339844, 1.2564067840576172, 0.5166884660720825, -0.44693344831466675, 1.2904760837554932, 0.6261120438575745, 1.3044620752334595, 0.2227696180343628, 0.9963104724884033, -0.7709411978721619, -0.2784344255924225, -0.43644392490386963, -0.11753425747156143, 0.74483323097229, 0.6001580357551575, 0.9330437183380127, -0.4621613323688507, 0.43371570110321045, 1.4557440280914307, 0.7685015797615051, 1.4841842651367188, -0.9003505706787109, -1.2768909931182861, 0.4806360602378845, -0.8975182771682739, 0.5874520540237427, -1.7340352535247803, -0.5077062249183655, 1.190496563911438, 0.5600138902664185, 0.7466943860054016, -0.04488654434680939, -1.3145887851715088, -0.722804069519043, 2.3811278343200684, 0.1669309139251709, -0.6201352477073669, -1.1645114421844482, -1.1166659593582153, 0.34250780940055847, 1.3767229318618774, -0.7110116481781006, 0.7190184593200684, -0.07678399235010147, -0.8146811127662659, 0.7209041714668274, 0.895696759223938, 1.084598422050476, -0.2019471526145935, -0.5789644122123718, -0.8840939402580261, 0.6187095046043396, -1.3864963054656982, 2.070247173309326, 1.7565488815307617, 1.4677296876907349, -0.35704877972602844, 2.320906162261963, -0.36335334181785583, -0.08777927607297897, 1.438997507095337, 2.046210289001465, -0.6693236231803894, 1.5056686401367188, -1.442528247833252, 0.7850504517555237, -0.553475022315979, 0.8326556086540222, -0.0836772695183754, 1.0649988651275635, -0.003643062897026539, -2.7051169872283936, -0.05984551087021828, -0.06576738506555557, 0.833958089351654, 1.3557671308517456, -0.3374423384666443, -0.1963731050491333, 0.19842824339866638, 0.5977802276611328, -0.13203245401382446, 0.27870410680770874, -0.5952009558677673, -2.76741886138916, -1.6012834310531616, 0.3394635021686554, 1.6694308519363403, 2.243549108505249, -0.8280346989631653, 1.4482253789901733, -0.9859783053398132, 1.1359801292419434, 0.19358403980731964, 0.00034424697514623404, 0.6478182673454285, 0.11425662040710449, -1.6442830562591553, -3.2436001300811768, 0.17008014023303986, 0.36674079298973083, 0.3181275725364685, 1.4179480075836182, -1.1387507915496826, -0.28027981519699097, 1.1032465696334839, 0.9986934065818787, -0.014459697529673576, -1.296858310699463, -2.2033865451812744, 0.7776454091072083, -0.0779646709561348, 0.3479868173599243, 0.4866902530193329, 0.9375062584877014, 1.9371817111968994, 0.39532092213630676, -0.4601958692073822, -0.5223142504692078, -0.2802289128303528, 0.9544676542282104, -0.9836066365242004, 0.3328557014465332, 0.2569635510444641, 1.5853337049484253, 1.7339459657669067, 1.124327301979065, 0.5836928486824036, 0.17328248918056488, 0.10099083930253983, -1.484749436378479, -0.07502461224794388, -0.7740309238433838, 0.7142006754875183, -0.028070762753486633, -0.1274649202823639, 0.16630563139915466, 0.29330846667289734, 0.009991300292313099, -0.3142090439796448, 2.164044141769409, -0.2787639796733856, 2.0730974674224854, -1.1931761503219604, -1.4785491228103638, -0.2547783851623535, 0.8330868482589722, -1.082543134689331, -2.0119872093200684, 0.7014238834381104, 1.6178847551345825, 0.6112331748008728, 0.7232083082199097, -1.0272164344787598, 0.7205721735954285, 1.2688850164413452, 1.7985633611679077, 0.07439373433589935, -0.6258048415184021, 0.4012311100959778, 0.9112706780433655, -0.16046790778636932, 1.4745912551879883, -0.04451070725917816, 1.0460928678512573, 0.25341930985450745, -0.22225041687488556, 2.3163344860076904, -0.018689151853322983, -1.090415358543396, -1.494855284690857, 1.5369490385055542, 0.7350398302078247, -1.5981546640396118, 0.6086006760597229, 0.6991204619407654, 0.7388693690299988, -0.25497984886169434, 0.04092460125684738, -0.094046950340271, 0.5575379133224487, -0.3047392666339874, -0.9736171960830688, -0.5364423990249634, 0.6701542139053345, -0.6270133256912231, -1.817793607711792, -0.02539786323904991, 0.4445766806602478, -0.6043509840965271, -0.9321532249450684, -0.3684554398059845, 1.3188347816467285, -2.147470235824585, -0.9807696342468262, 0.7160242795944214, -1.1919763088226318, 1.2071247100830078, 1.7753151655197144, -0.7245526313781738, -0.2872799038887024, 0.9234757423400879, -0.14636528491973877, 0.8924117684364319, -1.0945273637771606, 0.32743343710899353, 1.392268180847168, 0.35581785440444946, -1.1224915981292725, 0.07003988325595856, 1.5685561895370483, -0.5784863233566284, 0.9411221742630005, -0.6314911842346191, -1.4099501371383667, -1.6790157556533813, -0.9715328812599182, 0.2605281174182892, 1.072912335395813, -0.32148656249046326, 0.04497804492712021, -0.15955588221549988, 1.2642651796340942, 0.6036859154701233, 0.6972323656082153, -1.1037428379058838, 0.3604259192943573, -0.33086007833480835, 1.5716382265090942, -0.25446826219558716, 1.4697771072387695, 0.6139386892318726, -1.020544409751892, 2.537602424621582, 0.8845472931861877, -1.7031573057174683, 2.3164570331573486, -1.353914499282837, -10.378015518188477, 2.815650463104248, 0.7328245639801025, -0.2879813313484192, 0.8418683409690857, -1.1191067695617676, -1.4463146924972534, -0.24359211325645447, 0.5683329701423645, 0.8327547907829285, 0.5158776044845581, 1.5648314952850342, 1.835124135017395, -0.8047173023223877, -0.29429560899734497, -0.23190566897392273, -0.21611684560775757, 0.5168071389198303, -1.0362200736999512, -0.440332293510437, 0.4190625846385956, 0.30957794189453125, -0.47781386971473694, 2.481504440307617, 0.23530493676662445, 1.3036249876022339, -2.159163475036621, -0.581569254398346, -5.433287620544434, 1.4209409952163696, 0.528868556022644, 0.1241907924413681, -1.0265674591064453, 1.2221848964691162, -1.7742794752120972, 2.076120138168335, 1.3131903409957886, -0.1608954221010208, -0.17757129669189453, -2.8277077674865723, -0.5678718686103821, -1.788385033607483, -0.9937219023704529, -0.752764880657196, -3.037280321121216, 0.05599171668291092, -0.5337303280830383, 0.8946186304092407, 0.7590159773826599, -0.9130062460899353, 0.10859932005405426, 0.7076029777526855, -1.09146249294281, -0.8140619993209839, 0.2421218603849411, -1.5965911149978638, -0.33654335141181946, 0.23827028274536133, 0.32572141289711, -0.03473755344748497, -2.0085337162017822, -1.6713262796401978, -2.0646865367889404, -0.9501588344573975, -2.0937085151672363, -0.3493105471134186, 1.5513554811477661, 2.8225018978118896, 0.7044260501861572, 0.5933002829551697, 2.330284833908081, -0.350949227809906, -3.8495283126831055, -0.029960550367832184, 1.6004738807678223, 0.4136434495449066, 0.5793569087982178, -0.5036476850509644, 2.7832021713256836, 1.0875496864318848, -0.23068654537200928, -0.3102140426635742, -1.8469874858856201, 1.6488765478134155, 0.056168895214796066, -1.2632560729980469, 0.6850100755691528, -1.388835072517395, -0.9959481954574585, 0.7459391951560974, -0.2684158682823181, 0.9559957385063171, 0.42467108368873596, -0.23955221474170685, -1.691096305847168, 0.6897087097167969, 1.0976282358169556, -0.8715881705284119, -0.5778602957725525, 0.9335210919380188, -0.09698528796434402, -1.8375887870788574, 0.022812288254499435, -1.077928066253662, -0.1851189136505127, -0.38787752389907837, 1.671531319618225, 0.2916472852230072, -0.45621758699417114, 0.15477509796619415, -0.5092825889587402, 0.24753594398498535, -0.5241860151290894, 0.04958239570260048, -0.6226125359535217, 0.3963027596473694, 0.0696180909872055, -0.41744813323020935, -0.8592033982276917, 0.3856823444366455, 0.5560957193374634, -0.8068913817405701, 0.2790158987045288, -0.7129802107810974, -0.17531628906726837, 2.0369060039520264, -1.8029893636703491, 1.5662579536437988, 0.15087324380874634, 1.5248433351516724, 1.0311506986618042, 0.12273179739713669, -0.06446129828691483, 0.7943485975265503, 0.7219656109809875, 0.429450660943985, -0.47537723183631897, 1.8052990436553955, -1.0725960731506348, 0.1880982369184494, -0.8828526139259338, 0.10751473158597946, -0.506808340549469, -0.6035768389701843, -1.114205002784729, 0.13896918296813965, 0.3404039442539215, -0.574296236038208, 0.14585141837596893, -1.3629764318466187, 1.0821032524108887, 2.3850715160369873, 0.15888796746730804, 0.2881679832935333, -1.3206462860107422, 0.24685414135456085, -0.0028596254996955395, -0.9693610072135925, -1.0902482271194458, -0.3112451136112213, 0.6642235517501831, 0.23652541637420654, 0.4780943989753723, 0.33063989877700806, 0.5106430053710938, -0.8584216833114624, -1.6349581480026245, 0.03824375942349434, 0.17019903659820557, 0.7222962975502014, 0.04280532896518707, -0.6173800230026245, 0.5227164626121521, 1.2668834924697876, 0.42091789841651917, 1.4242950677871704, -0.0756620317697525, 0.8512700200080872, -13.035858154296875, -0.5484738349914551, 1.340429425239563, -1.8342939615249634, -0.5822285413742065, -14.395211219787598, -0.24219103157520294, -0.30885323882102966, -0.5169720649719238, 0.02916080877184868, 1.679809331893921, -0.49800407886505127, 0.8072046041488647, 0.05431241914629936, -0.6489418745040894, -0.4586397707462311, -0.16002821922302246, -0.7214706540107727, -0.6242067217826843, -1.0067099332809448, 0.9090010523796082, -0.7896755933761597, -1.223612904548645, 0.1937488168478012, 0.6677128672599792, 0.2522946298122406, -0.09466107189655304, -0.6786940097808838, 1.1850227117538452, 0.1540394127368927, 0.4015050530433655, -1.198108434677124, 0.4012439250946045, -1.2102842330932617, -0.6701326966285706, -0.8988478183746338, 1.1040626764297485, 0.902169406414032, -0.891193151473999, -0.9487868547439575, -1.7172187566757202, 0.7706246972084045, 0.2017737627029419, -0.397836297750473, 0.22104600071907043, -0.17315040528774261, -0.43517133593559265, 2.789371967315674, -0.4947224259376526, 2.1381988525390625, -0.1334267556667328, -2.316788673400879, 0.9174936413764954, 1.379286289215088, -0.9487485885620117, 0.8908724784851074, 0.032758768647909164, 1.4348994493484497, 1.1514085531234741, 0.1770613193511963, -0.1355336457490921, -8.528979301452637, -0.030753016471862793, 0.2829327881336212, -0.5718193650245667, -0.9413595199584961, 0.09313500672578812, 1.5108909606933594, 1.1195300817489624, 1.9688118696212769, 0.3853084444999695, 0.24633657932281494, -0.1264820396900177, 0.0491187646985054, 0.1171201840043068, -2.2252190113067627, -0.07937432825565338, 1.6214256286621094, -0.2237236499786377, 0.7718801498413086, -0.06230146810412407, 0.540649950504303, -0.7543508410453796, -2.0481557846069336, -0.8805294036865234, -0.6706892848014832, 1.5336519479751587, -14.976629257202148, -0.4306672215461731, -1.3345446586608887, -0.09574656188488007, -0.0631290078163147, -0.09476922452449799, 1.3543332815170288, 0.4976467192173004, -0.12491096556186676, 0.684242844581604, 0.09167739748954773, 1.8080880641937256, -0.18669475615024567, 1.1828924417495728, -0.6292058825492859, -0.42312872409820557, -0.33301424980163574, -0.35450229048728943, 0.5073098540306091, 0.36232373118400574, -1.6447889804840088, -0.21958909928798676, 1.5666335821151733, 1.403896689414978, -1.7889955043792725, 0.4854350686073303, -0.3794035315513611, 0.7633276581764221, -0.39117223024368286, -2.1034185886383057, 1.7694284915924072, 0.31606751680374146, 0.1720627099275589, 0.35632428526878357, 0.10686042159795761, -1.6658391952514648, -0.4720253050327301, -14.066549301147461, 1.862431287765503, -0.020748263224959373, 1.186438798904419, -0.053098734468221664, -1.1223556995391846, 0.6722441911697388, -1.1477198600769043, -0.7559611201286316, 0.5350112318992615, -0.06506924331188202, 1.0160545110702515, 0.013905627653002739, -0.7726896405220032, 1.0372580289840698, 0.22857694327831268, -0.14428403973579407, 0.16219563782215118, 0.8546177744865417, -0.0029818438924849033, 0.07215508073568344, -1.1474395990371704, -0.13490192592144012, -1.6201989650726318, -1.0758795738220215, -1.1990020275115967, -0.26391512155532837, 0.31985703110694885, 0.31163179874420166, -0.10845039039850235, 1.2694720029830933, 0.07296031713485718, -0.24907273054122925, 0.05222496762871742, 1.5927375555038452, -0.5503891706466675, 17.654451370239258, -0.32949602603912354, 2.0230350494384766, 0.36366552114486694, -1.8993747234344482, -0.1630266010761261, -0.05467938631772995, 1.115005612373352, -13.109701156616211, 1.0954816341400146, -0.6118172407150269, 1.3035340309143066, 0.10535354912281036, -0.305643767118454, -0.47870203852653503, 0.280754029750824, 0.43934541940689087, -0.5638266205787659, -2.5092289447784424, 0.45033231377601624, -0.8232510685920715, -0.607451856136322, -0.1402508169412613, -0.20493027567863464, -0.35434454679489136, 1.213202714920044, 0.7718878388404846, -0.6896661520004272, -0.894406259059906, 0.061743900179862976, 1.126186490058899, -0.5950273275375366, 0.4011070728302002, -1.8809897899627686, -0.7321900129318237, 1.633370280265808, 1.2150603532791138, -1.0372966527938843, -0.9410250782966614, -0.4209635853767395, -0.05703616514801979, -1.0543177127838135, -1.2701748609542847, 0.2601165175437927, -0.15998044610023499, 0.6695264577865601, -0.4947260320186615, 0.5982447266578674, -1.1181352138519287, -0.8558754920959473, 1.2345069646835327, -1.8866870403289795, 2.286816120147705, 1.0825996398925781, 0.17978574335575104, -0.9339504837989807, 1.9441200494766235, 0.9553858041763306, 0.5414735674858093, -0.18554240465164185, -0.08535893261432648, 0.6493269205093384, 0.13637638092041016, -1.4415183067321777, -0.9448647499084473, 0.13010573387145996, 1.3937077522277832, -0.09139358997344971, -1.9775652885437012, -0.6902911067008972, -0.29119911789894104, -0.4073745608329773, 0.39427638053894043, 0.22448068857192993, 1.5178422927856445, -0.8654325008392334, 1.7306067943572998, -0.2161431461572647, 0.5929462313652039, -0.998562753200531, 0.09069707244634628, -1.329700231552124, 0.3325282335281372, -1.1582615375518799, -0.086154505610466, 0.6415342092514038, 1.2859805822372437, 0.20250403881072998, 0.5200018882751465, -0.5138454437255859, 0.35696032643318176, 0.4212842583656311, 1.5117391347885132, 1.282814860343933, -0.7025047540664673, 1.6587698459625244, 0.027712173759937286, 0.5884730219841003, 1.560989260673523, -1.3832226991653442, -1.0168832540512085, -0.986527144908905, -15.616085052490234, -1.195932388305664, 1.5562121868133545, -0.5910977125167847, -0.0803278312087059, 1.0250804424285889, 1.2890678644180298, 1.343786597251892, -0.5825350284576416, 1.0040615797042847, -0.34046900272369385, 1.6401185989379883, 0.576945424079895, -1.0398982763290405, 0.03183569759130478, 1.202683448791504, -0.7917919158935547, -1.4305193424224854, -0.8436723351478577, 0.19243191182613373, -0.9080973863601685, 0.41194942593574524, -0.5918930172920227, -0.016402101144194603, -0.8484784364700317, 1.7396475076675415, 0.37869104743003845, -0.5124624967575073, 0.6521408557891846, -1.3678990602493286, -1.1515439748764038, 2.490232229232788, 1.168036937713623, -0.43216732144355774, 1.2971546649932861, -0.5716459155082703, -0.6945483684539795, 0.17257602512836456, -0.37215593457221985, -0.056403134018182755, -0.8163371086120605, 1.0243500471115112, -1.5736056566238403, 0.09937037527561188, -1.6000322103500366, 0.5962218046188354, 1.0127381086349487, 1.0177726745605469, -8.537287712097168, 0.7434054017066956, 1.3574084043502808, 1.25550377368927, -0.5816182494163513, -1.2965337038040161, 0.3532499074935913, -1.073146104812622, 0.10436688363552094, -0.7650768756866455, -2.059004545211792, 0.646730899810791, -0.6649861931800842, -0.4549941122531891, -0.6329873204231262, 1.7939516305923462, -2.816739082336426, -0.7044534683227539, 0.5675078630447388, 0.8222969770431519, -0.9015437960624695, -0.21509253978729248, -1.9019112586975098, 0.95953369140625, -0.09633567184209824, -0.6322488784790039, -0.669911801815033, 0.7206664085388184, -1.0647083520889282, -1.2252411842346191, 0.17738905549049377, 0.7078015208244324, -0.32561081647872925, 0.597207248210907, -2.114741802215576, 1.475508213043213, 0.20737779140472412, -0.9283602237701416, 0.20439264178276062, 0.3790736794471741, 0.306873619556427, -0.3203161954879761, 0.1920856088399887, -1.233883023262024, 1.1247987747192383, 0.7667765021324158, 0.12624159455299377, 0.0810849517583847, 1.758081316947937, 0.518388569355011, 0.5950789451599121, 1.1666510105133057, -0.15198160707950592, 1.4171665906906128, 3.2120416164398193, -0.9335529804229736, 0.9220122694969177, -1.0696237087249756, 0.3414382338523865, -1.9705979824066162, 1.3305031061172485, 1.0418074131011963, -0.3065810799598694, -0.54291832447052, 1.3716752529144287, 0.28641003370285034, -0.3895299732685089, 0.7069809436798096, 2.195507049560547, -1.1988015174865723, 0.8874413967132568, -0.3337860405445099, -0.9457858800888062, 0.977327287197113, 1.0391780138015747, -2.7172675132751465, -1.0479652881622314, 1.703545331954956, -1.8857994079589844, 0.7434396743774414, -0.22589921951293945, 0.5080916285514832, -0.7942342758178711, -0.7158393859863281, 0.6265300512313843, -0.33986514806747437, -0.38339826464653015, 0.2608870565891266, 0.3786708116531372, 0.10844673961400986, 0.30154114961624146, 1.0136983394622803, 1.4352492094039917, 0.509244978427887, 0.6342450976371765, 0.6975390911102295, -0.24401986598968506, 1.0945762395858765, -1.0535699129104614, -0.345050185918808, 0.5153366923332214, 0.06146484240889549, 1.9911527633666992, 0.4812977910041809, 0.008555023930966854, 0.48025912046432495, 0.8199244141578674, 0.8867685198783875, 0.9009782671928406, -2.026609420776367, 0.18357013165950775, -2.8296959400177, 2.0732791423797607, -0.3791671097278595, -0.19618579745292664, -0.5270445346832275, -0.2277485877275467, 0.48678404092788696, 0.20635397732257843, -1.4937849044799805, -1.520634651184082, 0.3571586310863495, 0.23143036663532257, 0.6613379716873169, -0.9919701218605042, -0.0036317193880677223, -0.39521607756614685, 0.8691772818565369, 0.9167015552520752, 1.2709802389144897, 0.4912343919277191, -0.5811675190925598, 0.372188925743103, -0.4690937399864197, 1.7639840841293335, 1.0055655241012573, 0.8153069615364075, 1.1979727745056152, 0.07230478525161743, -0.2838611304759979, -0.09414654970169067, -0.17530639469623566, 0.3677337169647217, -1.0603389739990234, 0.15675923228263855, 1.9492597579956055, 0.5237636566162109, -0.8631822466850281, -11.874322891235352, 0.6379782557487488, 1.828825831413269, -1.0120792388916016, -0.4765055775642395, -0.05846289545297623, -1.3966317176818848, -0.8646023869514465, 1.8977097272872925, 1.353115200996399, -1.5334625244140625, -0.8815521597862244, -0.15798012912273407, -0.058337870985269547, 0.532469630241394, 1.5556018352508545, 0.939849317073822, -0.49883103370666504, 0.9025881290435791, -0.3857099413871765, -0.5224379301071167, -1.8398271799087524, -2.1516895294189453, -1.0726217031478882, -0.032650209963321686, 0.21180963516235352, 0.03989814594388008, -2.2702670097351074, 2.0250144004821777, 1.1389107704162598, -0.6634626388549805, 1.451834797859192, -0.6886111497879028, -0.22495216131210327, 0.46994081139564514, -0.13183219730854034, -10.68085765838623, 1.705812931060791, 2.4371471405029297, 0.03659787029027939, -1.2681840658187866, 0.2993476688861847, 0.9006182551383972, -2.5290324687957764, 1.969557762145996, 0.2336641401052475, -2.621241807937622, -1.3490240573883057, -1.0380618572235107, -0.26493528485298157, -1.2399587631225586, 2.094379186630249, -0.9386415481567383, 1.3708484172821045, 0.5132824778556824, -0.23952452838420868, 2.829627752304077, 0.9184777140617371, -0.6117316484451294, 1.4034119844436646, -1.3066439628601074, -0.9897106885910034, 0.8861128687858582, -1.7173433303833008, 1.0813006162643433, -0.44475921988487244, 0.291791170835495, 1.3480756282806396, -1.5808035135269165, 0.36117061972618103, -0.39915093779563904, 0.7748870253562927, 0.02196236327290535, 0.808763861656189, -0.37516021728515625, 0.8324567675590515, -1.8867981433868408, 1.8456076383590698, 0.006246994249522686, 0.39245906472206116, -0.4499349296092987, -0.7608712315559387, 1.4366445541381836, 0.4797314405441284, 1.2725962400436401, 0.770415186882019, 2.3158822059631348, -1.2942320108413696, -0.5230917930603027, -0.060336604714393616, -17.262590408325195, 0.2358059585094452, 0.44950518012046814, -0.6680936217308044, -1.0465143918991089, -0.46627506613731384, 2.601900100708008, 0.3522307574748993, -0.43491077423095703, 0.44225186109542847, 0.18784479796886444, -0.16664060950279236, -0.40807926654815674, -0.030797472223639488, -1.4427006244659424, 1.8951914310455322, -2.453676462173462, 0.6833840608596802, 0.7280128002166748, 0.09816546738147736, -2.8006484508514404, 0.7583257555961609, 2.1683781147003174, -1.0402206182479858, -0.27723243832588196, 1.0004363059997559, 0.4058937132358551, 1.5861258506774902, 0.04444229602813721, -0.9595088362693787, -0.35009944438934326, 0.04174785315990448, -1.110657811164856, -0.8913745880126953, -1.3062598705291748, 0.3104453980922699, -1.6932774782180786, 1.1429738998413086, -0.8669798374176025, -0.07972117513418198, -0.3884810507297516, 1.8499462604522705, -2.2935118675231934, -2.099231004714966, -0.8037652969360352, 0.438490629196167, 0.6817114353179932, 1.5372031927108765, -1.037184715270996, -2.68843412399292, 0.029729895293712616, 0.6439306735992432, -0.2949749231338501, 0.06198018044233322, 0.6057364344596863, 0.48707306385040283, 0.33853623270988464, 0.03353973850607872, 0.2692946195602417, 1.0887633562088013, -0.025638630613684654, -0.15723833441734314, -0.32857993245124817, -1.4267617464065552, -0.8466893434524536, 0.18526354432106018, 0.37843871116638184, 0.8204169273376465, -1.263515830039978, 0.1337158977985382, -14.703717231750488, 0.03464154154062271, -0.2942408323287964, 0.949377179145813, 1.0656063556671143, 0.980219841003418, 1.0590176582336426, -1.887660026550293, 1.673553228378296, 1.095031976699829, 0.1254546046257019, 1.0642516613006592, 0.4628940224647522, -0.3368959128856659, 0.8888725638389587, -0.6418585181236267, -1.0775847434997559, 0.061481229960918427, -0.21802808344364166, 1.2205787897109985, -2.7521138191223145, -0.0763612762093544, 0.2510630488395691, -1.4967186450958252, -1.5163602828979492, 0.6181238889694214, -0.9156143665313721, 0.6192349791526794, 0.673225462436676, 0.832312285900116, 0.3664748966693878, -0.6315797567367554, 0.9274417757987976, 0.4650891125202179, 1.0079208612442017, 1.1135789155960083, -0.5551636219024658, -0.43321046233177185, 0.8271651864051819, -13.358097076416016, -0.30065596103668213, -0.20922382175922394, -0.5492241978645325, 1.147196888923645, 0.5248516201972961, -1.1587306261062622, -2.3946309089660645, 1.4031367301940918, -0.7095744609832764, -0.8379448056221008, 0.014636813662946224, 1.0228456258773804, 1.439949870109558, -0.8192696571350098, 0.7681215405464172, -1.1877321004867554, 0.8651378750801086, -0.9717968106269836, -2.124981164932251, 0.6493049263954163, -0.7810777425765991, 0.6589838266372681, 0.5480828285217285, 1.2455652952194214, -0.8006664514541626, -0.026155348867177963, -0.939895510673523, 0.6888488531112671, 1.9560863971710205, 1.7880043983459473, -0.15943260490894318, -0.014856056310236454, 0.4859602749347687, 1.867674469947815, 0.12963111698627472, -0.546897828578949, -1.0576752424240112, -0.109074167907238, 0.760177493095398, 1.6701346635818481, -0.2398177534341812, -0.44233274459838867, -0.7103861570358276, 0.1658346801996231, -0.17658893764019012, -17.71272850036621, -0.07871290296316147, -0.8339056372642517, -0.8376621007919312, -0.9907053709030151, 0.10343385487794876, 0.023988977074623108, 0.11007966101169586, 0.3371148109436035, 0.7046290636062622, 0.9184283018112183, -0.8428018689155579, -0.5823182463645935, -0.4474068880081177, -0.7202632427215576, -4.00836706161499, 1.1784884929656982, 0.823794424533844, -0.4540175199508667, 1.6336270570755005, -0.48928508162498474, -0.2623986601829529, -0.36412885785102844, 0.3599531650543213, 0.980114758014679, -1.422319769859314, -0.9408910274505615, 0.053181201219558716, 1.852401852607727, -0.25005069375038147, -0.01865793764591217, -1.0440806150436401, 0.6152093410491943, 3.2362136840820312, -0.5908492207527161, -0.886317789554596, -0.0648660808801651, 0.4047950208187103, 1.190183162689209, 0.26027506589889526, 0.7767653465270996, -1.9637037515640259, -0.5915114283561707, -0.09389512985944748, -1.76845383644104, -1.1382228136062622, 0.12791016697883606, -0.00883052870631218, -1.0569487810134888, -0.9579132795333862, -0.8632407188415527, -0.2618480920791626, -0.396801233291626, -18.178020477294922, -0.9774775505065918, -0.366274893283844, 0.7461230754852295, -0.600890576839447, -1.7841830253601074, -0.47392019629478455, 0.603165864944458, 0.5163179039955139, -10.992321014404297, 0.05847696587443352, -0.592343270778656, 1.5862246751785278, 0.8122441172599792, 1.881186604499817, -0.0818980261683464, 0.4402371942996979, -2.6661839485168457, 0.9894747734069824, -0.054225511848926544, 0.12464079260826111, 0.6589090824127197, 2.2001771926879883, 0.313066691160202, 0.7375079989433289, 0.41681814193725586, 0.6376863718032837, 2.157684564590454, -1.2273969650268555, 1.1872786283493042, -0.4573284685611725, 0.9494034647941589, 0.7902413010597229, 1.2716025114059448, -0.462176114320755, 0.22423149645328522, 0.5235453844070435, 0.03857520967721939, -0.6611140966415405, -0.12166392803192139, 0.03991016000509262, 0.8005797266960144, 0.1749304234981537, -0.622341513633728, -0.8815299868583679, -0.2119225114583969, -0.23364098370075226, -0.7931767702102661, 0.15945646166801453, -17.028030395507812, 0.005897479131817818, 0.5356499552726746, 0.42887505888938904, 0.7870733737945557, -0.7234447598457336, -0.9870204329490662, -0.0773141160607338, 0.9821524024009705, 1.1649806499481201, -0.12016602605581284, -2.43200421333313, -1.0437577962875366, -0.11741319298744202, 0.9171713590621948, -0.7017033100128174, 1.222437858581543, 0.7034915685653687, 1.9196767807006836, -0.8819275498390198, 0.21667349338531494, 1.2941006422042847, -0.27463066577911377, -1.1863218545913696, -1.1033430099487305, -9.332086563110352, 1.4458307027816772, 0.25789228081703186, 0.535156786441803, -2.0031635761260986, 1.0826808214187622, -0.3361513316631317, 0.5581792593002319, 0.03784014284610748, 0.5145555734634399, 1.3542276620864868, 0.506960928440094, -0.731766402721405, 1.2969634532928467, 0.6230394244194031, -0.374491810798645, -0.5775874257087708, -1.060779333114624, 0.9071971774101257, -0.7867053747177124, -0.7898997664451599, -0.7902092337608337, -0.30557358264923096, 1.4898964166641235, -0.13154630362987518, 0.36201420426368713, -11.6278657913208, -0.7838272452354431, 0.5117935538291931, 1.4351812601089478, 3.589482069015503, 0.5996702313423157, 0.009487634524703026, 0.7710534334182739, -0.15626490116119385, 0.9651121497154236, -0.6725803017616272, 0.040934979915618896, 1.0634393692016602, -1.0089812278747559, 1.3621327877044678, 0.8973782658576965, 0.027787597849965096, -0.4637056887149811, -0.2552837133407593, 0.26068222522735596, 1.768730640411377, -0.09331463277339935, 1.2852144241333008, 1.9812726974487305, -0.1229957565665245, -8.998945236206055, 0.9613778591156006, -0.5659896731376648, -0.1479998379945755, -0.5458599328994751, 0.6614067554473877, -0.6111403703689575, -0.9215565323829651, -0.8023243546485901, -1.3198460340499878, 0.7303836941719055, 0.28218385577201843, 0.01903741993010044, 0.5154340267181396, 0.8165992498397827, -1.4467154741287231, -13.183234214782715, -0.46268683671951294, 1.672405481338501, -0.14179681241512299, -0.8717766404151917, 0.7382022738456726, 0.6462942957878113, 1.059098243713379, -0.12975145876407623, -1.6001648902893066, 1.37491774559021, -0.9902151226997375, 0.9252652525901794, -1.6897380352020264, 0.45038798451423645, -1.3305766582489014, -0.7576790452003479, 0.1494760364294052, 0.7529374361038208, 1.2413376569747925, 1.0127135515213013, 0.9586888551712036, -0.8108838200569153, -2.5177032947540283, -0.2921208143234253, 0.42712390422821045, -0.3690865635871887, -0.8415383696556091, -1.3813799619674683, -0.05412294715642929, -1.3543334007263184, -0.6816694140434265, 0.28382015228271484, -0.7125266790390015, 0.6809104681015015, 1.8081843852996826, -0.5256606936454773, 1.2910276651382446, -2.8103644847869873, -0.007727497722953558, -1.5950288772583008, -0.016249587759375572, 1.2788645029067993, 0.8427976369857788, 0.8032383322715759, -1.419708490371704, 0.21402595937252045, 0.13663731515407562, -0.7478765845298767, 0.8583692908287048, 0.8433430194854736, 0.44367989897727966, 0.05933360382914543, 0.27476394176483154, -0.47082504630088806, -0.6086178421974182, 1.4247770309448242, 1.044184684753418, 0.27080950140953064, -0.9133725762367249, -0.2002360224723816, 1.3023815155029297, 0.2640337347984314, 1.3978850841522217, -2.4831926822662354, 0.17869111895561218, -1.3552063703536987, -0.6490508317947388, 1.4834926128387451, 1.1455827951431274, 0.6718537211418152, 1.4731433391571045, 0.3169265687465668, 1.3375550508499146, 0.966291069984436, 2.2469418048858643, 0.608099102973938, 0.35112494230270386, -0.49248236417770386, 0.32013359665870667, -0.5333873629570007, -2.706244707107544, 0.2822834849357605, 0.4001067280769348, -1.6755260229110718, 0.33172377943992615, -1.258212924003601, 0.44957679510116577, -0.35861778259277344, -0.2339956909418106, 0.1301838755607605, -0.09033642709255219, 0.987113356590271, 0.1525719165802002, 0.6331485509872437, 0.26770463585853577, 0.1216874048113823, -1.213758111000061, -0.9156219959259033, -0.7004855275154114, -0.3114033043384552, -1.6661114692687988, 0.2788669168949127, -0.6388514041900635, -1.1861014366149902, 0.0015040644211694598, 0.006108640227466822, -0.1413079798221588, -0.7120456695556641, -1.6792235374450684, -1.002279281616211, -0.602512776851654, -0.9231656789779663, 1.0999276638031006, -0.6823145747184753, 0.7205862998962402, -0.5939916372299194, 1.6157293319702148, -0.13535518944263458, -11.591750144958496, -0.34134742617607117, 1.7528249025344849, 1.308028221130371, -0.19935105741024017, -0.4654484987258911, -2.1405692100524902, -0.11464904248714447, 0.2545086741447449, 1.6193416118621826, 1.611379861831665, -3.045799970626831, 0.200917050242424, 1.4972009658813477, 0.3802821934223175, 0.6186553239822388, 1.1586490869522095, 0.6650059819221497, -0.060789208859205246, 0.019895093515515327, -2.2126572132110596, 0.2729663848876953, 1.333056092262268, -0.015412886627018452, 0.10189667344093323, -1.644769549369812, -4.416031837463379, -0.7558957934379578, 0.06842377036809921, -0.5892367959022522, 0.3151935040950775, 1.942173719406128, 0.2508658170700073, 1.0734959840774536, 0.988368570804596, -1.3014321327209473, -1.6809593439102173, 0.3224863111972809, 0.13087302446365356, 0.47470858693122864, -0.39842697978019714, -0.8063485026359558, 2.6841530799865723, 1.3365929126739502, 0.2819811999797821, -1.4120151996612549, -9.753790855407715, 0.9397339224815369, -0.3843245506286621, -0.2943519651889801, -0.29341042041778564, 1.6760634183883667, 2.5923261642456055, -0.6896306872367859, 0.42720454931259155, -0.0950261801481247, 0.9743184447288513, 0.10570753365755081, -1.5005143880844116, 1.9842597246170044, 0.840787947177887, -0.13817238807678223, 0.09227923303842545, 0.06360599398612976, -0.4867922067642212, -1.2949665784835815, -0.15764589607715607, 0.0009439492132514715, 0.10398363322019577, -0.9455431699752808, -0.44982680678367615, 1.0367921590805054, 0.021096521988511086, -0.061760064214468, 0.19567517936229706, -0.6506775617599487, 0.6867721676826477, 1.0509916543960571, 1.288507342338562, -0.5204434990882874, -1.3244214057922363, -0.19473925232887268, -1.8324904441833496, -0.4944448471069336, -1.3192551136016846, -0.652898907661438, -9.334442138671875, -0.25213488936424255, 0.6400492191314697, -3.4672858715057373, -0.47468140721321106, 0.3361824154853821, -0.20823362469673157, -0.6683828830718994, -1.193593978881836, -0.32731491327285767, 1.004419207572937, -0.5275686979293823, -0.317466676235199, 0.10949072241783142, -0.12290702015161514, -1.3155577182769775, 0.366690456867218, 0.771801769733429, 0.44662413001060486, -1.5276638269424438, -1.3230669498443604, 0.20462195575237274, 1.8637510538101196, 0.14475853741168976, -1.1575771570205688, 0.4982936382293701, 1.1362082958221436, -0.915822446346283, -2.0589284896850586, 0.23083434998989105, -0.21585200726985931, 0.8680292963981628, 1.0821572542190552, -0.6637921333312988, 0.3594973683357239, 0.43652600049972534, -1.0417991876602173, 0.4782133102416992, -0.3308417499065399, 0.07928723096847534, 0.3300573527812958, 0.6143463253974915, -0.16104091703891754, -0.08327235281467438, -0.9025706648826599, 2.0935311317443848, 0.25402209162712097, 0.11729621887207031, 1.1430819034576416, -0.017969880253076553, -0.07272127270698547, -1.0794461965560913, -16.385643005371094, -2.1354007720947266, 0.7724785208702087, 1.3257800340652466, -0.49635976552963257, -0.8218998312950134, -0.1938534379005432, -16.838359832763672, -1.291990041732788, 0.3394698202610016, -0.8392615914344788, 0.7495627999305725, -0.436113566160202, 0.018475987017154694, -2.1119918823242188, -0.2827478349208832, -1.5352637767791748, 1.4986728429794312, 0.011971302330493927, 0.6356011629104614, -0.9305954575538635, -0.6863175630569458, -0.5862239599227905, 0.1491260826587677, -0.16878502070903778, -1.9704045057296753, 1.7435494661331177, -0.08720678091049194, -1.9521324634552002, -0.820746123790741, 1.1895002126693726, -18.609771728515625, -1.683104395866394, 2.2372658252716064, 2.192441940307617, 0.6087211966514587, 1.9873595237731934, -1.1079953908920288, -0.6279205083847046, 0.08987024426460266, 0.8234704732894897, -0.8581265211105347, 0.5055385231971741, -1.39246666431427, 1.227686882019043, 1.3600412607192993, 0.5339385271072388, 0.591687798500061, 0.686722993850708, -0.25401824712753296, 0.4140390157699585, -0.8115792274475098, -1.5952458381652832, -0.5557762384414673, -1.023980736732483, -1.4318197965621948, -0.9455269575119019, 0.6015426516532898, 0.9530626535415649, 0.4517519176006317, 0.8183997869491577, 0.38313189148902893, 1.34036123752594, 0.8329271078109741, -1.0345044136047363, 0.633255124092102, -0.20929963886737823, -0.5633736252784729, 0.8527390360832214, 0.5890200734138489, -0.29031533002853394, -0.06800195574760437, 1.4182853698730469, -1.03180992603302, -0.7187442779541016, 0.6732690930366516, 0.05404302477836609, -0.5124194622039795, -1.791397213935852, 0.9855877161026001, 0.24904637038707733, -1.2164089679718018, -0.6871855854988098, -0.36452245712280273, 1.9152164459228516, 0.6008225679397583, 1.1885716915130615, -0.7017045021057129, -0.47994565963745117, 1.389529824256897, -0.192158043384552, 0.8286932110786438, 0.050339799374341965, 1.050615668296814, 0.016554944217205048, -0.6626673936843872, -0.9870953559875488, -12.272773742675781, -1.1102540493011475, -0.9634755253791809, -1.5194646120071411, -1.7228291034698486, -0.48310473561286926, -0.11560092121362686, -1.4221833944320679, 1.2484804391860962, 1.8492896556854248, 0.40925633907318115, 1.0893160104751587, -1.8937686681747437, 1.4166431427001953, -1.2006103992462158, 1.3748785257339478, 0.34814268350601196, 1.6126476526260376, 0.07080751657485962, 0.5719590783119202, -2.583897352218628, 0.46210289001464844, -0.4542282521724701, -1.1000218391418457, 0.6777184009552002, 0.3948290944099426, -0.39540162682533264, 1.1171735525131226, -0.5896574854850769, 0.1378585398197174, 1.6064022779464722, 0.8298493027687073, -0.8885389566421509, -0.7487128973007202, -1.6580864191055298, -0.6079308986663818, 0.5462265610694885, -0.09078237414360046, -0.7328747510910034, 1.0542813539505005, 0.07263560593128204, 0.5840127468109131, -0.2723083198070526, 1.0916297435760498, -0.023943312466144562, -1.608084797859192, -0.9478822946548462, 4.097755432128906, 0.754935622215271, -1.6707977056503296, -1.768013596534729, 2.4985146522521973, 0.4609963893890381, 0.2254994660615921, -0.5997695326805115, 0.2663823962211609, -1.5753557682037354, -1.9005944728851318, 0.08838502317667007, -0.8547964692115784, 0.3518548905849457, -0.8043453097343445, -0.4917120933532715, -1.697338342666626, -15.886241912841797, 1.5200271606445312, 0.648853600025177, -1.2194517850875854, -0.352075457572937, -0.21894274652004242, -0.2037838250398636, 1.428331732749939, -0.17719011008739471, 0.7220346331596375, 1.1887094974517822, 0.34387117624282837, 0.2096169888973236, 1.7991570234298706, -19.12592887878418, 0.11784517019987106, 0.03504600003361702, -1.1068487167358398, 1.2433149814605713, 0.5037469267845154, 1.460373044013977, -1.0574524402618408, -0.8707849979400635, -0.6321248412132263, -1.0092201232910156, -0.1045871376991272, -0.11383743584156036, -0.7745609879493713, 0.2229544222354889, 0.5107433795928955, 0.40015479922294617, -0.4272984564304352, 0.4391399919986725, 0.9033997654914856, -0.08745209872722626, -0.047908950597047806, -1.2374008893966675, 0.8028226494789124, -0.2880227267742157, -1.708505630493164, 1.8216394186019897, -0.03664517402648926, 0.46321386098861694, 0.4514177739620209, -0.4165317118167877, -0.2750873267650604, 1.1730079650878906, 0.38189226388931274, -1.3885000944137573, -0.6833122372627258, 1.5425814390182495, 0.900534987449646, 0.3547249138355255, -0.9408061504364014, -0.3191920816898346, -0.208198681473732, 0.18019205331802368, -0.6936740279197693, 0.2567315399646759, 0.45563480257987976, 1.295593500137329, 0.5649889707565308, 0.6486383080482483, 0.10432802140712738, 1.2701290845870972, -1.171460509300232, -0.31150874495506287, -2.1924524307250977, -11.243882179260254, -0.9561916589736938, 0.9338107109069824, -1.676492691040039, -1.075951099395752, 0.6965413689613342, -0.6273104548454285, 1.3912124633789062, -0.3852638006210327, -1.0924687385559082, 0.5274346470832825, 0.43794864416122437, -0.8971821665763855, -0.5900952816009521, -1.375219702720642, 0.7951874136924744, 0.1399318426847458, -0.11909165978431702, -0.32631903886795044, 0.4973292052745819, 1.287940263748169, 1.3332505226135254, 0.49347689747810364, -0.23171299695968628, -0.661846935749054, -0.23038898408412933, -0.7198752164840698, 0.21290123462677002, -0.7478870749473572, 0.18586432933807373, -0.17336922883987427, 1.3099095821380615, -0.6046044826507568, 0.7625049352645874, 0.9056687951087952, -0.8040850758552551, -2.453808069229126, -0.1667967289686203, 1.61802077293396, 0.2976312041282654, -0.8554096221923828, 0.5850481390953064, 0.44604721665382385, 1.0360820293426514, 0.13123105466365814, 0.5335934162139893, 1.1243692636489868, -0.7103925943374634, 2.033247470855713, -0.9186311960220337, -0.9991725087165833, 0.9588359594345093, -0.5253349542617798, -0.42549416422843933, 1.3353759050369263, 1.3132144212722778, -2.691941976547241, -0.9921488165855408, 0.7021850943565369, -0.4437614381313324, 1.831813097000122, -0.897921085357666, 0.08243731409311295, -0.2972126007080078, -0.015692247077822685, -0.3046613037586212, 0.17079675197601318, -0.5543441772460938, -0.16293545067310333, -0.45309510827064514, 0.5948633551597595, -1.3141350746154785, -0.8180609345436096, 1.07797372341156, 0.25544455647468567, -0.24732044339179993, 0.8681055903434753, -0.9679771661758423, -2.011136531829834, 0.19357092678546906, -1.0069055557250977, 0.28675734996795654, -1.456719160079956, -2.0247840881347656, -1.3389852046966553, 0.4818994104862213, -0.1925569325685501, -0.07477831840515137, -0.10200166702270508, -0.36873847246170044, 0.4178783595561981, 0.9173585772514343, 0.5476903319358826, 0.10589233785867691, -1.4295706748962402, 0.3812950849533081, 1.1422775983810425, -1.5404411554336548, 0.15804408490657806, -0.027258535847067833, -1.5441958904266357, 0.530143678188324, -1.8975328207015991, 0.11439377069473267, -13.470813751220703, -0.3250695765018463, 0.40884941816329956, 0.07851608842611313, -0.509496808052063, -2.241229772567749, 0.2651583254337311, -0.01863010972738266, -2.318288803100586, 0.5395304560661316, -0.08849252015352249, 0.6474907994270325, 1.0633405447006226, 0.6064977049827576, 0.08463200181722641, 0.0794164389371872, 1.173852562904358, 1.617604374885559, 0.24672189354896545, 0.25601890683174133, -0.4201355278491974, 0.9109470248222351, -0.8128572702407837, 0.4055442214012146, -0.5244698524475098, 0.6318066716194153, -0.7815129160881042, -1.2605040073394775, 0.8069818615913391, -1.8360077142715454, 0.11599717289209366, 1.6079845428466797, 0.7481235861778259, 0.5424730777740479, -0.5510713458061218, 0.07720369100570679, 1.6889923810958862, -1.6622122526168823, 0.7861592769622803, -1.4140233993530273, 0.6123657822608948, 0.05609796568751335, -0.6263421773910522, 1.2904086112976074, -0.02849038876593113, 1.6969753503799438, -0.415805846452713, -2.9410207271575928, 0.438997358083725, -1.4465101957321167, 1.3539537191390991, -0.6784656643867493, -0.45337072014808655, -0.33921530842781067, -16.58462142944336, 1.785503625869751, 0.5998018980026245, 1.1685023307800293, -0.5735059976577759, -0.5603251457214355, -1.5997467041015625, 0.627341628074646, 0.8962162733078003, 1.1138818264007568, -0.9937226176261902, 1.3836156129837036, 1.183530330657959, 1.072898030281067, 1.35843825340271, -0.5624852776527405, -0.9815428853034973, -1.1750625371932983, -1.2904752492904663, -0.47290703654289246, -1.7018187046051025, 0.7761130332946777, 0.297639399766922, -0.17601913213729858, -1.2699922323226929, -0.01427271869033575, 1.4170005321502686, -0.4286218285560608, 1.5938568115234375, 0.1587366908788681, 0.2235109508037567, -0.22610224783420563, -0.04864472150802612, -0.010096819140017033, 0.1866348385810852, 0.2562811076641083, -1.1757793426513672, 1.6230769157409668, 0.36518600583076477, -2.3950390815734863, 0.049291983246803284, 0.855854332447052, -1.657624363899231, 0.22888433933258057, 0.16863910853862762, 0.163735032081604, 0.1645907759666443, -7.5017476081848145, 0.5795133709907532, 0.3906889259815216, -1.9530481100082397, 1.0512198209762573, 0.43352439999580383, 0.6173216104507446, -1.7841030359268188, 0.6206581592559814, 0.6602708697319031, -0.12453953176736832, -0.9193007946014404, 0.5091692805290222, 0.972853422164917, 0.4904070198535919, -0.4056907892227173, 0.8583158254623413, 0.07033558934926987, -0.6620189547538757, -0.5833189487457275, 0.03515750542283058, 0.8736786246299744, 0.3414675295352936, 0.41244661808013916, -1.856811285018921, 0.027426673099398613, -0.07816249132156372, -0.101031094789505, -0.5226196050643921, -0.32892391085624695, -0.5353442430496216, -0.8906430602073669, 0.8701900243759155, 0.35267242789268494, -0.023927126079797745, -0.18461808562278748, -0.20101697742938995, 0.16526095569133759, -0.6035911440849304, 0.5383392572402954, -0.8296316862106323, -0.49258533120155334, 0.5070053935050964, 0.9473684430122375, -0.0019687521271407604, 1.4451231956481934, -0.9395120143890381, -2.6568219661712646, 0.3285970389842987, -4.519965171813965, -2.3319010734558105, 0.8041282296180725, 0.12010469287633896, 1.9186261892318726, -0.1642039716243744, -0.10289707034826279, -0.6730673313140869, -1.722672462463379, 0.8153150677680969, 2.356168270111084, -0.704069197177887, 1.102880597114563, 0.2719346284866333, 1.0842972993850708, 0.08395206928253174, -1.103307843208313, -0.1257409304380417, -1.3694572448730469, -1.286466121673584, 2.537715435028076, -0.25850480794906616, 1.0022869110107422, -0.3861854076385498, 1.3205922842025757, -0.9315071702003479, -1.0757404565811157, 1.436858892440796, -2.0289437770843506, 0.345335990190506, -0.9553184509277344, 0.07327638566493988, 0.5601541996002197, -2.0086710453033447, 0.3126887381076813, 0.19446907937526703, 1.08391273021698, 0.08631329238414764, 0.17812372744083405, 0.8586124181747437, -1.280415654182434, 0.7807736396789551, -1.0907211303710938, -0.16701266169548035, 0.6986004710197449, 0.4711739122867584, 0.9451526403427124, 0.8766873478889465, -1.9877954721450806, 1.8770915269851685, 0.2386150360107422, -1.8115222454071045, 0.5555476546287537, 1.0244938135147095, 0.35637736320495605, -0.6298149228096008, 0.6278781294822693, -0.5069499015808105, -1.36543607711792, 2.2914962768554688, -0.26946568489074707, 0.8161654472351074, -0.1826997846364975, 1.0046436786651611, -0.26747241616249084, 1.2943543195724487, -0.5807296633720398, -0.025480622425675392, 0.8258765339851379, 1.8437373638153076, -2.210911989212036, 0.4711938798427582, 0.920976459980011, -1.7232012748718262, -0.040234144777059555, -0.4640252888202667, 1.0796090364456177, 1.9979884624481201, -1.2312064170837402, 1.1071994304656982, -0.3696371912956238, 0.24536290764808655, 0.5908113121986389, 0.9369366765022278, -0.0886145755648613, -0.10122349113225937, -0.5456220507621765, -0.07582391053438187, -0.1160968542098999, -0.5961167216300964, -0.32117679715156555, 1.5716841220855713, -0.22175957262516022, -0.4305983781814575, 1.013382911682129, -1.020555019378662, 0.5565817356109619, -1.5072479248046875, 1.1280759572982788, -1.6181201934814453, 0.26593536138534546, -1.8243982791900635, 0.0529070720076561, 0.30430832505226135, -0.8573086261749268, 1.4696507453918457, 0.4637570381164551, -1.507346272468567, -0.312030166387558, -0.9141648411750793, 0.13352805376052856, -0.7318568229675293, -0.34911438822746277, 0.33682259917259216, -0.40777355432510376, -0.3973061740398407, -0.6639308929443359, 0.8942137360572815, 0.5137659907341003, 0.3906639516353607, -1.0738976001739502, -0.3680728077888489, 0.641219973564148, 0.39488324522972107, 0.031150110065937042, -0.04853415861725807, 0.9057925343513489, 0.49391651153564453, 0.8569917678833008, -0.22517021000385284, 4.097755432128906, 0.7885909676551819, 0.15721948444843292, -0.267106294631958, 3.0356945991516113, -0.11450093984603882, -1.4952099323272705, 0.5610188245773315, -1.7376254796981812, 0.3650616407394409, 0.35234934091567993, 0.1741698980331421, 0.18872451782226562, -0.3063614070415497, -1.675121784210205, -0.26364555954933167, -17.12749481201172, -1.3017197847366333, -0.1590338498353958, -0.389167845249176, -0.13265517354011536, -0.6187953948974609, 0.3102993071079254, 0.9743372201919556, -0.015941614285111427, -0.5912570357322693, 1.6271518468856812, 1.127139925956726, 0.4236678183078766, -0.48470747470855713, 1.0042219161987305, 1.38899564743042, -0.8606571555137634, -0.13236302137374878, 0.8333430290222168, -0.8237043023109436, -0.5301413536071777, 1.482857346534729, 0.7655964493751526, -0.09069719910621643, 1.553743600845337, -1.0619739294052124, -0.23924942314624786, 0.36596769094467163, 0.8436725735664368, -0.5112578868865967, -0.6867060661315918, 0.5088785886764526, 2.2833213806152344, 0.42580297589302063, -0.5044949650764465, 1.115968108177185, 1.1712149381637573, 0.3639342486858368, 0.45476117730140686, -16.067914962768555, 2.0585505962371826, -0.4915136992931366, -0.5914280414581299, 0.19145984947681427, 0.8830695748329163, 0.5585391521453857, 0.7041908502578735, 0.7071318030357361, -1.3127553462982178, 0.7672927379608154, -0.6602600812911987, 0.2458207607269287, 0.648349404335022, -1.0216134786605835, 0.2148456573486328, -2.6997852325439453, -0.47525861859321594, 0.24141128361225128, 0.041436709463596344, -0.9450514316558838, 0.3409941792488098, 1.6932251453399658, -0.9034672379493713, 2.1707329750061035, 0.07826439291238785, -0.6966630220413208, 0.6391975283622742, -0.22908426821231842, 1.3748096227645874, 1.367271900177002, -0.8960849046707153, -0.5149982571601868, -0.44686004519462585, -1.7423492670059204, 0.9024530053138733, 0.4774550199508667, -0.08760865777730942, -2.29356050491333, 1.243320107460022, 1.4654875993728638, 0.2533523142337799, -0.8315621614456177, -0.35930633544921875, -0.31531134247779846, 0.1018218845129013, -0.4263482391834259, 1.5981526374816895, -1.8442964553833008, -1.4389301538467407, -1.081494927406311, -1.7417842149734497, -1.5854517221450806, 0.3624005913734436, 0.6111950278282166, 0.8963255882263184, 0.8030410408973694, -0.49223846197128296, 0.0703914612531662, 1.580844759941101, -0.5400506854057312, 0.09753093868494034, 0.7311423420906067, 1.2765120267868042, -0.47490638494491577, 0.7620760202407837, -0.43761247396469116, 1.3264931440353394, 0.3905019164085388, 0.665174126625061, -0.6093280911445618, -0.1799653172492981, -0.8639873266220093, -0.1487802416086197, 0.13492000102996826, 0.33444011211395264, -1.6434049606323242, 1.1612548828125, -0.8917189836502075, 0.13554176688194275, 1.3991459608078003, 1.0846086740493774, -16.267044067382812, -1.7387374639511108, 0.22193162143230438, 0.171903595328331, 0.2662603557109833, 0.0895361602306366, -0.27136534452438354, -1.2375074625015259, 2.259626626968384, 2.545830488204956, -0.011364289559423923, -0.6528089046478271, 0.07985985279083252, -3.1301910877227783, -0.31641441583633423, -1.2609848976135254, -0.30440062284469604, -0.9973298907279968, -0.36072778701782227, 0.19978512823581696, 0.5435221195220947, -0.7013300061225891, -1.6763224601745605, -0.12047260999679565, -0.8762654662132263, -1.1071069240570068, 0.3526572585105896, 0.1482481062412262, 0.7031402587890625, -0.40737080574035645, 1.2377313375473022, -0.3166641891002655, 1.0460313558578491, -0.814848005771637, 1.7492494583129883, -0.5587565302848816, -0.19189968705177307, 0.5021796226501465, 0.12312682718038559, -1.6402490139007568, 0.014937927946448326, -0.5710797309875488, 1.2347917556762695, 1.0545520782470703, 0.6843260526657104, 0.04530419409275055, 0.17619848251342773, 0.8522592186927795, -0.11262507736682892, -1.5153450965881348, 0.6131868958473206, -0.31468817591667175, -0.1401522308588028, 1.5082919597625732, 0.5847020745277405, 1.6839102506637573, -1.2684574127197266, -0.9323864579200745, 0.485810786485672, -0.6423563957214355, -1.892232894897461, -0.3803088068962097, 0.6103200316429138, 0.11989666521549225, -0.8710960745811462, 0.6862249970436096, 0.21813145279884338, -0.9414797425270081, 1.758217215538025, -0.3605915606021881, 0.2687808573246002, 0.19541139900684357, 0.5997894406318665, 0.8308013081550598, 0.5830529928207397, 0.6395601034164429, 0.9806798100471497, 0.26266413927078247, -0.26175689697265625, 0.9959012269973755, -1.4034717082977295, -1.6303800344467163, -0.35350990295410156, -1.0851609706878662, -0.8399578928947449, 0.5273087024688721, -0.6095067262649536, -0.7701442837715149, 1.1645333766937256, 0.31334322690963745, 1.545762538909912, -0.40891942381858826, -2.258057117462158, -2.0563933849334717, -1.2818671464920044, 1.2223533391952515, -1.639946460723877, -0.3828103244304657, -0.3349155783653259, -0.361346960067749, -0.8787715435028076, 0.12672068178653717, -1.6309186220169067, -1.9368233680725098, 1.2708075046539307, -0.5488868355751038, 1.6343708038330078, 0.16928113996982574, -0.29747429490089417, 0.25166016817092896, 1.0808526277542114, -0.7498931884765625, -0.51644366979599, -0.6494140028953552, 0.1782035380601883, 1.4399577379226685, -0.12726753950119019, -0.28312137722969055, -0.3636869490146637, -0.13372519612312317, -1.7051843404769897, 0.9462634921073914, -1.0984152555465698, -0.15726709365844727, 0.7964584827423096, -1.01930832862854, -0.41765713691711426, -0.35035642981529236, 0.20764029026031494, 0.9393301010131836, 0.02121954970061779, 0.03803255781531334, -1.1647007465362549, 0.04685520380735397, 0.7176241278648376, -2.0762643814086914, 0.2501579821109772, -0.9459984302520752, 0.567242443561554, 1.6101291179656982, 0.3279980421066284, -2.325330972671509, -0.13353431224822998, 0.31216633319854736, 0.4560348093509674, 0.06661753356456757, -0.8246954083442688, -0.05680987611413002, 1.4002212285995483, 0.8972690105438232, -0.8520643711090088, 0.23236942291259766, 0.2030249983072281, 0.07700525224208832, 0.18451698124408722, 0.464886873960495, 0.27116215229034424, 1.4561004638671875, -0.5599481463432312, 0.8225253224372864, 0.18187622725963593, 1.0455220937728882, -1.7773300409317017, -0.07274187356233597, 1.2804505825042725, -0.3196893334388733, 1.3474454879760742, 1.512327790260315, -0.4141712188720703, 1.2755308151245117, -0.5187236666679382, 0.2190275937318802, 0.2971757650375366, 1.2870184183120728, -1.0029478073120117, -0.3486124873161316, 0.6026456952095032, 0.6433351635932922, -0.5846070647239685, 0.719911515712738, -0.03537369519472122, 0.021572330966591835, 1.0182969570159912, 0.7044039964675903, 1.4048126935958862, -0.49457111954689026, 1.6692771911621094, 0.9081430435180664, -0.18567579984664917, 1.655480980873108, 0.09501083940267563, -0.4156680703163147, 0.4644431173801422, 1.9177820682525635, 0.9531696438789368, 0.467302143573761, 0.32767871022224426, -1.1922551393508911, 0.27503588795661926, 0.16604742407798767, -0.2949604094028473, 1.6554467678070068, -0.9537938833236694, 3.426973342895508 ], "xaxis": "x2", "yaxis": "y2" } ], "layout": { "barmode": "relative", "legend": { "tracegroupgap": 0 }, "margin": { "t": 60 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "white", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "white", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "#C8D4E3", "linecolor": "#C8D4E3", "minorgridcolor": "#C8D4E3", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "#C8D4E3", "linecolor": "#C8D4E3", "minorgridcolor": "#C8D4E3", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "sequentialminus": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "white", "showlakes": true, "showland": true, "subunitcolor": "#C8D4E3" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "white", "polar": { "angularaxis": { "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "" }, "bgcolor": "white", "radialaxis": { "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "white", "gridcolor": "#DFE8F3", "gridwidth": 2, "linecolor": "#EBF0F8", "showbackground": true, "ticks": "", "zerolinecolor": "#EBF0F8" }, "yaxis": { "backgroundcolor": "white", "gridcolor": "#DFE8F3", "gridwidth": 2, "linecolor": "#EBF0F8", "showbackground": true, "ticks": "", "zerolinecolor": "#EBF0F8" }, "zaxis": { "backgroundcolor": "white", "gridcolor": "#DFE8F3", "gridwidth": 2, "linecolor": "#EBF0F8", "showbackground": true, "ticks": "", "zerolinecolor": "#EBF0F8" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "#DFE8F3", "linecolor": "#A2B1C6", "ticks": "" }, "baxis": { "gridcolor": "#DFE8F3", "linecolor": "#A2B1C6", "ticks": "" }, "bgcolor": "white", "caxis": { "gridcolor": "#DFE8F3", "linecolor": "#A2B1C6", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "#EBF0F8", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "#EBF0F8", "zerolinewidth": 2 } } }, "title": {}, "xaxis": { "anchor": "y", "domain": [ 0, 1 ], "title": { "text": "Latent variable" } }, "xaxis2": { "anchor": "y2", "domain": [ 0, 1 ], "matches": "x", "showgrid": true, "showticklabels": false }, "yaxis": { "anchor": "x", "domain": [ 0, 0.8316 ], "title": { "text": "count" } }, "yaxis2": { "anchor": "x2", "domain": [ 0.8416, 1 ], "matches": "y2", "showgrid": false, "showline": false, "showticklabels": false, "ticks": "" } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "threepl.plot.latent_score_distribution(theta_train_threepl).show()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "If we are interested in the $\\theta$ score of a specific test taker, we of course print the estimated $\\theta$ score along with the standard error. We can also plot the likelihood function for a specific response pattern using the `log_likelihood()` method. In this case, we plot the likelihood function for the first test taker in the training data (note that python uses zero indexing so 0 is the first element, 1 is the second, etc.). This test taker did relatively well on the test, but there is a lot of uncertainty in the estimate.\n", "\n", "In addition, we can use the `expected_sum_score` argument to plot the likelihood function against the expected sum score instead of $\\theta$ (the expected sum score is the expected number of correct responses given the estimated $\\theta$). From this plot, we see that the expected is close to the observed one which we print using the `expected_scores()` method on the last line below.\n", "\n", "One should note that a lack of overlap between expected and observed scores does not mean that the model performs poorly. As opposed to the observed sum score, the estimated $\\theta$ scores (and the expected sum scores) also consider the characteristics of the items; thus, it will tend to be a more accurate estimate of the ability. For example, getting an less discriminating item with a more flat item response function correctly tends to have relatively low impact on the estimated $\\theta$ score. More IRT flexible models tend to have less overlap between expected and observed scores." ] }, { "cell_type": "code", "execution_count": 21, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "Test taker 0 estimate: 1.67. Standard error: 0.277\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "plotlyServerURL": "https://plot.ly" }, "data": [ { "hovertemplate": "x=%{x}
y=%{y}", "legendgroup": "", "line": { "dash": "solid", "shape": "spline" }, "marker": { "symbol": "circle" }, "mode": "lines", "name": "", "orientation": "v", "showlegend": false, "type": "scatter", "x": [ -3, -2.939393997192383, -2.8787879943847656, -2.8181817531585693, -2.757575750350952, -2.696969747543335, -2.6363635063171387, -2.5757575035095215, -2.5151515007019043, -2.454545497894287, -2.39393949508667, -2.3333332538604736, -2.2727272510528564, -2.2121212482452393, -2.151515007019043, -2.090909004211426, -2.0303030014038086, -1.9696969985961914, -1.9090908765792847, -1.848484754562378, -1.7878787517547607, -1.7272727489471436, -1.6666666269302368, -1.60606050491333, -1.545454502105713, -1.4848484992980957, -1.424242377281189, -1.3636362552642822, -1.303030252456665, -1.2424242496490479, -1.1818181276321411, -1.1212120056152344, -1.0606060028076172, -1, -0.9393939971923828, -0.8787877559661865, -0.8181817531585693, -0.7575757503509521, -0.6969695091247559, -0.6363635063171387, -0.5757575035095215, -0.5151515007019043, -0.4545454978942871, -0.3939392566680908, -0.33333325386047363, -0.27272725105285645, -0.21212100982666016, -0.15151500701904297, -0.09090900421142578, -0.030303001403808594, 0.030303001403808594, 0.09090900421142578, 0.15151500701904297, 0.21212100982666016, 0.27272725105285645, 0.33333325386047363, 0.3939392566680908, 0.4545454978942871, 0.5151515007019043, 0.5757575035095215, 0.6363635063171387, 0.6969695091247559, 0.7575757503509521, 0.8181817531585693, 0.8787877559661865, 0.9393939971923828, 1, 1.0606060028076172, 1.1212120056152344, 1.1818181276321411, 1.2424242496490479, 1.303030252456665, 1.3636362552642822, 1.424242377281189, 1.4848484992980957, 1.545454502105713, 1.60606050491333, 1.6666666269302368, 1.7272727489471436, 1.7878787517547607, 1.848484754562378, 1.9090908765792847, 1.9696969985961914, 2.0303030014038086, 2.090909004211426, 2.151515007019043, 2.2121212482452393, 2.2727272510528564, 2.3333332538604736, 2.39393949508667, 2.454545497894287, 2.5151515007019043, 2.5757575035095215, 2.6363635063171387, 2.696969747543335, 2.757575750350952, 2.8181817531585693, 2.8787879943847656, 2.939393997192383, 3 ], "xaxis": "x", "y": [ -115.67594909667969, -115.23727416992188, -114.77552032470703, -114.28946685791016, -113.77789306640625, -113.23946380615234, -112.67281341552734, -112.07658386230469, -111.44929504394531, -110.78947448730469, -110.09563446044922, -109.36624145507812, -108.59979248046875, -107.79476928710938, -106.94967651367188, -106.0631103515625, -105.13361358642578, -104.159912109375, -103.14071655273438, -102.07485961914062, -100.96131896972656, -99.79912567138672, -98.58747863769531, -97.32573699951172, -96.01336669921875, -94.65005493164062, -93.23568725585938, -91.7703628540039, -90.25440216064453, -88.68841552734375, -87.07328796386719, -85.41021728515625, -83.70068359375, -81.9465560913086, -80.1500244140625, -78.31362915039062, -76.44029235839844, -74.53329467773438, -72.59622192382812, -70.63311767578125, -68.64828491210938, -66.64637756347656, -64.63236236572266, -62.61149597167969, -60.589317321777344, -58.5715446472168, -56.56410217285156, -54.57307434082031, -52.6046142578125, -50.6649284362793, -48.760223388671875, -46.89664077758789, -45.08018493652344, -43.316673278808594, -41.61164855957031, -39.97032165527344, -38.3974609375, -36.8973388671875, -35.47368240356445, -34.129573822021484, -32.867431640625, -31.68899917602539, -30.595294952392578, -29.586688995361328, -28.662883758544922, -27.822978973388672, -27.0655574798584, -26.38871192932129, -25.7901611328125, -25.267303466796875, -24.817310333251953, -24.437164306640625, -24.123748779296875, -23.873882293701172, -23.684371948242188, -23.55204963684082, -23.473793029785156, -23.446542739868164, -23.467357635498047, -23.533361434936523, -23.64181137084961, -23.790069580078125, -23.975622177124023, -24.19607925415039, -24.449172973632812, -24.732717514038086, -25.044723510742188, -25.38323211669922, -25.74643898010254, -26.132675170898438, -26.54031753540039, -26.967884063720703, -27.413936614990234, -27.877283096313477, -28.356569290161133, -28.850751876831055, -29.358715057373047, -29.87953758239746, -30.412132263183594, -30.955886840820312 ], "yaxis": "y" } ], "layout": { "legend": { "tracegroupgap": 0 }, "margin": { "t": 60 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "white", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "white", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "#C8D4E3", "linecolor": "#C8D4E3", "minorgridcolor": "#C8D4E3", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "#C8D4E3", "linecolor": "#C8D4E3", "minorgridcolor": "#C8D4E3", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "sequentialminus": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "white", "showlakes": true, "showland": true, "subunitcolor": "#C8D4E3" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "white", "polar": { "angularaxis": { "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "" }, "bgcolor": "white", "radialaxis": { "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "white", "gridcolor": "#DFE8F3", "gridwidth": 2, "linecolor": "#EBF0F8", "showbackground": true, "ticks": "", "zerolinecolor": "#EBF0F8" }, "yaxis": { "backgroundcolor": "white", "gridcolor": "#DFE8F3", "gridwidth": 2, "linecolor": "#EBF0F8", "showbackground": true, "ticks": "", "zerolinecolor": "#EBF0F8" }, "zaxis": { "backgroundcolor": "white", "gridcolor": "#DFE8F3", "gridwidth": 2, "linecolor": "#EBF0F8", "showbackground": true, "ticks": "", "zerolinecolor": "#EBF0F8" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "#DFE8F3", "linecolor": "#A2B1C6", "ticks": "" }, "baxis": { "gridcolor": "#DFE8F3", "linecolor": "#A2B1C6", "ticks": "" }, "bgcolor": "white", "caxis": { "gridcolor": "#DFE8F3", "linecolor": "#A2B1C6", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "#EBF0F8", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "#EBF0F8", "zerolinewidth": 2 } } }, "xaxis": { "anchor": "y", "domain": [ 0, 1 ], "title": { "text": "Latent variable" } }, "yaxis": { "anchor": "x", "domain": [ 0, 1 ], "title": { "text": "Log-likelihood" } } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "application/vnd.plotly.v1+json": { "config": { "plotlyServerURL": "https://plot.ly" }, "data": [ { "hovertemplate": "x=%{x}
y=%{y}", "legendgroup": "", "line": { "dash": "solid", "shape": "spline" }, "marker": { "symbol": "circle" }, "mode": "lines", "name": "", "orientation": "v", "showlegend": false, "type": "scatter", "x": [ 18.235939025878906, 18.320770263671875, 18.411605834960938, 18.508892059326172, 18.61309242248535, 18.72472381591797, 18.844322204589844, 18.97246742248535, 19.109785079956055, 19.256935119628906, 19.414621353149414, 19.583593368530273, 19.7646484375, 19.958635330200195, 20.16644287109375, 20.389015197753906, 20.627347946166992, 20.882476806640625, 21.155492782592773, 21.447528839111328, 21.75975227355957, 22.09337615966797, 22.44964027404785, 22.829795837402344, 23.235122680664062, 23.666887283325195, 24.1263427734375, 24.614723205566406, 25.133211135864258, 25.682926177978516, 26.264909744262695, 26.880102157592773, 27.529333114624023, 28.213289260864258, 28.932519912719727, 29.687408447265625, 30.47817039489746, 31.304832458496094, 32.16725158691406, 33.065059661865234, 33.99770736694336, 34.96443557739258, 35.964256286621094, 36.9959716796875, 38.05813980102539, 39.14910125732422, 40.26696014404297, 41.409576416015625, 42.57457733154297, 43.759361267089844, 44.961090087890625, 46.17671203613281, 47.402931213378906, 48.63628005981445, 49.87308883666992, 51.10951614379883, 52.341617584228516, 53.565345764160156, 54.776641845703125, 55.97148132324219, 57.14594268798828, 58.296287536621094, 59.419036865234375, 60.511016845703125, 61.569454193115234, 62.59200668334961, 63.57676315307617, 64.52230834960938, 65.42765808105469, 66.29231262207031, 67.11611938476562, 67.8993148803711, 68.64241790771484, 69.34623718261719, 70.01176452636719, 70.64015197753906, 71.23268127441406, 71.79071044921875, 72.31566619873047, 72.80902862548828, 73.27223205566406, 73.70677185058594, 74.11410522460938, 74.49564361572266, 74.8528060913086, 75.18696594238281, 75.4994125366211, 75.79144287109375, 76.06426239013672, 76.31907653808594, 76.55697631835938, 76.7790298461914, 76.98628234863281, 77.17965698242188, 77.36009216308594, 77.52845001220703, 77.68550872802734, 77.83204650878906, 77.96876525878906, 78.09635925292969 ], "xaxis": "x", "y": [ -115.67594909667969, -115.23727416992188, -114.77552032470703, -114.28946685791016, -113.77789306640625, -113.23946380615234, -112.67281341552734, -112.07658386230469, -111.44929504394531, -110.78947448730469, -110.09563446044922, -109.36624145507812, -108.59979248046875, -107.79476928710938, -106.94967651367188, -106.0631103515625, -105.13361358642578, -104.159912109375, -103.14071655273438, -102.07485961914062, -100.96131896972656, -99.79912567138672, -98.58747863769531, -97.32573699951172, -96.01336669921875, -94.65005493164062, -93.23568725585938, -91.7703628540039, -90.25440216064453, -88.68841552734375, -87.07328796386719, -85.41021728515625, -83.70068359375, -81.9465560913086, -80.1500244140625, -78.31362915039062, -76.44029235839844, -74.53329467773438, -72.59622192382812, -70.63311767578125, -68.64828491210938, -66.64637756347656, -64.63236236572266, -62.61149597167969, -60.589317321777344, -58.5715446472168, -56.56410217285156, -54.57307434082031, -52.6046142578125, -50.6649284362793, -48.760223388671875, -46.89664077758789, -45.08018493652344, -43.316673278808594, -41.61164855957031, -39.97032165527344, -38.3974609375, -36.8973388671875, -35.47368240356445, -34.129573822021484, -32.867431640625, -31.68899917602539, -30.595294952392578, -29.586688995361328, -28.662883758544922, -27.822978973388672, -27.0655574798584, -26.38871192932129, -25.7901611328125, -25.267303466796875, -24.817310333251953, -24.437164306640625, -24.123748779296875, -23.873882293701172, -23.684371948242188, -23.55204963684082, -23.473793029785156, -23.446542739868164, -23.467357635498047, -23.533361434936523, -23.64181137084961, -23.790069580078125, -23.975622177124023, -24.19607925415039, -24.449172973632812, -24.732717514038086, -25.044723510742188, -25.38323211669922, -25.74643898010254, -26.132675170898438, -26.54031753540039, -26.967884063720703, -27.413936614990234, -27.877283096313477, -28.356569290161133, -28.850751876831055, -29.358715057373047, -29.87953758239746, -30.412132263183594, -30.955886840820312 ], "yaxis": "y" } ], "layout": { "annotations": [ { "arrowhead": 1, "ax": 0, "ay": -40, "showarrow": true, "text": "Observed sum score: 71.0", "x": 71, "y": 1, "yref": "paper" } ], "legend": { "tracegroupgap": 0 }, "margin": { "t": 60 }, "shapes": [ { "line": { "color": "gray", "dash": "dash" }, "opacity": 0.7, "type": "line", "x0": 71, "x1": 71, "xref": "x", "y0": 0, "y1": 1, "yref": "y domain" } ], "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "white", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "white", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "#C8D4E3", "linecolor": "#C8D4E3", "minorgridcolor": "#C8D4E3", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "#C8D4E3", "linecolor": "#C8D4E3", "minorgridcolor": "#C8D4E3", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "sequentialminus": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "white", "showlakes": true, "showland": true, "subunitcolor": "#C8D4E3" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "white", "polar": { "angularaxis": { "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "" }, "bgcolor": "white", "radialaxis": { "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "white", "gridcolor": "#DFE8F3", "gridwidth": 2, "linecolor": "#EBF0F8", "showbackground": true, "ticks": "", "zerolinecolor": "#EBF0F8" }, "yaxis": { "backgroundcolor": "white", "gridcolor": "#DFE8F3", "gridwidth": 2, "linecolor": "#EBF0F8", "showbackground": true, "ticks": "", "zerolinecolor": "#EBF0F8" }, "zaxis": { "backgroundcolor": "white", "gridcolor": "#DFE8F3", "gridwidth": 2, "linecolor": "#EBF0F8", "showbackground": true, "ticks": "", "zerolinecolor": "#EBF0F8" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "#DFE8F3", "linecolor": "#A2B1C6", "ticks": "" }, "baxis": { "gridcolor": "#DFE8F3", "linecolor": "#A2B1C6", "ticks": "" }, "bgcolor": "white", "caxis": { "gridcolor": "#DFE8F3", "linecolor": "#A2B1C6", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "#EBF0F8", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "#EBF0F8", "zerolinewidth": 2 } } }, "xaxis": { "anchor": "y", "domain": [ 0, 1 ], "title": { "text": "Expected sum score" } }, "yaxis": { "anchor": "x", "domain": [ 0, 1 ], "title": { "text": "Log-likelihood" } } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stdout", "output_type": "stream", "text": [ "Test taker 0 expected sum score: 71.821\n" ] } ], "source": [ "test_taker = 0\n", "print(f\"Test taker {test_taker} estimate: {round(theta_train_threepl[test_taker].item(), 3)}. Standard error: {round(theta_se_train_threepl[test_taker].item(), 3)}\")\n", "threepl.plot.log_likelihood(data=train_data_binary[test_taker]).show()\n", "threepl.plot.log_likelihood(data=train_data_binary[test_taker], expected_sum_score=True).show()\n", "print(f\"Test taker {test_taker} expected sum score: {round(threepl.expected_scores(theta_train_threepl[test_taker:test_taker+1], return_item_scores=False).item(), 3)}\")" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "To visualize item response functions, we use the `item_probabilities()` method. Here we plot the curves for item 56." ] }, { "cell_type": "code", "execution_count": 22, "metadata": {}, "outputs": [ { "data": { "application/vnd.plotly.v1+json": { "config": { "plotlyServerURL": "https://plot.ly" }, "data": [ { "line": { "color": "#636EFA" }, "mode": "lines", "name": "0", "type": "scatter", "x": [ -3, -2.9698493480682373, -2.9396984577178955, -2.909547805786133, -2.879396915435791, -2.8492462635040283, -2.8190953731536865, -2.788944721221924, -2.758794069290161, -2.7286431789398193, -2.6984925270080566, -2.668341636657715, -2.638190984725952, -2.6080400943756104, -2.5778894424438477, -2.547738552093506, -2.517587900161743, -2.4874372482299805, -2.4572863578796387, -2.427135705947876, -2.3969850540161133, -2.3668341636657715, -2.3366832733154297, -2.306532621383667, -2.2763819694519043, -2.2462310791015625, -2.2160804271698, -2.185929775238037, -2.1557788848876953, -2.1256279945373535, -2.095477342605591, -2.065326690673828, -2.0351758003234863, -2.0050251483917236, -1.9748743772506714, -1.9447236061096191, -1.914572834968567, -1.8844220638275146, -1.8542712926864624, -1.8241205215454102, -1.7939698696136475, -1.7638190984725952, -1.733668327331543, -1.7035175561904907, -1.6733667850494385, -1.6432160139083862, -1.613065242767334, -1.5829145908355713, -1.552763819694519, -1.5226130485534668, -1.4924622774124146, -1.4623115062713623, -1.43216073513031, -1.4020099639892578, -1.3718593120574951, -1.3417085409164429, -1.3115577697753906, -1.2814069986343384, -1.2512562274932861, -1.2211054563522339, -1.1909546852111816, -1.160804033279419, -1.1306532621383667, -1.1005024909973145, -1.0703517198562622, -1.04020094871521, -1.0100501775741577, -0.9798994064331055, -0.9497487545013428, -0.919597864151001, -0.8894472122192383, -0.8592963218688965, -0.8291456699371338, -0.7989950180053711, -0.7688441276550293, -0.7386934757232666, -0.7085425853729248, -0.6783919334411621, -0.6482410430908203, -0.6180903911590576, -0.5879397392272949, -0.5577888488769531, -0.5276381969451904, -0.49748730659484863, -0.46733665466308594, -0.43718576431274414, -0.40703511238098145, -0.37688446044921875, -0.34673357009887695, -0.31658291816711426, -0.28643202781677246, -0.25628137588500977, -0.22613048553466797, -0.19597983360290527, -0.16582918167114258, -0.13567829132080078, -0.10552763938903809, -0.07537674903869629, -0.045226097106933594, -0.015075206756591797, 0.015075206756591797, 0.045226097106933594, 0.07537674903869629, 0.10552763938903809, 0.13567829132080078, 0.16582918167114258, 0.19597983360290527, 0.22613048553466797, 0.25628137588500977, 0.28643202781677246, 0.31658291816711426, 0.34673357009887695, 0.37688446044921875, 0.40703511238098145, 0.43718576431274414, 0.46733665466308594, 0.49748730659484863, 0.5276381969451904, 0.5577888488769531, 0.5879397392272949, 0.6180903911590576, 0.6482410430908203, 0.6783919334411621, 0.7085425853729248, 0.7386934757232666, 0.7688441276550293, 0.7989950180053711, 0.8291456699371338, 0.8592963218688965, 0.8894472122192383, 0.919597864151001, 0.9497487545013428, 0.9798994064331055, 1.0100501775741577, 1.04020094871521, 1.0703517198562622, 1.1005024909973145, 1.1306532621383667, 1.160804033279419, 1.1909546852111816, 1.2211054563522339, 1.2512562274932861, 1.2814069986343384, 1.3115577697753906, 1.3417085409164429, 1.3718593120574951, 1.4020099639892578, 1.43216073513031, 1.4623115062713623, 1.4924622774124146, 1.5226130485534668, 1.552763819694519, 1.5829145908355713, 1.613065242767334, 1.6432160139083862, 1.6733667850494385, 1.7035175561904907, 1.733668327331543, 1.7638190984725952, 1.7939698696136475, 1.8241205215454102, 1.8542712926864624, 1.8844220638275146, 1.914572834968567, 1.9447236061096191, 1.9748743772506714, 2.0050251483917236, 2.0351758003234863, 2.065326690673828, 2.095477342605591, 2.1256279945373535, 2.1557788848876953, 2.185929775238037, 2.2160804271698, 2.2462310791015625, 2.2763819694519043, 2.306532621383667, 2.3366832733154297, 2.3668341636657715, 2.3969850540161133, 2.427135705947876, 2.4572863578796387, 2.4874372482299805, 2.517587900161743, 2.547738552093506, 2.5778894424438477, 2.6080400943756104, 2.638190984725952, 2.668341636657715, 2.6984925270080566, 2.7286431789398193, 2.758794069290161, 2.788944721221924, 2.8190953731536865, 2.8492462635040283, 2.879396915435791, 2.909547805786133, 2.9396984577178955, 2.9698493480682373, 3 ], "y": [ 0.8778234124183655, 0.8775932192802429, 0.8773521184921265, 0.8770995736122131, 0.8768350481987, 0.8765579462051392, 0.8762677907943726, 0.8759638071060181, 0.8756455183029175, 0.8753121495246887, 0.8749630451202393, 0.8745974898338318, 0.8742147088050842, 0.8738138675689697, 0.8733941316604614, 0.8729547262191772, 0.872494637966156, 0.8720129728317261, 0.871508777141571, 0.870980978012085, 0.8704284429550171, 0.8698501586914062, 0.8692448735237122, 0.8686114549636841, 0.867948591709137, 0.8672549724578857, 0.8665291666984558, 0.8657698631286621, 0.8649754524230957, 0.8641444444656372, 0.8632752299308777, 0.8623660802841187, 0.8614153861999512, 0.8604212403297424, 0.8593817949295044, 0.8582950830459595, 0.8571590781211853, 0.8559717535972595, 0.8547309041023254, 0.8534342646598816, 0.8520795702934265, 0.8506643772125244, 0.8491862416267395, 0.8476426005363464, 0.8460308313369751, 0.844348132610321, 0.8425917625427246, 0.8407589197158813, 0.8388464450836182, 0.8368514776229858, 0.8347707986831665, 0.8326011896133423, 0.8303394317626953, 0.8279821872711182, 0.8255259990692139, 0.8229673504829407, 0.8203027844429016, 0.8175286054611206, 0.8146412968635559, 0.8116370439529419, 0.8085120916366577, 0.8052627444267273, 0.801885187625885, 0.7983756065368652, 0.7947303056716919, 0.7909453511238098, 0.7870171070098877, 0.7829416990280151, 0.7787156105041504, 0.7743351459503174, 0.7697968482971191, 0.7650971412658691, 0.7602329254150391, 0.755200982093811, 0.749998152256012, 0.7446218132972717, 0.7390692234039307, 0.7333381175994873, 0.7274262309074402, 0.721331775188446, 0.7150532007217407, 0.7085890769958496, 0.7019387483596802, 0.6951014995574951, 0.6880773305892944, 0.6808663606643677, 0.6734695434570312, 0.665887713432312, 0.658122718334198, 0.6501767635345459, 0.6420522928237915, 0.6337525844573975, 0.6252813339233398, 0.6166428327560425, 0.6078417301177979, 0.5988834500312805, 0.5897738933563232, 0.5805193185806274, 0.5711268186569214, 0.5616037845611572, 0.5519583225250244, 0.542198657989502, 0.5323337316513062, 0.522372841835022, 0.5123258233070374, 0.5022026300430298, 0.49201369285583496, 0.4817698001861572, 0.4714816212654114, 0.46116048097610474, 0.4508175253868103, 0.4404641389846802, 0.4301115870475769, 0.41977155208587646, 0.40945518016815186, 0.3991734981536865, 0.38893795013427734, 0.37875908613204956, 0.36864787340164185, 0.35861438512802124, 0.34866875410079956, 0.3388206362724304, 0.32907921075820923, 0.3194533586502075, 0.30995142459869385, 0.30058127641677856, 0.29135018587112427, 0.28226524591445923, 0.27333271503448486, 0.2645580768585205, 0.2559469938278198, 0.24750375747680664, 0.2392328381538391, 0.23113775253295898, 0.2232215404510498, 0.21548670530319214, 0.20793545246124268, 0.2005692720413208, 0.1933891773223877, 0.18639600276947021, 0.17958968877792358, 0.17297017574310303, 0.16653692722320557, 0.16028887033462524, 0.15422463417053223, 0.14834284782409668, 0.14264142513275146, 0.13711822032928467, 0.13177084922790527, 0.12659651041030884, 0.12159240245819092, 0.1167556643486023, 0.11208289861679077, 0.10757094621658325, 0.10321635007858276, 0.09901547431945801, 0.09496468305587769, 0.0910603404045105, 0.08729875087738037, 0.08367615938186646, 0.0801888108253479, 0.07683265209197998, 0.07360416650772095, 0.0704994797706604, 0.06751477718353271, 0.06464642286300659, 0.06189072132110596, 0.05924391746520996, 0.05670243501663208, 0.05426293611526489, 0.05192166566848755, 0.0496753454208374, 0.04752069711685181, 0.045454442501068115, 0.04347330331802368, 0.041574299335479736, 0.03975421190261841, 0.03801029920578003, 0.036339521408081055, 0.034739136695861816, 0.03320658206939697, 0.03173905611038208, 0.030334115028381348, 0.028989136219024658, 0.027701854705810547, 0.02647000551223755, 0.025291383266448975, 0.024163663387298584, 0.023084938526153564, 0.022053062915802002, 0.02106630802154541, 0.02012258768081665, 0.01922011375427246, 0.018357396125793457, 0.017532527446746826, 0.016744017601013184, 0.015990376472473145, 0.015270054340362549, 0.014581561088562012, 0.01392364501953125 ] }, { "line": { "color": "#EF553B" }, "mode": "lines", "name": "1", "type": "scatter", "x": [ -3, -2.9698493480682373, -2.9396984577178955, -2.909547805786133, -2.879396915435791, -2.8492462635040283, -2.8190953731536865, -2.788944721221924, -2.758794069290161, -2.7286431789398193, -2.6984925270080566, -2.668341636657715, -2.638190984725952, -2.6080400943756104, -2.5778894424438477, -2.547738552093506, -2.517587900161743, -2.4874372482299805, -2.4572863578796387, -2.427135705947876, -2.3969850540161133, -2.3668341636657715, -2.3366832733154297, -2.306532621383667, -2.2763819694519043, -2.2462310791015625, -2.2160804271698, -2.185929775238037, -2.1557788848876953, -2.1256279945373535, -2.095477342605591, -2.065326690673828, -2.0351758003234863, -2.0050251483917236, -1.9748743772506714, -1.9447236061096191, -1.914572834968567, -1.8844220638275146, -1.8542712926864624, -1.8241205215454102, -1.7939698696136475, -1.7638190984725952, -1.733668327331543, -1.7035175561904907, -1.6733667850494385, -1.6432160139083862, -1.613065242767334, -1.5829145908355713, -1.552763819694519, -1.5226130485534668, -1.4924622774124146, -1.4623115062713623, -1.43216073513031, -1.4020099639892578, -1.3718593120574951, -1.3417085409164429, -1.3115577697753906, -1.2814069986343384, -1.2512562274932861, -1.2211054563522339, -1.1909546852111816, -1.160804033279419, -1.1306532621383667, -1.1005024909973145, -1.0703517198562622, -1.04020094871521, -1.0100501775741577, -0.9798994064331055, -0.9497487545013428, -0.919597864151001, -0.8894472122192383, -0.8592963218688965, -0.8291456699371338, -0.7989950180053711, -0.7688441276550293, -0.7386934757232666, -0.7085425853729248, -0.6783919334411621, -0.6482410430908203, -0.6180903911590576, -0.5879397392272949, -0.5577888488769531, -0.5276381969451904, -0.49748730659484863, -0.46733665466308594, -0.43718576431274414, -0.40703511238098145, -0.37688446044921875, -0.34673357009887695, -0.31658291816711426, -0.28643202781677246, -0.25628137588500977, -0.22613048553466797, -0.19597983360290527, -0.16582918167114258, -0.13567829132080078, -0.10552763938903809, -0.07537674903869629, -0.045226097106933594, -0.015075206756591797, 0.015075206756591797, 0.045226097106933594, 0.07537674903869629, 0.10552763938903809, 0.13567829132080078, 0.16582918167114258, 0.19597983360290527, 0.22613048553466797, 0.25628137588500977, 0.28643202781677246, 0.31658291816711426, 0.34673357009887695, 0.37688446044921875, 0.40703511238098145, 0.43718576431274414, 0.46733665466308594, 0.49748730659484863, 0.5276381969451904, 0.5577888488769531, 0.5879397392272949, 0.6180903911590576, 0.6482410430908203, 0.6783919334411621, 0.7085425853729248, 0.7386934757232666, 0.7688441276550293, 0.7989950180053711, 0.8291456699371338, 0.8592963218688965, 0.8894472122192383, 0.919597864151001, 0.9497487545013428, 0.9798994064331055, 1.0100501775741577, 1.04020094871521, 1.0703517198562622, 1.1005024909973145, 1.1306532621383667, 1.160804033279419, 1.1909546852111816, 1.2211054563522339, 1.2512562274932861, 1.2814069986343384, 1.3115577697753906, 1.3417085409164429, 1.3718593120574951, 1.4020099639892578, 1.43216073513031, 1.4623115062713623, 1.4924622774124146, 1.5226130485534668, 1.552763819694519, 1.5829145908355713, 1.613065242767334, 1.6432160139083862, 1.6733667850494385, 1.7035175561904907, 1.733668327331543, 1.7638190984725952, 1.7939698696136475, 1.8241205215454102, 1.8542712926864624, 1.8844220638275146, 1.914572834968567, 1.9447236061096191, 1.9748743772506714, 2.0050251483917236, 2.0351758003234863, 2.065326690673828, 2.095477342605591, 2.1256279945373535, 2.1557788848876953, 2.185929775238037, 2.2160804271698, 2.2462310791015625, 2.2763819694519043, 2.306532621383667, 2.3366832733154297, 2.3668341636657715, 2.3969850540161133, 2.427135705947876, 2.4572863578796387, 2.4874372482299805, 2.517587900161743, 2.547738552093506, 2.5778894424438477, 2.6080400943756104, 2.638190984725952, 2.668341636657715, 2.6984925270080566, 2.7286431789398193, 2.758794069290161, 2.788944721221924, 2.8190953731536865, 2.8492462635040283, 2.879396915435791, 2.909547805786133, 2.9396984577178955, 2.9698493480682373, 3 ], "y": [ 0.12217658758163452, 0.12240677326917648, 0.12264788150787354, 0.12290044128894806, 0.12316497415304184, 0.12344203889369965, 0.12373223900794983, 0.12403617054224014, 0.12435447424650192, 0.12468782812356949, 0.12503692507743835, 0.12540249526500702, 0.12578529119491577, 0.12618613243103027, 0.1266058385372162, 0.12704527378082275, 0.1275053471326828, 0.12798699736595154, 0.12849122285842896, 0.12901905179023743, 0.1295715570449829, 0.13014985620975494, 0.13075511157512665, 0.13138854503631592, 0.13205140829086304, 0.13274505734443665, 0.1334708333015442, 0.13423016667366028, 0.13502457737922668, 0.135855570435524, 0.1367247849702835, 0.13763388991355896, 0.13858461380004883, 0.13957877457141876, 0.140618234872818, 0.14170494675636292, 0.1428409218788147, 0.14402826130390167, 0.14526911079883575, 0.1465657353401184, 0.1479204297065735, 0.1493356078863144, 0.1508137434720993, 0.15235738456249237, 0.1539691835641861, 0.15565185248851776, 0.157408207654953, 0.15924111008644104, 0.16115354001522064, 0.16314853727817535, 0.16522923111915588, 0.16739881038665771, 0.1696605682373047, 0.17201782763004303, 0.17447401583194733, 0.17703263461589813, 0.1796972155570984, 0.182471364736557, 0.1853587031364441, 0.1883629858493805, 0.19148793816566467, 0.1947372555732727, 0.198114812374115, 0.20162436366081238, 0.2052697241306305, 0.20905464887619019, 0.2129829227924347, 0.21705828607082367, 0.22128435969352722, 0.22566485404968262, 0.23020318150520325, 0.23490282893180847, 0.23976704478263855, 0.24479904770851135, 0.25000184774398804, 0.25537818670272827, 0.26093074679374695, 0.2666618525981903, 0.2725737690925598, 0.27866822481155396, 0.28494682908058167, 0.2914109230041504, 0.2980612516403198, 0.3048985004425049, 0.31192266941070557, 0.31913360953330994, 0.32653048634529114, 0.3341122567653656, 0.341877281665802, 0.3498232662677765, 0.3579477369785309, 0.36624738574028015, 0.37471866607666016, 0.3833571970462799, 0.39215824007987976, 0.4011165499687195, 0.41022613644599915, 0.41948068141937256, 0.4288731515407562, 0.4383961856365204, 0.4480416774749756, 0.45780137181282043, 0.46766626834869385, 0.4776271879673004, 0.48767417669296265, 0.4977973997592926, 0.507986307144165, 0.5182301998138428, 0.5285183787345886, 0.5388395190238953, 0.5491824746131897, 0.5595358610153198, 0.5698884129524231, 0.5802284479141235, 0.5905448198318481, 0.6008265018463135, 0.6110620498657227, 0.6212409138679504, 0.6313521265983582, 0.6413856148719788, 0.6513312458992004, 0.6611793637275696, 0.6709207892417908, 0.6805466413497925, 0.6900485754013062, 0.6994187235832214, 0.7086498141288757, 0.7177347540855408, 0.7266672849655151, 0.7354419231414795, 0.7440530061721802, 0.7524962425231934, 0.7607671618461609, 0.768862247467041, 0.7767784595489502, 0.7845132946968079, 0.7920645475387573, 0.7994307279586792, 0.8066108226776123, 0.8136039972305298, 0.8204103112220764, 0.827029824256897, 0.8334630727767944, 0.8397111296653748, 0.8457753658294678, 0.8516571521759033, 0.8573585748672485, 0.8628817796707153, 0.8682291507720947, 0.8734034895896912, 0.8784075975418091, 0.8832443356513977, 0.8879171013832092, 0.8924290537834167, 0.8967836499214172, 0.900984525680542, 0.9050353169441223, 0.9089396595954895, 0.9127012491226196, 0.9163238406181335, 0.9198111891746521, 0.92316734790802, 0.926395833492279, 0.9295005202293396, 0.9324852228164673, 0.9353535771369934, 0.938109278678894, 0.94075608253479, 0.9432975649833679, 0.9457370638847351, 0.9480783343315125, 0.9503246545791626, 0.9524793028831482, 0.9545455574989319, 0.9565266966819763, 0.9584257006645203, 0.9602457880973816, 0.96198970079422, 0.963660478591919, 0.9652608633041382, 0.966793417930603, 0.9682609438896179, 0.9696658849716187, 0.9710108637809753, 0.9722981452941895, 0.9735299944877625, 0.974708616733551, 0.9758363366127014, 0.9769150614738464, 0.977946937084198, 0.9789336919784546, 0.9798774123191833, 0.9807798862457275, 0.9816426038742065, 0.9824674725532532, 0.9832559823989868, 0.9840096235275269, 0.9847299456596375, 0.985418438911438, 0.9860763549804688 ] } ], "layout": { "legend": { "title": { "text": "Score" } }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "white", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "white", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "#C8D4E3", "linecolor": "#C8D4E3", "minorgridcolor": "#C8D4E3", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "#C8D4E3", "linecolor": "#C8D4E3", "minorgridcolor": "#C8D4E3", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "sequentialminus": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "white", "showlakes": true, "showland": true, "subunitcolor": "#C8D4E3" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "white", "polar": { "angularaxis": { "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "" }, "bgcolor": "white", "radialaxis": { "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "white", "gridcolor": "#DFE8F3", "gridwidth": 2, "linecolor": "#EBF0F8", "showbackground": true, "ticks": "", "zerolinecolor": "#EBF0F8" }, "yaxis": { "backgroundcolor": "white", "gridcolor": "#DFE8F3", "gridwidth": 2, "linecolor": "#EBF0F8", "showbackground": true, "ticks": "", "zerolinecolor": "#EBF0F8" }, "zaxis": { "backgroundcolor": "white", "gridcolor": "#DFE8F3", "gridwidth": 2, "linecolor": "#EBF0F8", "showbackground": true, "ticks": "", "zerolinecolor": "#EBF0F8" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "#DFE8F3", "linecolor": "#A2B1C6", "ticks": "" }, "baxis": { "gridcolor": "#DFE8F3", "linecolor": "#A2B1C6", "ticks": "" }, "bgcolor": "white", "caxis": { "gridcolor": "#DFE8F3", "linecolor": "#A2B1C6", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "#EBF0F8", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "#EBF0F8", "zerolinewidth": 2 } } }, "title": { "text": "IRF - Item 56" }, "xaxis": { "title": { "text": "Latent variable" } }, "yaxis": { "title": { "text": "Probability" } } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "threepl.plot.item_probabilities(item = 56).show()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "For parametric IRT models such as the 3PL, we can get the estimated item parameters using the `item_parameters()` method. The `irt_format=True` argument returns the parameters in the traditional IRT format." ] }, { "cell_type": "code", "execution_count": 23, "metadata": {}, "outputs": [ { "data": { "application/vnd.microsoft.datawrangler.viewer.v0+json": { "columns": [ { "name": "index", "rawType": "int64", "type": "integer" }, { "name": "a1", "rawType": "float32", "type": "float" }, { "name": "b", "rawType": "float32", "type": "float" }, { "name": "c", "rawType": "float32", "type": "float" } ], "ref": "bada9d60-5e20-4c20-9954-5bf9ad27d883", "rows": [ [ "0", "1.9666656", "0.8280084", "0.2515542" ], [ "1", "0.9165581", "-0.13929005", "0.022015005" ], [ "2", "1.6796399", "-0.46983188", "0.14121112" ], [ "3", "0.87216717", "1.5462776", "0.20809436" ], [ "4", "2.076665", "0.82909423", "0.29359952" ], [ "5", "1.4386376", "-0.891842", "0.25558853" ], [ "6", "1.7942804", "-0.6591078", "0.23474637" ], [ "7", "0.94528043", "-0.4161092", "0.029263936" ], [ "8", "1.578471", "-1.0213288", "0.18067615" ], [ "9", "1.4995817", "-0.12229943", "0.18889786" ], [ "10", "1.4189222", "0.6244635", "0.19045092" ], [ "11", "1.7894397", "0.0525756", "0.137951" ], [ "12", "1.7007183", "-0.31538564", "0.07619972" ], [ "13", "1.0926416", "1.5506381", "0.3917384" ], [ "14", "2.4994867", "0.38397962", "0.2297661" ], [ "15", "1.2844002", "0.9898001", "0.41334024" ], [ "16", "2.0788805", "0.49268946", "0.18071781" ], [ "17", "1.6279835", "0.5404157", "0.37786427" ], [ "18", "1.3703768", "-0.24845923", "0.09633019" ], [ "19", "1.9116191", "1.4128505", "0.24041094" ], [ "20", "1.4266747", "0.920478", "0.27222595" ], [ "21", "1.7917941", "-0.22782683", "0.21366471" ], [ "22", "1.4883467", "-0.94074076", "0.33329976" ], [ "23", "1.5673239", "0.15425098", "0.40793082" ], [ "24", "1.4821106", "-0.42964312", "0.009520088" ], [ "25", "1.1386943", "-0.49701044", "0.37748688" ], [ "26", "1.8352267", "0.56252795", "0.19594127" ], [ "27", "1.3709435", "-0.61121404", "0.07457641" ], [ "28", "1.3539299", "0.8692724", "0.23239113" ], [ "29", "1.5377632", "0.43018898", "0.20929576" ], [ "30", "1.0176121", "0.02258052", "0.30093288" ], [ "31", "1.3168193", "-0.74364483", "0.087428235" ], [ "32", "2.6211119", "0.370802", "0.10658042" ], [ "33", "1.4328235", "1.3579336", "0.27568194" ], [ "34", "1.7830213", "-0.18636304", "0.25574154" ], [ "35", "1.8032404", "0.028059108", "0.23634726" ], [ "36", "2.5493748", "0.4580768", "0.20136856" ], [ "37", "2.296529", "0.4346294", "0.056094643" ], [ "38", "1.3730512", "0.6241117", "0.26481637" ], [ "39", "1.3007473", "0.21045554", "0.2735754" ], [ "40", "0.61183786", "-0.2943946", "0.073820904" ], [ "41", "1.912172", "-0.11960983", "0.44038996" ], [ "42", "1.3132217", "0.28435954", "0.11171631" ], [ "43", "2.1699405", "-0.4135532", "0.22904745" ], [ "44", "2.3512995", "0.92756355", "0.21065667" ], [ "45", "1.5116191", "0.40879706", "0.18892528" ], [ "46", "1.0269433", "-1.2034166", "0.14100774" ], [ "47", "1.4983013", "0.77737886", "0.22986062" ], [ "48", "2.374876", "0.71729565", "0.14895916" ], [ "49", "1.7717494", "-0.3187836", "0.20514101" ] ], "shape": { "columns": 3, "rows": 80 } }, "text/html": [ "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
a1bc
01.9666660.8280080.251554
10.916558-0.1392900.022015
21.679640-0.4698320.141211
30.8721671.5462780.208094
42.0766650.8290940.293600
............
751.3805021.3613260.151783
762.5750200.0507300.216261
771.1088280.5147780.078823
781.8274660.5578740.120996
790.8971260.1558840.217186
\n", "

80 rows × 3 columns

\n", "
" ], "text/plain": [ " a1 b c\n", "0 1.966666 0.828008 0.251554\n", "1 0.916558 -0.139290 0.022015\n", "2 1.679640 -0.469832 0.141211\n", "3 0.872167 1.546278 0.208094\n", "4 2.076665 0.829094 0.293600\n", ".. ... ... ...\n", "75 1.380502 1.361326 0.151783\n", "76 2.575020 0.050730 0.216261\n", "77 1.108828 0.514778 0.078823\n", "78 1.827466 0.557874 0.120996\n", "79 0.897126 0.155884 0.217186\n", "\n", "[80 rows x 3 columns]" ] }, "execution_count": 23, "metadata": {}, "output_type": "execute_result" } ], "source": [ "threepl.item_parameters(irt_format=True)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Evaluate the model fit\n", "There are various ways to evaluate which model fits the data best and many are available within the `evaluate` model property (see the [Model evaluate](./../evaluator.rst) section). For example, we can compute the log-likelihood on our test data or various predictive metrics such as accuracy, precision, recall and F1 score. These are illustrated below. Refer to the [Model evaluate](./../evaluator.rst) section for more details on a specific metric." ] }, { "cell_type": "code", "execution_count": 24, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "tensor(-44074.7773)\n", "tensor(0.7104)\n", "precision 0.690388\n", "recall 0.664427\n", "f1 0.667016\n", "w_precision 0.704528\n", "w_recall 0.710362\n", "w_f1 0.699610\n", "dtype: float32\n" ] } ], "source": [ "print(threepl.evaluate.log_likelihood(data=test_data_binary, theta=theta_test_threepl))\n", "print(threepl.evaluate.accuracy(data=test_data_binary, theta=theta_test_threepl))\n", "print(threepl.evaluate.predictions(data=test_data_binary, theta=theta_test_threepl).mean(axis = 0))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "We can also add grouped residuals to our item response function figures to visualize model fit by supplying `plot_group_fit=True`. For these figures, the test takers are divided into groups based on their latent scores. Within each group, the proportion of test takers responding with each response option is plotted and compared to the proportion expected by the model. Thus, a good overlap of the data and model dots in the figures indicate a good fit.\n", "\n", "To speed up computation, since we already estimated the $\\theta$ scores, we can provide them together with the data to the method call. Otherwise, calling `threepl.plot.item_probabilities(item = 56, plot_group_fit=True).show()` does the same computation internally." ] }, { "cell_type": "code", "execution_count": 25, "metadata": {}, "outputs": [ { "data": { "application/vnd.plotly.v1+json": { "config": { "plotlyServerURL": "https://plot.ly" }, "data": [ { "line": { "color": "#636EFA" }, "mode": "lines", "name": "0", "type": "scatter", "x": [ -3, -2.9698493480682373, -2.9396984577178955, -2.909547805786133, -2.879396915435791, -2.8492462635040283, -2.8190953731536865, -2.788944721221924, -2.758794069290161, -2.7286431789398193, -2.6984925270080566, -2.668341636657715, -2.638190984725952, -2.6080400943756104, -2.5778894424438477, -2.547738552093506, -2.517587900161743, -2.4874372482299805, -2.4572863578796387, -2.427135705947876, -2.3969850540161133, -2.3668341636657715, -2.3366832733154297, -2.306532621383667, -2.2763819694519043, -2.2462310791015625, -2.2160804271698, -2.185929775238037, -2.1557788848876953, -2.1256279945373535, -2.095477342605591, -2.065326690673828, -2.0351758003234863, -2.0050251483917236, -1.9748743772506714, -1.9447236061096191, -1.914572834968567, -1.8844220638275146, -1.8542712926864624, -1.8241205215454102, -1.7939698696136475, -1.7638190984725952, -1.733668327331543, -1.7035175561904907, -1.6733667850494385, -1.6432160139083862, -1.613065242767334, -1.5829145908355713, -1.552763819694519, -1.5226130485534668, -1.4924622774124146, -1.4623115062713623, -1.43216073513031, -1.4020099639892578, -1.3718593120574951, -1.3417085409164429, -1.3115577697753906, -1.2814069986343384, -1.2512562274932861, -1.2211054563522339, -1.1909546852111816, -1.160804033279419, -1.1306532621383667, -1.1005024909973145, -1.0703517198562622, -1.04020094871521, -1.0100501775741577, -0.9798994064331055, -0.9497487545013428, -0.919597864151001, -0.8894472122192383, -0.8592963218688965, -0.8291456699371338, -0.7989950180053711, -0.7688441276550293, -0.7386934757232666, -0.7085425853729248, -0.6783919334411621, -0.6482410430908203, -0.6180903911590576, -0.5879397392272949, -0.5577888488769531, -0.5276381969451904, -0.49748730659484863, -0.46733665466308594, -0.43718576431274414, -0.40703511238098145, -0.37688446044921875, -0.34673357009887695, -0.31658291816711426, -0.28643202781677246, -0.25628137588500977, -0.22613048553466797, -0.19597983360290527, -0.16582918167114258, -0.13567829132080078, -0.10552763938903809, -0.07537674903869629, -0.045226097106933594, -0.015075206756591797, 0.015075206756591797, 0.045226097106933594, 0.07537674903869629, 0.10552763938903809, 0.13567829132080078, 0.16582918167114258, 0.19597983360290527, 0.22613048553466797, 0.25628137588500977, 0.28643202781677246, 0.31658291816711426, 0.34673357009887695, 0.37688446044921875, 0.40703511238098145, 0.43718576431274414, 0.46733665466308594, 0.49748730659484863, 0.5276381969451904, 0.5577888488769531, 0.5879397392272949, 0.6180903911590576, 0.6482410430908203, 0.6783919334411621, 0.7085425853729248, 0.7386934757232666, 0.7688441276550293, 0.7989950180053711, 0.8291456699371338, 0.8592963218688965, 0.8894472122192383, 0.919597864151001, 0.9497487545013428, 0.9798994064331055, 1.0100501775741577, 1.04020094871521, 1.0703517198562622, 1.1005024909973145, 1.1306532621383667, 1.160804033279419, 1.1909546852111816, 1.2211054563522339, 1.2512562274932861, 1.2814069986343384, 1.3115577697753906, 1.3417085409164429, 1.3718593120574951, 1.4020099639892578, 1.43216073513031, 1.4623115062713623, 1.4924622774124146, 1.5226130485534668, 1.552763819694519, 1.5829145908355713, 1.613065242767334, 1.6432160139083862, 1.6733667850494385, 1.7035175561904907, 1.733668327331543, 1.7638190984725952, 1.7939698696136475, 1.8241205215454102, 1.8542712926864624, 1.8844220638275146, 1.914572834968567, 1.9447236061096191, 1.9748743772506714, 2.0050251483917236, 2.0351758003234863, 2.065326690673828, 2.095477342605591, 2.1256279945373535, 2.1557788848876953, 2.185929775238037, 2.2160804271698, 2.2462310791015625, 2.2763819694519043, 2.306532621383667, 2.3366832733154297, 2.3668341636657715, 2.3969850540161133, 2.427135705947876, 2.4572863578796387, 2.4874372482299805, 2.517587900161743, 2.547738552093506, 2.5778894424438477, 2.6080400943756104, 2.638190984725952, 2.668341636657715, 2.6984925270080566, 2.7286431789398193, 2.758794069290161, 2.788944721221924, 2.8190953731536865, 2.8492462635040283, 2.879396915435791, 2.909547805786133, 2.9396984577178955, 2.9698493480682373, 3 ], "y": [ 0.8778234124183655, 0.8775932192802429, 0.8773521184921265, 0.8770995736122131, 0.8768350481987, 0.8765579462051392, 0.8762677907943726, 0.8759638071060181, 0.8756455183029175, 0.8753121495246887, 0.8749630451202393, 0.8745974898338318, 0.8742147088050842, 0.8738138675689697, 0.8733941316604614, 0.8729547262191772, 0.872494637966156, 0.8720129728317261, 0.871508777141571, 0.870980978012085, 0.8704284429550171, 0.8698501586914062, 0.8692448735237122, 0.8686114549636841, 0.867948591709137, 0.8672549724578857, 0.8665291666984558, 0.8657698631286621, 0.8649754524230957, 0.8641444444656372, 0.8632752299308777, 0.8623660802841187, 0.8614153861999512, 0.8604212403297424, 0.8593817949295044, 0.8582950830459595, 0.8571590781211853, 0.8559717535972595, 0.8547309041023254, 0.8534342646598816, 0.8520795702934265, 0.8506643772125244, 0.8491862416267395, 0.8476426005363464, 0.8460308313369751, 0.844348132610321, 0.8425917625427246, 0.8407589197158813, 0.8388464450836182, 0.8368514776229858, 0.8347707986831665, 0.8326011896133423, 0.8303394317626953, 0.8279821872711182, 0.8255259990692139, 0.8229673504829407, 0.8203027844429016, 0.8175286054611206, 0.8146412968635559, 0.8116370439529419, 0.8085120916366577, 0.8052627444267273, 0.801885187625885, 0.7983756065368652, 0.7947303056716919, 0.7909453511238098, 0.7870171070098877, 0.7829416990280151, 0.7787156105041504, 0.7743351459503174, 0.7697968482971191, 0.7650971412658691, 0.7602329254150391, 0.755200982093811, 0.749998152256012, 0.7446218132972717, 0.7390692234039307, 0.7333381175994873, 0.7274262309074402, 0.721331775188446, 0.7150532007217407, 0.7085890769958496, 0.7019387483596802, 0.6951014995574951, 0.6880773305892944, 0.6808663606643677, 0.6734695434570312, 0.665887713432312, 0.658122718334198, 0.6501767635345459, 0.6420522928237915, 0.6337525844573975, 0.6252813339233398, 0.6166428327560425, 0.6078417301177979, 0.5988834500312805, 0.5897738933563232, 0.5805193185806274, 0.5711268186569214, 0.5616037845611572, 0.5519583225250244, 0.542198657989502, 0.5323337316513062, 0.522372841835022, 0.5123258233070374, 0.5022026300430298, 0.49201369285583496, 0.4817698001861572, 0.4714816212654114, 0.46116048097610474, 0.4508175253868103, 0.4404641389846802, 0.4301115870475769, 0.41977155208587646, 0.40945518016815186, 0.3991734981536865, 0.38893795013427734, 0.37875908613204956, 0.36864787340164185, 0.35861438512802124, 0.34866875410079956, 0.3388206362724304, 0.32907921075820923, 0.3194533586502075, 0.30995142459869385, 0.30058127641677856, 0.29135018587112427, 0.28226524591445923, 0.27333271503448486, 0.2645580768585205, 0.2559469938278198, 0.24750375747680664, 0.2392328381538391, 0.23113775253295898, 0.2232215404510498, 0.21548670530319214, 0.20793545246124268, 0.2005692720413208, 0.1933891773223877, 0.18639600276947021, 0.17958968877792358, 0.17297017574310303, 0.16653692722320557, 0.16028887033462524, 0.15422463417053223, 0.14834284782409668, 0.14264142513275146, 0.13711822032928467, 0.13177084922790527, 0.12659651041030884, 0.12159240245819092, 0.1167556643486023, 0.11208289861679077, 0.10757094621658325, 0.10321635007858276, 0.09901547431945801, 0.09496468305587769, 0.0910603404045105, 0.08729875087738037, 0.08367615938186646, 0.0801888108253479, 0.07683265209197998, 0.07360416650772095, 0.0704994797706604, 0.06751477718353271, 0.06464642286300659, 0.06189072132110596, 0.05924391746520996, 0.05670243501663208, 0.05426293611526489, 0.05192166566848755, 0.0496753454208374, 0.04752069711685181, 0.045454442501068115, 0.04347330331802368, 0.041574299335479736, 0.03975421190261841, 0.03801029920578003, 0.036339521408081055, 0.034739136695861816, 0.03320658206939697, 0.03173905611038208, 0.030334115028381348, 0.028989136219024658, 0.027701854705810547, 0.02647000551223755, 0.025291383266448975, 0.024163663387298584, 0.023084938526153564, 0.022053062915802002, 0.02106630802154541, 0.02012258768081665, 0.01922011375427246, 0.018357396125793457, 0.017532527446746826, 0.016744017601013184, 0.015990376472473145, 0.015270054340362549, 0.014581561088562012, 0.01392364501953125 ] }, { "marker": { "color": "#636EFA", "symbol": "circle-open" }, "mode": "markers", "name": "Data", "type": "scatter", "x": [ -1.8857994079589844, -1.0606352090835571, -0.6784656643867493, -0.36353373527526855, -0.09414654970169067, 0.1439109444618225, 0.39532092213630676, 0.6952174305915833, 1.0542813539505005, 1.6605991125106812 ], "y": [ 0.8500000238418579, 0.7975000143051147, 0.7574999928474426, 0.6675000190734863, 0.5924999713897705, 0.48249998688697815, 0.42250001430511475, 0.32499998807907104, 0.22750000655651093, 0.10000000149011612 ] }, { "marker": { "color": "#636EFA", "symbol": "circle" }, "mode": "markers", "name": "Model", "type": "scatter", "x": [ -1.8857994079589844, -1.0606352090835571, -0.6784656643867493, -0.36353373527526855, -0.09414654970169067, 0.1439109444618225, 0.39532092213630676, 0.6952174305915833, 1.0542813539505005, 1.6605991125106812 ], "y": [ 0.8571722507476807, 0.7952343821525574, 0.7327879071235657, 0.6624664068222046, 0.5874650478363037, 0.5092958807945251, 0.4219977557659149, 0.32410508394241333, 0.21803104877471924, 0.0969252809882164 ] }, { "line": { "color": "#EF553B" }, "mode": "lines", "name": "1", "type": "scatter", "x": [ -3, -2.9698493480682373, -2.9396984577178955, -2.909547805786133, -2.879396915435791, -2.8492462635040283, -2.8190953731536865, -2.788944721221924, -2.758794069290161, -2.7286431789398193, -2.6984925270080566, -2.668341636657715, -2.638190984725952, -2.6080400943756104, -2.5778894424438477, -2.547738552093506, -2.517587900161743, -2.4874372482299805, -2.4572863578796387, -2.427135705947876, -2.3969850540161133, -2.3668341636657715, -2.3366832733154297, -2.306532621383667, -2.2763819694519043, -2.2462310791015625, -2.2160804271698, -2.185929775238037, -2.1557788848876953, -2.1256279945373535, -2.095477342605591, -2.065326690673828, -2.0351758003234863, -2.0050251483917236, -1.9748743772506714, -1.9447236061096191, -1.914572834968567, -1.8844220638275146, -1.8542712926864624, -1.8241205215454102, -1.7939698696136475, -1.7638190984725952, -1.733668327331543, -1.7035175561904907, -1.6733667850494385, -1.6432160139083862, -1.613065242767334, -1.5829145908355713, -1.552763819694519, -1.5226130485534668, -1.4924622774124146, -1.4623115062713623, -1.43216073513031, -1.4020099639892578, -1.3718593120574951, -1.3417085409164429, -1.3115577697753906, -1.2814069986343384, -1.2512562274932861, -1.2211054563522339, -1.1909546852111816, -1.160804033279419, -1.1306532621383667, -1.1005024909973145, -1.0703517198562622, -1.04020094871521, -1.0100501775741577, -0.9798994064331055, -0.9497487545013428, -0.919597864151001, -0.8894472122192383, -0.8592963218688965, -0.8291456699371338, -0.7989950180053711, -0.7688441276550293, -0.7386934757232666, -0.7085425853729248, -0.6783919334411621, -0.6482410430908203, -0.6180903911590576, -0.5879397392272949, -0.5577888488769531, -0.5276381969451904, -0.49748730659484863, -0.46733665466308594, -0.43718576431274414, -0.40703511238098145, -0.37688446044921875, -0.34673357009887695, -0.31658291816711426, -0.28643202781677246, -0.25628137588500977, -0.22613048553466797, -0.19597983360290527, -0.16582918167114258, -0.13567829132080078, -0.10552763938903809, -0.07537674903869629, -0.045226097106933594, -0.015075206756591797, 0.015075206756591797, 0.045226097106933594, 0.07537674903869629, 0.10552763938903809, 0.13567829132080078, 0.16582918167114258, 0.19597983360290527, 0.22613048553466797, 0.25628137588500977, 0.28643202781677246, 0.31658291816711426, 0.34673357009887695, 0.37688446044921875, 0.40703511238098145, 0.43718576431274414, 0.46733665466308594, 0.49748730659484863, 0.5276381969451904, 0.5577888488769531, 0.5879397392272949, 0.6180903911590576, 0.6482410430908203, 0.6783919334411621, 0.7085425853729248, 0.7386934757232666, 0.7688441276550293, 0.7989950180053711, 0.8291456699371338, 0.8592963218688965, 0.8894472122192383, 0.919597864151001, 0.9497487545013428, 0.9798994064331055, 1.0100501775741577, 1.04020094871521, 1.0703517198562622, 1.1005024909973145, 1.1306532621383667, 1.160804033279419, 1.1909546852111816, 1.2211054563522339, 1.2512562274932861, 1.2814069986343384, 1.3115577697753906, 1.3417085409164429, 1.3718593120574951, 1.4020099639892578, 1.43216073513031, 1.4623115062713623, 1.4924622774124146, 1.5226130485534668, 1.552763819694519, 1.5829145908355713, 1.613065242767334, 1.6432160139083862, 1.6733667850494385, 1.7035175561904907, 1.733668327331543, 1.7638190984725952, 1.7939698696136475, 1.8241205215454102, 1.8542712926864624, 1.8844220638275146, 1.914572834968567, 1.9447236061096191, 1.9748743772506714, 2.0050251483917236, 2.0351758003234863, 2.065326690673828, 2.095477342605591, 2.1256279945373535, 2.1557788848876953, 2.185929775238037, 2.2160804271698, 2.2462310791015625, 2.2763819694519043, 2.306532621383667, 2.3366832733154297, 2.3668341636657715, 2.3969850540161133, 2.427135705947876, 2.4572863578796387, 2.4874372482299805, 2.517587900161743, 2.547738552093506, 2.5778894424438477, 2.6080400943756104, 2.638190984725952, 2.668341636657715, 2.6984925270080566, 2.7286431789398193, 2.758794069290161, 2.788944721221924, 2.8190953731536865, 2.8492462635040283, 2.879396915435791, 2.909547805786133, 2.9396984577178955, 2.9698493480682373, 3 ], "y": [ 0.12217658758163452, 0.12240677326917648, 0.12264788150787354, 0.12290044128894806, 0.12316497415304184, 0.12344203889369965, 0.12373223900794983, 0.12403617054224014, 0.12435447424650192, 0.12468782812356949, 0.12503692507743835, 0.12540249526500702, 0.12578529119491577, 0.12618613243103027, 0.1266058385372162, 0.12704527378082275, 0.1275053471326828, 0.12798699736595154, 0.12849122285842896, 0.12901905179023743, 0.1295715570449829, 0.13014985620975494, 0.13075511157512665, 0.13138854503631592, 0.13205140829086304, 0.13274505734443665, 0.1334708333015442, 0.13423016667366028, 0.13502457737922668, 0.135855570435524, 0.1367247849702835, 0.13763388991355896, 0.13858461380004883, 0.13957877457141876, 0.140618234872818, 0.14170494675636292, 0.1428409218788147, 0.14402826130390167, 0.14526911079883575, 0.1465657353401184, 0.1479204297065735, 0.1493356078863144, 0.1508137434720993, 0.15235738456249237, 0.1539691835641861, 0.15565185248851776, 0.157408207654953, 0.15924111008644104, 0.16115354001522064, 0.16314853727817535, 0.16522923111915588, 0.16739881038665771, 0.1696605682373047, 0.17201782763004303, 0.17447401583194733, 0.17703263461589813, 0.1796972155570984, 0.182471364736557, 0.1853587031364441, 0.1883629858493805, 0.19148793816566467, 0.1947372555732727, 0.198114812374115, 0.20162436366081238, 0.2052697241306305, 0.20905464887619019, 0.2129829227924347, 0.21705828607082367, 0.22128435969352722, 0.22566485404968262, 0.23020318150520325, 0.23490282893180847, 0.23976704478263855, 0.24479904770851135, 0.25000184774398804, 0.25537818670272827, 0.26093074679374695, 0.2666618525981903, 0.2725737690925598, 0.27866822481155396, 0.28494682908058167, 0.2914109230041504, 0.2980612516403198, 0.3048985004425049, 0.31192266941070557, 0.31913360953330994, 0.32653048634529114, 0.3341122567653656, 0.341877281665802, 0.3498232662677765, 0.3579477369785309, 0.36624738574028015, 0.37471866607666016, 0.3833571970462799, 0.39215824007987976, 0.4011165499687195, 0.41022613644599915, 0.41948068141937256, 0.4288731515407562, 0.4383961856365204, 0.4480416774749756, 0.45780137181282043, 0.46766626834869385, 0.4776271879673004, 0.48767417669296265, 0.4977973997592926, 0.507986307144165, 0.5182301998138428, 0.5285183787345886, 0.5388395190238953, 0.5491824746131897, 0.5595358610153198, 0.5698884129524231, 0.5802284479141235, 0.5905448198318481, 0.6008265018463135, 0.6110620498657227, 0.6212409138679504, 0.6313521265983582, 0.6413856148719788, 0.6513312458992004, 0.6611793637275696, 0.6709207892417908, 0.6805466413497925, 0.6900485754013062, 0.6994187235832214, 0.7086498141288757, 0.7177347540855408, 0.7266672849655151, 0.7354419231414795, 0.7440530061721802, 0.7524962425231934, 0.7607671618461609, 0.768862247467041, 0.7767784595489502, 0.7845132946968079, 0.7920645475387573, 0.7994307279586792, 0.8066108226776123, 0.8136039972305298, 0.8204103112220764, 0.827029824256897, 0.8334630727767944, 0.8397111296653748, 0.8457753658294678, 0.8516571521759033, 0.8573585748672485, 0.8628817796707153, 0.8682291507720947, 0.8734034895896912, 0.8784075975418091, 0.8832443356513977, 0.8879171013832092, 0.8924290537834167, 0.8967836499214172, 0.900984525680542, 0.9050353169441223, 0.9089396595954895, 0.9127012491226196, 0.9163238406181335, 0.9198111891746521, 0.92316734790802, 0.926395833492279, 0.9295005202293396, 0.9324852228164673, 0.9353535771369934, 0.938109278678894, 0.94075608253479, 0.9432975649833679, 0.9457370638847351, 0.9480783343315125, 0.9503246545791626, 0.9524793028831482, 0.9545455574989319, 0.9565266966819763, 0.9584257006645203, 0.9602457880973816, 0.96198970079422, 0.963660478591919, 0.9652608633041382, 0.966793417930603, 0.9682609438896179, 0.9696658849716187, 0.9710108637809753, 0.9722981452941895, 0.9735299944877625, 0.974708616733551, 0.9758363366127014, 0.9769150614738464, 0.977946937084198, 0.9789336919784546, 0.9798774123191833, 0.9807798862457275, 0.9816426038742065, 0.9824674725532532, 0.9832559823989868, 0.9840096235275269, 0.9847299456596375, 0.985418438911438, 0.9860763549804688 ] }, { "marker": { "color": "#EF553B", "symbol": "circle-open" }, "mode": "markers", "name": "Data", "type": "scatter", "x": [ -1.8857994079589844, -1.0606352090835571, -0.6784656643867493, -0.36353373527526855, -0.09414654970169067, 0.1439109444618225, 0.39532092213630676, 0.6952174305915833, 1.0542813539505005, 1.6605991125106812 ], "y": [ 0.15000000596046448, 0.20250000059604645, 0.24250000715255737, 0.33250001072883606, 0.4074999988079071, 0.5174999833106995, 0.5774999856948853, 0.675000011920929, 0.7724999785423279, 0.8999999761581421 ] }, { "marker": { "color": "#EF553B", "symbol": "circle" }, "mode": "markers", "name": "Model", "type": "scatter", "x": [ -1.8857994079589844, -1.0606352090835571, -0.6784656643867493, -0.36353373527526855, -0.09414654970169067, 0.1439109444618225, 0.39532092213630676, 0.6952174305915833, 1.0542813539505005, 1.6605991125106812 ], "y": [ 0.14282770454883575, 0.20476561784744263, 0.2672121524810791, 0.33753350377082825, 0.4125349521636963, 0.49070411920547485, 0.5780022144317627, 0.6758949756622314, 0.7819690108299255, 0.9030747413635254 ] } ], "layout": { "legend": { "title": { "text": "Score" } }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "white", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "white", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "#C8D4E3", "linecolor": "#C8D4E3", "minorgridcolor": "#C8D4E3", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "#C8D4E3", "linecolor": "#C8D4E3", "minorgridcolor": "#C8D4E3", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "sequentialminus": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "white", "showlakes": true, "showland": true, "subunitcolor": "#C8D4E3" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "white", "polar": { "angularaxis": { "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "" }, "bgcolor": "white", "radialaxis": { "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "white", "gridcolor": "#DFE8F3", "gridwidth": 2, "linecolor": "#EBF0F8", "showbackground": true, "ticks": "", "zerolinecolor": "#EBF0F8" }, "yaxis": { "backgroundcolor": "white", "gridcolor": "#DFE8F3", "gridwidth": 2, "linecolor": "#EBF0F8", "showbackground": true, "ticks": "", "zerolinecolor": "#EBF0F8" }, "zaxis": { "backgroundcolor": "white", "gridcolor": "#DFE8F3", "gridwidth": 2, "linecolor": "#EBF0F8", "showbackground": true, "ticks": "", "zerolinecolor": "#EBF0F8" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "#DFE8F3", "linecolor": "#A2B1C6", "ticks": "" }, "baxis": { "gridcolor": "#DFE8F3", "linecolor": "#A2B1C6", "ticks": "" }, "bgcolor": "white", "caxis": { "gridcolor": "#DFE8F3", "linecolor": "#A2B1C6", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "#EBF0F8", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "#EBF0F8", "zerolinewidth": 2 } } }, "title": { "text": "IRF - Item 56" }, "xaxis": { "title": { "text": "Latent variable" } }, "yaxis": { "title": { "text": "Probability" } } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "threepl.plot.item_probabilities(item = 56, plot_group_fit=True, group_fit_data=train_data_binary, group_fit_population_theta=theta_train_threepl).show()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Modeling incorrect responses\n", "We proceed by creating two nested logit models to model the incorrect response options (distractors). The first model uses a nominal response model for the incorrect responses, and the second model uses more flexible B-splines. Explicitly modeling the distractors can enhance the precision of latent trait estimation by considering how likely someone is to pick each specific distractor based on their ability level. These models take a model for the correct responses, such as the 3PL model we created earlier, as an input. We can choose whether to use a pre-fitted correct response model or simply a fresh model instance. Since the pre-fitted 3PL should provide good starting parameters, we use that one.\n", "\n", "In this case, we create copies of the 3PL model, otherwise the models would update each other's parameters which we do not want. If one simply fits one model, copying is not needed. We fit these models in the same procedure as with the 3PL model." ] }, { "cell_type": "code", "execution_count": 26, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "Epoch: 89. Loss: 308682.6250 " ] }, { "name": "stderr", "output_type": "stream", "text": [ "INFO: Stopping training after 2 learning rate updates.\n", "INFO: Best model found at iteration 89 with loss 308682.6250.\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Epoch: 100. Loss: 307686.1875 " ] }, { "name": "stderr", "output_type": "stream", "text": [ "INFO: Stopping training after 2 learning rate updates.\n", "INFO: Best model found at iteration 100 with loss 307686.1875.\n" ] } ], "source": [ "threepl_nominal = copy.deepcopy(threepl)\n", "threepl_bspline = copy.deepcopy(threepl)\n", "nested_nominal = NestedLogit(mc_correct = correct_responses, correct_response_model = threepl_nominal, incorrect_response_model = \"nominal\", data = train_data)\n", "nested_bspline = NestedLogit(mc_correct = correct_responses, correct_response_model = threepl_bspline, incorrect_response_model = \"bspline\", data = train_data)\n", "nested_nominal.fit(train_data=train_data, algorithm=MML())\n", "nested_bspline.fit(train_data=train_data, algorithm=MML())\n", "nested_nominal.save_model(\"swesat_nested_nominal.pt\")\n", "nested_bspline.save_model(\"swesat_nested_bspline.pt\")" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "We proceed by estimating the $\\theta$ scores using the nested logit models." ] }, { "cell_type": "code", "execution_count": 27, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "INFO: Optimizing theta scores...\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Iteration 5: Current Loss = 303979.4375 " ] }, { "name": "stderr", "output_type": "stream", "text": [ "INFO: Converged at iteration 5.\n", "INFO: Computing Jacobian for all items and item categories...\n", "INFO: Optimizing theta scores...\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Iteration 5: Current Loss = 302579.46875 " ] }, { "name": "stderr", "output_type": "stream", "text": [ "INFO: Converged at iteration 5.\n", "INFO: Computing Jacobian for all items and item categories...\n", "INFO: Optimizing theta scores...\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Iteration 3: Current Loss = 75308.203125 " ] }, { "name": "stderr", "output_type": "stream", "text": [ "INFO: Converged at iteration 3.\n", "INFO: Computing Jacobian for all items and item categories...\n", "INFO: Optimizing theta scores...\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Iteration 5: Current Loss = 75252.1328125 " ] }, { "name": "stderr", "output_type": "stream", "text": [ "INFO: Converged at iteration 5.\n", "INFO: Computing Jacobian for all items and item categories...\n" ] } ], "source": [ "theta_train_nominal, theta_se_train_nominal = nested_nominal.latent_scores(train_data, standard_errors=True)\n", "theta_train_bspline, theta_se_train_bspline = nested_bspline.latent_scores(train_data, standard_errors=True)\n", "theta_test_nominal, theta_se_test_nominal = nested_nominal.latent_scores(test_data, standard_errors=True)\n", "theta_test_bspline, theta_se_test_bspline = nested_bspline.latent_scores(test_data, standard_errors=True)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "If we can compare the $\\theta$ standard errors by computing the mean difference between the nested logit standard errors and the 3PL standard errors from before, we see that on average, there is less uncertainty in the $\\theta$ estimates from the nested logit models. The extra information from the incorrect responses appears to provide slightly more reliable $\\theta$ estimates in general. However, this is not the case for every test taker, as some may have unusual incorrect response patterns given their estimated $\\theta$, leading to more uncertainty. Modeling the distractors with splines appears to lower the standard errors the most in this case.\n", "\n", "We excluded test takers with very large standard errors as a result from mostly guessing using `[~(theta_se_train_threepl>2)]`." ] }, { "cell_type": "code", "execution_count": 28, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "tensor(0.0393)\n", "tensor(0.0696)\n", "tensor(0.0303)\n" ] } ], "source": [ "print((theta_se_train_threepl-theta_se_train_nominal)[~(theta_se_train_threepl>2)].mean())\n", "print((theta_se_train_threepl-theta_se_train_bspline)[~(theta_se_train_threepl>2)].mean())\n", "print((theta_se_train_nominal-theta_se_train_bspline)[~(theta_se_train_threepl>2)].mean())" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "If we evaluate model fit of our nested logit models on our test data, most metrics are close to the same. We see that the spline model has a slightly better fit than the nominal model in terms of log-likelihood, and the nominal nested logit model actually does better in many predictive metrics. Maybe the added flexibility of the splines do not add too much for this dataset." ] }, { "cell_type": "code", "execution_count": 29, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "nominal log-likelihood: -75308\n", "bspline log-likelihood: -75252\n", "nominal accuracy: 0.607\n", "bspline accuracy: 0.606\n", "nominal metrics:\n", "precision 0.264\n", "recall 0.296\n", "f1 0.260\n", "w_precision 0.469\n", "w_recall 0.607\n", "w_f1 0.515\n", "dtype: float32\n", "--------------------\n", "bspline metrics:\n", "precision 0.267\n", "recall 0.294\n", "f1 0.258\n", "w_precision 0.474\n", "w_recall 0.606\n", "w_f1 0.515\n", "dtype: float32\n", "--------------------\n" ] } ], "source": [ "print(f\"nominal log-likelihood: {round(nested_nominal.evaluate.log_likelihood(data=test_data, theta=theta_test_nominal).item())}\")\n", "print(f\"bspline log-likelihood: {round(nested_bspline.evaluate.log_likelihood(data=test_data, theta=theta_test_bspline).item())}\")\n", "print(f\"nominal accuracy: {round(nested_nominal.evaluate.accuracy(data=test_data, theta=theta_test_nominal).item(), 3)}\")\n", "print(f\"bspline accuracy: {round(nested_bspline.evaluate.accuracy(data=test_data, theta=theta_test_bspline).item(), 3)}\")\n", "print(f\"nominal metrics:\\n{round(nested_nominal.evaluate.predictions(data=test_data, theta=theta_test_nominal).mean(axis=0), 3)}\\n--------------------\")\n", "print(f\"bspline metrics:\\n{round(nested_bspline.evaluate.predictions(data=test_data, theta=theta_test_bspline).mean(axis=0), 3)}\\n--------------------\")" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "We can plot the item response functions for these models to visualize how the incorrect response probabilities change over the latent variable. Analyzing distractors gives test creators a way to check how well the incorrect options are working. For example, it can highlight distractors that are hardly ever chosen or those that might be confusingly attractive to high-ability test-takers, indicating potential issues.\n", "\n", "For example, option 2 appears to be the most popular distractor for item 34, and is the most common response for most of the $\\theta$ scale. In fact, it is chosen quite often even for test takers performing above average. Maybe this distractor is even too confusing? It could be worth looking at." ] }, { "cell_type": "code", "execution_count": 30, "metadata": {}, "outputs": [ { "data": { "application/vnd.plotly.v1+json": { "config": { "plotlyServerURL": "https://plot.ly" }, "data": [ { "line": { "color": "#636EFA" }, "mode": "lines", "name": "Option 1", "type": "scatter", "x": [ -3, -2.9698493480682373, -2.9396984577178955, -2.909547805786133, -2.879396915435791, -2.8492462635040283, -2.8190953731536865, -2.788944721221924, -2.758794069290161, -2.7286431789398193, -2.6984925270080566, -2.668341636657715, -2.638190984725952, -2.6080400943756104, -2.5778894424438477, -2.547738552093506, -2.517587900161743, -2.4874372482299805, -2.4572863578796387, -2.427135705947876, -2.3969850540161133, -2.3668341636657715, -2.3366832733154297, -2.306532621383667, -2.2763819694519043, -2.2462310791015625, -2.2160804271698, -2.185929775238037, -2.1557788848876953, -2.1256279945373535, -2.095477342605591, -2.065326690673828, -2.0351758003234863, -2.0050251483917236, -1.9748743772506714, -1.9447236061096191, -1.914572834968567, -1.8844220638275146, -1.8542712926864624, -1.8241205215454102, -1.7939698696136475, -1.7638190984725952, -1.733668327331543, -1.7035175561904907, -1.6733667850494385, -1.6432160139083862, -1.613065242767334, -1.5829145908355713, -1.552763819694519, -1.5226130485534668, -1.4924622774124146, -1.4623115062713623, -1.43216073513031, -1.4020099639892578, -1.3718593120574951, -1.3417085409164429, -1.3115577697753906, -1.2814069986343384, -1.2512562274932861, -1.2211054563522339, -1.1909546852111816, -1.160804033279419, -1.1306532621383667, -1.1005024909973145, -1.0703517198562622, -1.04020094871521, -1.0100501775741577, -0.9798994064331055, -0.9497487545013428, -0.919597864151001, -0.8894472122192383, -0.8592963218688965, -0.8291456699371338, -0.7989950180053711, -0.7688441276550293, -0.7386934757232666, -0.7085425853729248, -0.6783919334411621, -0.6482410430908203, -0.6180903911590576, -0.5879397392272949, -0.5577888488769531, -0.5276381969451904, -0.49748730659484863, -0.46733665466308594, -0.43718576431274414, -0.40703511238098145, -0.37688446044921875, -0.34673357009887695, -0.31658291816711426, -0.28643202781677246, -0.25628137588500977, -0.22613048553466797, -0.19597983360290527, -0.16582918167114258, -0.13567829132080078, -0.10552763938903809, -0.07537674903869629, -0.045226097106933594, -0.015075206756591797, 0.015075206756591797, 0.045226097106933594, 0.07537674903869629, 0.10552763938903809, 0.13567829132080078, 0.16582918167114258, 0.19597983360290527, 0.22613048553466797, 0.25628137588500977, 0.28643202781677246, 0.31658291816711426, 0.34673357009887695, 0.37688446044921875, 0.40703511238098145, 0.43718576431274414, 0.46733665466308594, 0.49748730659484863, 0.5276381969451904, 0.5577888488769531, 0.5879397392272949, 0.6180903911590576, 0.6482410430908203, 0.6783919334411621, 0.7085425853729248, 0.7386934757232666, 0.7688441276550293, 0.7989950180053711, 0.8291456699371338, 0.8592963218688965, 0.8894472122192383, 0.919597864151001, 0.9497487545013428, 0.9798994064331055, 1.0100501775741577, 1.04020094871521, 1.0703517198562622, 1.1005024909973145, 1.1306532621383667, 1.160804033279419, 1.1909546852111816, 1.2211054563522339, 1.2512562274932861, 1.2814069986343384, 1.3115577697753906, 1.3417085409164429, 1.3718593120574951, 1.4020099639892578, 1.43216073513031, 1.4623115062713623, 1.4924622774124146, 1.5226130485534668, 1.552763819694519, 1.5829145908355713, 1.613065242767334, 1.6432160139083862, 1.6733667850494385, 1.7035175561904907, 1.733668327331543, 1.7638190984725952, 1.7939698696136475, 1.8241205215454102, 1.8542712926864624, 1.8844220638275146, 1.914572834968567, 1.9447236061096191, 1.9748743772506714, 2.0050251483917236, 2.0351758003234863, 2.065326690673828, 2.095477342605591, 2.1256279945373535, 2.1557788848876953, 2.185929775238037, 2.2160804271698, 2.2462310791015625, 2.2763819694519043, 2.306532621383667, 2.3366832733154297, 2.3668341636657715, 2.3969850540161133, 2.427135705947876, 2.4572863578796387, 2.4874372482299805, 2.517587900161743, 2.547738552093506, 2.5778894424438477, 2.6080400943756104, 2.638190984725952, 2.668341636657715, 2.6984925270080566, 2.7286431789398193, 2.758794069290161, 2.788944721221924, 2.8190953731536865, 2.8492462635040283, 2.879396915435791, 2.909547805786133, 2.9396984577178955, 2.9698493480682373, 3 ], "y": [ 0.2923617959022522, 0.29239416122436523, 0.2924281060695648, 0.2924636900424957, 0.2925010323524475, 0.29254016280174255, 0.2925812304019928, 0.29262426495552063, 0.292669415473938, 0.29271677136421204, 0.29276642203330994, 0.29281851649284363, 0.2928731143474579, 0.29293039441108704, 0.29299044609069824, 0.29305341839790344, 0.2931194603443146, 0.2931887209415436, 0.2932613492012024, 0.29333752393722534, 0.293417364358902, 0.2935011088848114, 0.29358893632888794, 0.2936810255050659, 0.29377758502960205, 0.29387882351875305, 0.293984979391098, 0.29409629106521606, 0.2942129969596863, 0.29433536529541016, 0.2944636642932892, 0.29459819197654724, 0.2947392165660858, 0.29488709568977356, 0.29504209756851196, 0.29520463943481445, 0.2953750193119049, 0.29555362462997437, 0.29574087262153625, 0.295937180519104, 0.29614293575286865, 0.2963586151599884, 0.29658469557762146, 0.296821653842926, 0.2970700263977051, 0.2973303496837616, 0.29760316014289856, 0.2978890836238861, 0.2981887459754944, 0.29850274324417114, 0.2988317906856537, 0.2991766035556793, 0.29953786730766296, 0.2999163866043091, 0.30031293630599976, 0.3007284104824066, 0.3011636435985565, 0.3016195595264435, 0.3020971119403839, 0.3025972843170166, 0.3031211197376251, 0.30366969108581543, 0.30424416065216064, 0.3048456609249115, 0.3054754436016083, 0.30613476037979126, 0.3068249225616455, 0.30754736065864563, 0.30830347537994385, 0.30909472703933716, 0.3099227249622345, 0.3107890188694, 0.31169530749320984, 0.31264328956604004, 0.31363481283187866, 0.31467169523239136, 0.3157559037208557, 0.31688934564590454, 0.31807416677474976, 0.3193124532699585, 0.32060641050338745, 0.3219583034515381, 0.32337048649787903, 0.3248453438282013, 0.32638534903526306, 0.3279930651187897, 0.32967108488082886, 0.3314221203327179, 0.33324891328811646, 0.3351542055606842, 0.3371409475803375, 0.33921200037002563, 0.3413704037666321, 0.34361913800239563, 0.3459612727165222, 0.34839996695518494, 0.3509383201599121, 0.3535795211791992, 0.35632675886154175, 0.35918325185775757, 0.362152099609375, 0.36523663997650146, 0.3684399425983429, 0.3717651963233948, 0.37521547079086304, 0.3787938356399536, 0.3825032413005829, 0.3863465189933777, 0.39032652974128723, 0.39444583654403687, 0.3987070322036743, 0.40311241149902344, 0.4076642096042633, 0.41236433386802673, 0.417214572429657, 0.422216534614563, 0.42737138271331787, 0.4326801896095276, 0.4381435513496399, 0.443761944770813, 0.4495352506637573, 0.4554632902145386, 0.4615452289581299, 0.4677799940109253, 0.4741661250591278, 0.4807015657424927, 0.48738405108451843, 0.4942105710506439, 0.501177966594696, 0.5082824230194092, 0.5155197381973267, 0.5228852033615112, 0.5303735733032227, 0.5379793047904968, 0.5456963777542114, 0.5535181760787964, 0.5614378452301025, 0.5694480538368225, 0.5775411128997803, 0.5857088565826416, 0.5939431190490723, 0.6022351384162903, 0.6105759739875793, 0.6189565062522888, 0.6273674964904785, 0.6357994079589844, 0.6442427039146423, 0.6526877880096436, 0.6611251831054688, 0.6695452928543091, 0.6779385209083557, 0.6862955093383789, 0.694607138633728, 0.702864408493042, 0.711058497428894, 0.7191809415817261, 0.7272236347198486, 0.7351785898208618, 0.743038535118103, 0.7507961988449097, 0.7584449648857117, 0.7659787535667419, 0.773391604423523, 0.7806782722473145, 0.7878337502479553, 0.7948538064956665, 0.8017343282699585, 0.8084719181060791, 0.8150637149810791, 0.8215067386627197, 0.8277993202209473, 0.8339396715164185, 0.8399263620376587, 0.8457585573196411, 0.8514358997344971, 0.856958270072937, 0.8623256683349609, 0.8675390481948853, 0.8725990056991577, 0.8775068521499634, 0.8822640180587769, 0.8868719339370728, 0.891332745552063, 0.8956484794616699, 0.8998215198516846, 0.903854250907898, 0.9077491760253906, 0.9115092754364014, 0.9151370525360107, 0.9186357259750366, 0.9220082759857178, 0.9252575635910034, 0.928386926651001, 0.9313994646072388, 0.9342982769012451, 0.9370867013931274, 0.9397678375244141, 0.9423449039459229, 0.9448212385177612, 0.9471997022628784 ] }, { "marker": { "color": "#636EFA", "symbol": "circle-open" }, "mode": "markers", "name": "Data", "type": "scatter", "x": [ -1.7393314838409424, -1.1220300197601318, -0.7101010680198669, -0.38662999868392944, -0.1055997908115387, 0.15158772468566895, 0.4124176502227783, 0.7205674052238464, 1.0900816917419434, 1.6987545490264893 ], "y": [ 0.33919596672058105, 0.23499999940395355, 0.34170854091644287, 0.33834585547447205, 0.36250001192092896, 0.35249999165534973, 0.38847118616104126, 0.48500001430511475, 0.5450000166893005, 0.75 ] }, { "marker": { "color": "#636EFA", "symbol": "circle" }, "mode": "markers", "name": "Model", "type": "scatter", "x": [ -1.7393314838409424, -1.1220300197601318, -0.7101010680198669, -0.38662999868392944, -0.1055997908115387, 0.15158772468566895, 0.4124176502227783, 0.7205674052238464, 1.0900816917419434, 1.6987545490264893 ], "y": [ 0.29658180475234985, 0.3044975697994232, 0.3158916234970093, 0.33103829622268677, 0.35109981894493103, 0.377400666475296, 0.4146937429904938, 0.4713571071624756, 0.5630716681480408, 0.744391918182373 ] }, { "line": { "color": "#EF553B" }, "mode": "lines", "name": "Option 2", "type": "scatter", "x": [ -3, -2.9698493480682373, -2.9396984577178955, -2.909547805786133, -2.879396915435791, -2.8492462635040283, -2.8190953731536865, -2.788944721221924, -2.758794069290161, -2.7286431789398193, -2.6984925270080566, -2.668341636657715, -2.638190984725952, -2.6080400943756104, -2.5778894424438477, -2.547738552093506, -2.517587900161743, -2.4874372482299805, -2.4572863578796387, -2.427135705947876, -2.3969850540161133, -2.3668341636657715, -2.3366832733154297, -2.306532621383667, -2.2763819694519043, -2.2462310791015625, -2.2160804271698, -2.185929775238037, -2.1557788848876953, -2.1256279945373535, -2.095477342605591, -2.065326690673828, -2.0351758003234863, -2.0050251483917236, -1.9748743772506714, -1.9447236061096191, -1.914572834968567, -1.8844220638275146, -1.8542712926864624, -1.8241205215454102, -1.7939698696136475, -1.7638190984725952, -1.733668327331543, -1.7035175561904907, -1.6733667850494385, -1.6432160139083862, -1.613065242767334, -1.5829145908355713, -1.552763819694519, -1.5226130485534668, -1.4924622774124146, -1.4623115062713623, -1.43216073513031, -1.4020099639892578, -1.3718593120574951, -1.3417085409164429, -1.3115577697753906, -1.2814069986343384, -1.2512562274932861, -1.2211054563522339, -1.1909546852111816, -1.160804033279419, -1.1306532621383667, -1.1005024909973145, -1.0703517198562622, -1.04020094871521, -1.0100501775741577, -0.9798994064331055, -0.9497487545013428, -0.919597864151001, -0.8894472122192383, -0.8592963218688965, -0.8291456699371338, -0.7989950180053711, -0.7688441276550293, -0.7386934757232666, -0.7085425853729248, -0.6783919334411621, -0.6482410430908203, -0.6180903911590576, -0.5879397392272949, -0.5577888488769531, -0.5276381969451904, -0.49748730659484863, -0.46733665466308594, -0.43718576431274414, -0.40703511238098145, -0.37688446044921875, -0.34673357009887695, -0.31658291816711426, -0.28643202781677246, -0.25628137588500977, -0.22613048553466797, -0.19597983360290527, -0.16582918167114258, -0.13567829132080078, -0.10552763938903809, -0.07537674903869629, -0.045226097106933594, -0.015075206756591797, 0.015075206756591797, 0.045226097106933594, 0.07537674903869629, 0.10552763938903809, 0.13567829132080078, 0.16582918167114258, 0.19597983360290527, 0.22613048553466797, 0.25628137588500977, 0.28643202781677246, 0.31658291816711426, 0.34673357009887695, 0.37688446044921875, 0.40703511238098145, 0.43718576431274414, 0.46733665466308594, 0.49748730659484863, 0.5276381969451904, 0.5577888488769531, 0.5879397392272949, 0.6180903911590576, 0.6482410430908203, 0.6783919334411621, 0.7085425853729248, 0.7386934757232666, 0.7688441276550293, 0.7989950180053711, 0.8291456699371338, 0.8592963218688965, 0.8894472122192383, 0.919597864151001, 0.9497487545013428, 0.9798994064331055, 1.0100501775741577, 1.04020094871521, 1.0703517198562622, 1.1005024909973145, 1.1306532621383667, 1.160804033279419, 1.1909546852111816, 1.2211054563522339, 1.2512562274932861, 1.2814069986343384, 1.3115577697753906, 1.3417085409164429, 1.3718593120574951, 1.4020099639892578, 1.43216073513031, 1.4623115062713623, 1.4924622774124146, 1.5226130485534668, 1.552763819694519, 1.5829145908355713, 1.613065242767334, 1.6432160139083862, 1.6733667850494385, 1.7035175561904907, 1.733668327331543, 1.7638190984725952, 1.7939698696136475, 1.8241205215454102, 1.8542712926864624, 1.8844220638275146, 1.914572834968567, 1.9447236061096191, 1.9748743772506714, 2.0050251483917236, 2.0351758003234863, 2.065326690673828, 2.095477342605591, 2.1256279945373535, 2.1557788848876953, 2.185929775238037, 2.2160804271698, 2.2462310791015625, 2.2763819694519043, 2.306532621383667, 2.3366832733154297, 2.3668341636657715, 2.3969850540161133, 2.427135705947876, 2.4572863578796387, 2.4874372482299805, 2.517587900161743, 2.547738552093506, 2.5778894424438477, 2.6080400943756104, 2.638190984725952, 2.668341636657715, 2.6984925270080566, 2.7286431789398193, 2.758794069290161, 2.788944721221924, 2.8190953731536865, 2.8492462635040283, 2.879396915435791, 2.909547805786133, 2.9396984577178955, 2.9698493480682373, 3 ], "y": [ 0.26279565691947937, 0.26778098940849304, 0.27278682589530945, 0.2778107821941376, 0.28285062313079834, 0.2879039943218231, 0.2929686903953552, 0.2980422377586365, 0.3031223714351654, 0.30820682644844055, 0.31329312920570374, 0.31837907433509827, 0.32346227765083313, 0.328540563583374, 0.333611398935318, 0.3386727571487427, 0.3437221944332123, 0.3487575650215149, 0.3537767231464386, 0.35877740383148193, 0.36375752091407776, 0.3687150478363037, 0.3736477792263031, 0.3785538375377655, 0.3834311068058014, 0.3882777690887451, 0.3930918574333191, 0.39787155389785767, 0.4026150703430176, 0.4073205888271332, 0.41198650002479553, 0.4166110157966614, 0.4211926758289337, 0.4257298409938812, 0.43022099137306213, 0.43466463685035706, 0.43905943632125854, 0.4434039294719696, 0.44769686460494995, 0.4519367814064026, 0.45612266659736633, 0.46025314927101135, 0.4643271267414093, 0.4683435261249542, 0.4723011553287506, 0.47619903087615967, 0.48003607988357544, 0.48381122946739197, 0.4875236749649048, 0.4911723732948303, 0.49475640058517456, 0.49827489256858826, 0.5017268657684326, 0.5051116347312927, 0.5084280371665955, 0.5116754770278931, 0.5148529410362244, 0.517959713935852, 0.5209947824478149, 0.523957371711731, 0.5268467664718628, 0.5296617746353149, 0.5324017405509949, 0.5350657105445862, 0.5376527309417725, 0.5401618480682373, 0.5425921082496643, 0.5449424982070923, 0.5472120046615601, 0.5493995547294617, 0.5515039563179016, 0.5535241365432739, 0.5554588437080383, 0.5573070049285889, 0.5590670108795166, 0.5607378482818604, 0.5623179078102112, 0.5638057589530945, 0.5651999115943909, 0.566498875617981, 0.5677009224891663, 0.5688043236732483, 0.5698073506355286, 0.5707082152366638, 0.5715048313140869, 0.5721954703330994, 0.5727779269218445, 0.5732501745223999, 0.5736099481582642, 0.5738551616668701, 0.5739834308624268, 0.5739923119544983, 0.5738795399665833, 0.5736424922943115, 0.5732787251472473, 0.5727856159210205, 0.5721606612205505, 0.5714010000228882, 0.5705040693283081, 0.5694671273231506, 0.5682875514030457, 0.5669625401496887, 0.5654893517494202, 0.5638653039932251, 0.562087893486023, 0.5601541996002197, 0.5580617785453796, 0.5558083057403564, 0.5533910989761353, 0.5508080124855042, 0.5480568408966064, 0.5451355576515198, 0.5420423746109009, 0.5387753248214722, 0.5353332161903381, 0.5317144393920898, 0.52791827917099, 0.5239437818527222, 0.519790530204773, 0.5154582262039185, 0.5109471678733826, 0.5062577724456787, 0.501390814781189, 0.4963476359844208, 0.49112972617149353, 0.4857393503189087, 0.48017871379852295, 0.4744510352611542, 0.46855947375297546, 0.46250787377357483, 0.4563005864620209, 0.44994229078292847, 0.4434382915496826, 0.4367942214012146, 0.4300161302089691, 0.42311063408851624, 0.41608476638793945, 0.40894579887390137, 0.40170150995254517, 0.39436018466949463, 0.38693004846572876, 0.3794200122356415, 0.3718390464782715, 0.36419644951820374, 0.3565015494823456, 0.3487641215324402, 0.34099385142326355, 0.33320045471191406, 0.3253936469554901, 0.317583292722702, 0.30977919697761536, 0.3019910156726837, 0.29422810673713684, 0.2864997982978821, 0.27881526947021484, 0.2711832523345947, 0.26361218094825745, 0.2561105489730835, 0.24868586659431458, 0.2413458377122879, 0.23409752547740936, 0.22694739699363708, 0.21990184485912323, 0.21296653151512146, 0.2061469554901123, 0.19944776594638824, 0.1928735375404358, 0.18642808496952057, 0.18011479079723358, 0.17393703758716583, 0.16789698600769043, 0.16199687123298645, 0.15623855590820312, 0.1506233513355255, 0.1451520472764969, 0.13982516527175903, 0.13464318215847015, 0.12960556149482727, 0.12471209466457367, 0.11996186524629593, 0.11535385251045227, 0.11088701337575912, 0.10655955225229263, 0.10236984491348267, 0.09831579774618149, 0.09439541399478912, 0.09060648828744888, 0.08694636821746826, 0.08341285586357117, 0.08000301569700241, 0.07671415060758591, 0.07354367524385452, 0.07048849761486053, 0.06754577159881592, 0.06471263617277145, 0.06198597326874733, 0.059362903237342834, 0.05684040114283562, 0.054415345191955566, 0.052085041999816895 ] }, { "marker": { "color": "#EF553B", "symbol": "circle-open" }, "mode": "markers", "name": "Data", "type": "scatter", "x": [ -1.7393314838409424, -1.1220300197601318, -0.7101010680198669, -0.38662999868392944, -0.1055997908115387, 0.15158772468566895, 0.4124176502227783, 0.7205674052238464, 1.0900816917419434, 1.6987545490264893 ], "y": [ 0.43467336893081665, 0.6025000214576721, 0.520100474357605, 0.5714285969734192, 0.5425000190734863, 0.5600000023841858, 0.5689222812652588, 0.4950000047683716, 0.4399999976158142, 0.24500000476837158 ] }, { "marker": { "color": "#EF553B", "symbol": "circle" }, "mode": "markers", "name": "Model", "type": "scatter", "x": [ -1.7393314838409424, -1.1220300197601318, -0.7101010680198669, -0.38662999868392944, -0.1055997908115387, 0.15158772468566895, 0.4124176502227783, 0.7205674052238464, 1.0900816917419434, 1.6987545490264893 ], "y": [ 0.45258110761642456, 0.5314821004867554, 0.5615182518959045, 0.5726723670959473, 0.5717798471450806, 0.5606412291526794, 0.5368629693984985, 0.4932020604610443, 0.41431716084480286, 0.24666082859039307 ] }, { "line": { "color": "#00CC96" }, "mode": "lines", "name": "Option 3", "type": "scatter", "x": [ -3, -2.9698493480682373, -2.9396984577178955, -2.909547805786133, -2.879396915435791, -2.8492462635040283, -2.8190953731536865, -2.788944721221924, -2.758794069290161, -2.7286431789398193, -2.6984925270080566, -2.668341636657715, -2.638190984725952, -2.6080400943756104, -2.5778894424438477, -2.547738552093506, -2.517587900161743, -2.4874372482299805, -2.4572863578796387, -2.427135705947876, -2.3969850540161133, -2.3668341636657715, -2.3366832733154297, -2.306532621383667, -2.2763819694519043, -2.2462310791015625, -2.2160804271698, -2.185929775238037, -2.1557788848876953, -2.1256279945373535, -2.095477342605591, -2.065326690673828, -2.0351758003234863, -2.0050251483917236, -1.9748743772506714, -1.9447236061096191, -1.914572834968567, -1.8844220638275146, -1.8542712926864624, -1.8241205215454102, -1.7939698696136475, -1.7638190984725952, -1.733668327331543, -1.7035175561904907, -1.6733667850494385, -1.6432160139083862, -1.613065242767334, -1.5829145908355713, -1.552763819694519, -1.5226130485534668, -1.4924622774124146, -1.4623115062713623, -1.43216073513031, -1.4020099639892578, -1.3718593120574951, -1.3417085409164429, -1.3115577697753906, -1.2814069986343384, -1.2512562274932861, -1.2211054563522339, -1.1909546852111816, -1.160804033279419, -1.1306532621383667, -1.1005024909973145, -1.0703517198562622, -1.04020094871521, -1.0100501775741577, -0.9798994064331055, -0.9497487545013428, -0.919597864151001, -0.8894472122192383, -0.8592963218688965, -0.8291456699371338, -0.7989950180053711, -0.7688441276550293, -0.7386934757232666, -0.7085425853729248, -0.6783919334411621, -0.6482410430908203, -0.6180903911590576, -0.5879397392272949, -0.5577888488769531, -0.5276381969451904, -0.49748730659484863, -0.46733665466308594, -0.43718576431274414, -0.40703511238098145, -0.37688446044921875, -0.34673357009887695, -0.31658291816711426, -0.28643202781677246, -0.25628137588500977, -0.22613048553466797, -0.19597983360290527, -0.16582918167114258, -0.13567829132080078, -0.10552763938903809, -0.07537674903869629, -0.045226097106933594, -0.015075206756591797, 0.015075206756591797, 0.045226097106933594, 0.07537674903869629, 0.10552763938903809, 0.13567829132080078, 0.16582918167114258, 0.19597983360290527, 0.22613048553466797, 0.25628137588500977, 0.28643202781677246, 0.31658291816711426, 0.34673357009887695, 0.37688446044921875, 0.40703511238098145, 0.43718576431274414, 0.46733665466308594, 0.49748730659484863, 0.5276381969451904, 0.5577888488769531, 0.5879397392272949, 0.6180903911590576, 0.6482410430908203, 0.6783919334411621, 0.7085425853729248, 0.7386934757232666, 0.7688441276550293, 0.7989950180053711, 0.8291456699371338, 0.8592963218688965, 0.8894472122192383, 0.919597864151001, 0.9497487545013428, 0.9798994064331055, 1.0100501775741577, 1.04020094871521, 1.0703517198562622, 1.1005024909973145, 1.1306532621383667, 1.160804033279419, 1.1909546852111816, 1.2211054563522339, 1.2512562274932861, 1.2814069986343384, 1.3115577697753906, 1.3417085409164429, 1.3718593120574951, 1.4020099639892578, 1.43216073513031, 1.4623115062713623, 1.4924622774124146, 1.5226130485534668, 1.552763819694519, 1.5829145908355713, 1.613065242767334, 1.6432160139083862, 1.6733667850494385, 1.7035175561904907, 1.733668327331543, 1.7638190984725952, 1.7939698696136475, 1.8241205215454102, 1.8542712926864624, 1.8844220638275146, 1.914572834968567, 1.9447236061096191, 1.9748743772506714, 2.0050251483917236, 2.0351758003234863, 2.065326690673828, 2.095477342605591, 2.1256279945373535, 2.1557788848876953, 2.185929775238037, 2.2160804271698, 2.2462310791015625, 2.2763819694519043, 2.306532621383667, 2.3366832733154297, 2.3668341636657715, 2.3969850540161133, 2.427135705947876, 2.4572863578796387, 2.4874372482299805, 2.517587900161743, 2.547738552093506, 2.5778894424438477, 2.6080400943756104, 2.638190984725952, 2.668341636657715, 2.6984925270080566, 2.7286431789398193, 2.758794069290161, 2.788944721221924, 2.8190953731536865, 2.8492462635040283, 2.879396915435791, 2.909547805786133, 2.9396984577178955, 2.9698493480682373, 3 ], "y": [ 0.2314170002937317, 0.23090426623821259, 0.23033004999160767, 0.2296949177980423, 0.22899948060512543, 0.2282443791627884, 0.22743046283721924, 0.22655849158763885, 0.22562935948371887, 0.2246440201997757, 0.2236034870147705, 0.22250883281230927, 0.2213611900806427, 0.22016172111034393, 0.21891160309314728, 0.2176121473312378, 0.21626466512680054, 0.21487046778202057, 0.21343091130256653, 0.2119475156068802, 0.2104216068983078, 0.20885466039180756, 0.20724819600582123, 0.20560376346111298, 0.203922837972641, 0.20220695436000824, 0.20045766234397888, 0.19867654144763947, 0.19686511158943176, 0.19502492249011993, 0.1931576132774353, 0.19126461446285248, 0.18934759497642517, 0.18740800023078918, 0.18544736504554749, 0.18346720933914185, 0.18146903812885284, 0.1794542521238327, 0.17742440104484558, 0.17538079619407654, 0.17332495748996735, 0.17125815153121948, 0.16918177902698517, 0.16709718108177185, 0.16500557959079742, 0.16290827095508575, 0.16080649197101593, 0.15870141983032227, 0.1565941870212555, 0.15448591113090515, 0.15237769484519958, 0.15027059614658356, 0.14816562831401825, 0.14606374502182007, 0.1439659297466278, 0.1418730616569519, 0.13978594541549683, 0.13770553469657898, 0.1356325000524521, 0.1335677057504654, 0.1315118372440338, 0.12946556508541107, 0.1274295598268509, 0.12540443241596222, 0.12339076399803162, 0.12138912081718445, 0.1194000095129013, 0.11742394417524338, 0.11546135693788528, 0.11351268738508224, 0.1115783229470253, 0.1096586138010025, 0.1077539324760437, 0.10586460679769516, 0.10399089008569717, 0.10213305056095123, 0.10029133409261703, 0.0984659418463707, 0.09665708988904953, 0.09486493468284607, 0.09308964014053345, 0.09133131057024002, 0.08959008008241653, 0.08786603063344955, 0.08615924417972565, 0.08446978032588959, 0.08279771357774734, 0.08114305883646011, 0.0795058086514473, 0.07788603752851486, 0.07628367841243744, 0.07469877600669861, 0.0731312707066536, 0.071581169962883, 0.07004842162132263, 0.06853298097848892, 0.06703484058380127, 0.0655539259314537, 0.06409019231796265, 0.06264356523752213, 0.061214055866003036, 0.059801533818244934, 0.05840601027011871, 0.057027384638786316, 0.05566566064953804, 0.05432074889540672, 0.05299263447523117, 0.051681287586688995, 0.05038664862513542, 0.049108728766441345, 0.04784747585654259, 0.046602919697761536, 0.04537501931190491, 0.044163793325424194, 0.042969267815351486, 0.04179143160581589, 0.04063034802675247, 0.03948603570461273, 0.03835856169462204, 0.03724795579910278, 0.036154307425022125, 0.03507767617702484, 0.0340181365609169, 0.032975781708955765, 0.031950708478689194, 0.030943017452955246, 0.029952798038721085, 0.028980165719985962, 0.02802523598074913, 0.027088114991784096, 0.026168910786509514, 0.025267744436860085, 0.02438473328948021, 0.023519964888691902, 0.022673550993204117, 0.021845592185854912, 0.0210361760109663, 0.020245375111699104, 0.019473258405923843, 0.01871989108622074, 0.017985301092267036, 0.01726953126490116, 0.016572589054703712, 0.01589447446167469, 0.015235153026878834, 0.014594603329896927, 0.013972758315503597, 0.013369530439376831, 0.012784824706614017, 0.012218514457345009, 0.011670464649796486, 0.01114050392061472, 0.010628454387187958, 0.010134104639291763, 0.009657230228185654, 0.009197589010000229, 0.00875491090118885, 0.008328920230269432, 0.00791930966079235, 0.007525772787630558, 0.007147977594286203, 0.0067855739034712315, 0.006438212934881449, 0.006105524953454733, 0.005787134636193514, 0.005482654087245464, 0.005191697273403406, 0.004913864191621542, 0.004648749716579914, 0.004395962227135897, 0.004155084490776062, 0.003925713710486889, 0.003707449184730649, 0.0034998906776309013, 0.003302633296698332, 0.003115283092483878, 0.002937458688393235, 0.0027687642723321915, 0.002608831273391843, 0.0024572855327278376, 0.0023137673269957304, 0.0021779267117381096, 0.002049415372312069, 0.001927901292219758, 0.0018130553653463721, 0.0017045659478753805, 0.0016021281480789185, 0.0015054435934871435, 0.001414232887327671, 0.0013282181462273002, 0.0012471354566514492, 0.0011707348749041557, 0.0010987689020112157, 0.001031006802804768, 0.0009672246524132788, 0.0009072078391909599, 0.0008507532184012234, 0.000797665270511061, 0.0007477562758140266, 0.0007008527754805982 ] }, { "marker": { "color": "#00CC96", "symbol": "circle-open" }, "mode": "markers", "name": "Data", "type": "scatter", "x": [ -1.7393314838409424, -1.1220300197601318, -0.7101010680198669, -0.38662999868392944, -0.1055997908115387, 0.15158772468566895, 0.4124176502227783, 0.7205674052238464, 1.0900816917419434, 1.6987545490264893 ], "y": [ 0.15075376629829407, 0.125, 0.11809045076370239, 0.08020050078630447, 0.08250000327825546, 0.08250000327825546, 0.04010025039315224, 0.019999999552965164, 0.014999999664723873, 0.004999999888241291 ] }, { "marker": { "color": "#00CC96", "symbol": "circle" }, "mode": "markers", "name": "Model", "type": "scatter", "x": [ -1.7393314838409424, -1.1220300197601318, -0.7101010680198669, -0.38662999868392944, -0.1055997908115387, 0.15158772468566895, 0.4124176502227783, 0.7205674052238464, 1.0900816917419434, 1.6987545490264893 ], "y": [ 0.1728203147649765, 0.1276349574327469, 0.10066775232553482, 0.0818224847316742, 0.06718244403600693, 0.05504349246621132, 0.04379311576485634, 0.03258340060710907, 0.02114017680287361, 0.008522860705852509 ] }, { "line": { "color": "#AB63FA" }, "mode": "lines", "name": "Option 4", "type": "scatter", "x": [ -3, -2.9698493480682373, -2.9396984577178955, -2.909547805786133, -2.879396915435791, -2.8492462635040283, -2.8190953731536865, -2.788944721221924, -2.758794069290161, -2.7286431789398193, -2.6984925270080566, -2.668341636657715, -2.638190984725952, -2.6080400943756104, -2.5778894424438477, -2.547738552093506, -2.517587900161743, -2.4874372482299805, -2.4572863578796387, -2.427135705947876, -2.3969850540161133, -2.3668341636657715, -2.3366832733154297, -2.306532621383667, -2.2763819694519043, -2.2462310791015625, -2.2160804271698, -2.185929775238037, -2.1557788848876953, -2.1256279945373535, -2.095477342605591, -2.065326690673828, -2.0351758003234863, -2.0050251483917236, -1.9748743772506714, -1.9447236061096191, -1.914572834968567, -1.8844220638275146, -1.8542712926864624, -1.8241205215454102, -1.7939698696136475, -1.7638190984725952, -1.733668327331543, -1.7035175561904907, -1.6733667850494385, -1.6432160139083862, -1.613065242767334, -1.5829145908355713, -1.552763819694519, -1.5226130485534668, -1.4924622774124146, -1.4623115062713623, -1.43216073513031, -1.4020099639892578, -1.3718593120574951, -1.3417085409164429, -1.3115577697753906, -1.2814069986343384, -1.2512562274932861, -1.2211054563522339, -1.1909546852111816, -1.160804033279419, -1.1306532621383667, -1.1005024909973145, -1.0703517198562622, -1.04020094871521, -1.0100501775741577, -0.9798994064331055, -0.9497487545013428, -0.919597864151001, -0.8894472122192383, -0.8592963218688965, -0.8291456699371338, -0.7989950180053711, -0.7688441276550293, -0.7386934757232666, -0.7085425853729248, -0.6783919334411621, -0.6482410430908203, -0.6180903911590576, -0.5879397392272949, -0.5577888488769531, -0.5276381969451904, -0.49748730659484863, -0.46733665466308594, -0.43718576431274414, -0.40703511238098145, -0.37688446044921875, -0.34673357009887695, -0.31658291816711426, -0.28643202781677246, -0.25628137588500977, -0.22613048553466797, -0.19597983360290527, -0.16582918167114258, -0.13567829132080078, -0.10552763938903809, -0.07537674903869629, -0.045226097106933594, -0.015075206756591797, 0.015075206756591797, 0.045226097106933594, 0.07537674903869629, 0.10552763938903809, 0.13567829132080078, 0.16582918167114258, 0.19597983360290527, 0.22613048553466797, 0.25628137588500977, 0.28643202781677246, 0.31658291816711426, 0.34673357009887695, 0.37688446044921875, 0.40703511238098145, 0.43718576431274414, 0.46733665466308594, 0.49748730659484863, 0.5276381969451904, 0.5577888488769531, 0.5879397392272949, 0.6180903911590576, 0.6482410430908203, 0.6783919334411621, 0.7085425853729248, 0.7386934757232666, 0.7688441276550293, 0.7989950180053711, 0.8291456699371338, 0.8592963218688965, 0.8894472122192383, 0.919597864151001, 0.9497487545013428, 0.9798994064331055, 1.0100501775741577, 1.04020094871521, 1.0703517198562622, 1.1005024909973145, 1.1306532621383667, 1.160804033279419, 1.1909546852111816, 1.2211054563522339, 1.2512562274932861, 1.2814069986343384, 1.3115577697753906, 1.3417085409164429, 1.3718593120574951, 1.4020099639892578, 1.43216073513031, 1.4623115062713623, 1.4924622774124146, 1.5226130485534668, 1.552763819694519, 1.5829145908355713, 1.613065242767334, 1.6432160139083862, 1.6733667850494385, 1.7035175561904907, 1.733668327331543, 1.7638190984725952, 1.7939698696136475, 1.8241205215454102, 1.8542712926864624, 1.8844220638275146, 1.914572834968567, 1.9447236061096191, 1.9748743772506714, 2.0050251483917236, 2.0351758003234863, 2.065326690673828, 2.095477342605591, 2.1256279945373535, 2.1557788848876953, 2.185929775238037, 2.2160804271698, 2.2462310791015625, 2.2763819694519043, 2.306532621383667, 2.3366832733154297, 2.3668341636657715, 2.3969850540161133, 2.427135705947876, 2.4572863578796387, 2.4874372482299805, 2.517587900161743, 2.547738552093506, 2.5778894424438477, 2.6080400943756104, 2.638190984725952, 2.668341636657715, 2.6984925270080566, 2.7286431789398193, 2.758794069290161, 2.788944721221924, 2.8190953731536865, 2.8492462635040283, 2.879396915435791, 2.909547805786133, 2.9396984577178955, 2.9698493480682373, 3 ], "y": [ 0.21342560648918152, 0.20892053842544556, 0.20445497334003448, 0.20003058016300201, 0.19564886391162872, 0.19131143391132355, 0.18701967597007751, 0.18277505040168762, 0.17857889831066132, 0.1744324266910553, 0.17033696174621582, 0.16629353165626526, 0.1623033583164215, 0.15836738049983978, 0.1544865369796753, 0.15066170692443848, 0.1468937247991562, 0.14318327605724335, 0.13953103125095367, 0.1359376162290573, 0.13240355253219604, 0.12892919778823853, 0.12551504373550415, 0.12216140329837799, 0.11886849254369736, 0.11563647538423538, 0.11246549338102341, 0.10935564339160919, 0.10630683600902557, 0.10331906378269196, 0.10039221495389938, 0.09752608835697174, 0.09472044557332993, 0.09197505563497543, 0.08928953111171722, 0.08666348457336426, 0.08409653604030609, 0.08158817887306213, 0.07913793623447418, 0.07674521952867508, 0.07440948486328125, 0.07213007658720016, 0.06990634649991989, 0.0677376314997673, 0.0656232088804245, 0.06356232613325119, 0.061554260551929474, 0.059598229825496674, 0.05769339203834534, 0.055838946253061295, 0.05403406172990799, 0.052277904003858566, 0.05056959018111229, 0.04890826717019081, 0.04729307070374489, 0.0457230843603611, 0.0441974438726902, 0.04271523654460907, 0.04127557575702667, 0.039877571165561676, 0.03852032870054245, 0.037202946841716766, 0.035924531519412994, 0.034684207290410995, 0.03348107635974884, 0.032314274460077286, 0.031182928010821342, 0.030086182057857513, 0.0290231816470623, 0.027993079274892807, 0.026995040476322174, 0.026028241962194443, 0.025091873481869698, 0.024185143411159515, 0.023307248950004578, 0.0224574226886034, 0.0216349009424448, 0.020838933065533638, 0.020068779587745667, 0.01932373084127903, 0.018603064119815826, 0.017906086519360542, 0.017232125625014305, 0.016580503433942795, 0.015950586646795273, 0.015341714024543762, 0.014753291383385658, 0.014184688217937946, 0.013635315001010895, 0.013104600831866264, 0.012591970153152943, 0.012096882797777653, 0.011618792079389095, 0.011157184839248657, 0.010711546055972576, 0.010281376540660858, 0.009866204112768173, 0.009465553797781467, 0.009078973904252052, 0.008706019259989262, 0.008346266113221645, 0.007999288849532604, 0.0076646870002150536, 0.007342066150158644, 0.0070310477167367935, 0.006731260567903519, 0.006442346144467592, 0.006163958925753832, 0.0058957599103450775, 0.005637425929307938, 0.005388639401644468, 0.00514909578487277, 0.0049184998497366905, 0.0046965619549155235, 0.004483009688556194, 0.004277565982192755, 0.004079980775713921, 0.003889993065968156, 0.00370736769400537, 0.0035318604204803705, 0.0033632502891123295, 0.0032013109885156155, 0.0030458285473287106, 0.00289659621194005, 0.0027534121181815863, 0.0026160809211432934, 0.00248441263101995, 0.0023582247085869312, 0.0022373374085873365, 0.0021215782035142183, 0.0020107757300138474, 0.0019047694513574243, 0.0018033994128927588, 0.001706508919596672, 0.0016139467479661107, 0.0015255677280947566, 0.0014412262244150043, 0.0013607839355245233, 0.0012841023271903396, 0.001211051014252007, 0.0011414969339966774, 0.0010753143578767776, 0.0010123786050826311, 0.000952569826040417, 0.0008957678801380098, 0.0008418579236604273, 0.0007907272665761411, 0.0007422641501761973, 0.0006963621126487851, 0.0006529146921820939, 0.0006118204328231514, 0.0005729789845645428, 0.0005362928495742381, 0.0005016665090806782, 0.00046900802408345044, 0.0004382272018119693, 0.00040923719643615186, 0.0003819529083557427, 0.0003562922647688538, 0.0003321758413221687, 0.00030952677479945123, 0.0002882700937334448, 0.00026833429001271725, 0.00024965000920929015, 0.0002321507636224851, 0.00021577200095634907, 0.00020045261771883816, 0.00018613299471326172, 0.00017275648133363575, 0.00016026923549361527, 0.0001486187829868868, 0.0001377559674438089, 0.00012763356789946556, 0.0001182067280751653, 0.00010943235974991694, 0.00010127002315130085, 0.0000936813376029022, 0.00008662939944770187, 0.00008007979340618476, 0.0000739997994969599, 0.00006835851672803983, 0.00006312684854492545, 0.00005827718632644974, 0.0000537837840965949, 0.0000496221509820316, 0.00004576949868351221, 0.00004220439586788416, 0.00003890653533744626, 0.000035857254260918126, 0.00003303873018012382, 0.00003043446304218378, 0.000028029040549881756, 0.00002580798536655493, 0.000023757849703542888, 0.000021866084352950566, 0.000020120931367273442, 0.000018511556845624, 0.000017027767171384767, 0.00001566012178955134, 0.000014399914107343648 ] }, { "marker": { "color": "#AB63FA", "symbol": "circle-open" }, "mode": "markers", "name": "Data", "type": "scatter", "x": [ -1.7393314838409424, -1.1220300197601318, -0.7101010680198669, -0.38662999868392944, -0.1055997908115387, 0.15158772468566895, 0.4124176502227783, 0.7205674052238464, 1.0900816917419434, 1.6987545490264893 ], "y": [ 0.07537688314914703, 0.03750000149011612, 0.02010050229728222, 0.01002506259828806, 0.012500000186264515, 0.004999999888241291, 0.002506265649572015, 0, 0, 0 ] }, { "marker": { "color": "#AB63FA", "symbol": "circle" }, "mode": "markers", "name": "Model", "type": "scatter", "x": [ -1.7393314838409424, -1.1220300197601318, -0.7101010680198669, -0.38662999868392944, -0.1055997908115387, 0.15158772468566895, 0.4124176502227783, 0.7205674052238464, 1.0900816917419434, 1.6987545490264893 ], "y": [ 0.07801676541566849, 0.036385394632816315, 0.02192237414419651, 0.014466874301433563, 0.009937874041497707, 0.006914576515555382, 0.0046502067707479, 0.0028573251329362392, 0.0014709901297464967, 0.0004244304436724633 ] } ], "layout": { "legend": { "title": { "text": "Item response" } }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "white", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "white", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "#C8D4E3", "linecolor": "#C8D4E3", "minorgridcolor": "#C8D4E3", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "#C8D4E3", "linecolor": "#C8D4E3", "minorgridcolor": "#C8D4E3", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "sequentialminus": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "white", "showlakes": true, "showland": true, "subunitcolor": "#C8D4E3" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "white", "polar": { "angularaxis": { "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "" }, "bgcolor": "white", "radialaxis": { "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "white", "gridcolor": "#DFE8F3", "gridwidth": 2, "linecolor": "#EBF0F8", "showbackground": true, "ticks": "", "zerolinecolor": "#EBF0F8" }, "yaxis": { "backgroundcolor": "white", "gridcolor": "#DFE8F3", "gridwidth": 2, "linecolor": "#EBF0F8", "showbackground": true, "ticks": "", "zerolinecolor": "#EBF0F8" }, "zaxis": { "backgroundcolor": "white", "gridcolor": "#DFE8F3", "gridwidth": 2, "linecolor": "#EBF0F8", "showbackground": true, "ticks": "", "zerolinecolor": "#EBF0F8" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "#DFE8F3", "linecolor": "#A2B1C6", "ticks": "" }, "baxis": { "gridcolor": "#DFE8F3", "linecolor": "#A2B1C6", "ticks": "" }, "bgcolor": "white", "caxis": { "gridcolor": "#DFE8F3", "linecolor": "#A2B1C6", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "#EBF0F8", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "#EBF0F8", "zerolinewidth": 2 } } }, "title": { "text": "IRF - Item 34" }, "xaxis": { "title": { "text": "Latent variable" } }, "yaxis": { "title": { "text": "Probability" } } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "application/vnd.plotly.v1+json": { "config": { "plotlyServerURL": "https://plot.ly" }, "data": [ { "line": { "color": "#636EFA" }, "mode": "lines", "name": "Option 1", "type": "scatter", "x": [ -3, -2.9698493480682373, -2.9396984577178955, -2.909547805786133, -2.879396915435791, -2.8492462635040283, -2.8190953731536865, -2.788944721221924, -2.758794069290161, -2.7286431789398193, -2.6984925270080566, -2.668341636657715, -2.638190984725952, -2.6080400943756104, -2.5778894424438477, -2.547738552093506, -2.517587900161743, -2.4874372482299805, -2.4572863578796387, -2.427135705947876, -2.3969850540161133, -2.3668341636657715, -2.3366832733154297, -2.306532621383667, -2.2763819694519043, -2.2462310791015625, -2.2160804271698, -2.185929775238037, -2.1557788848876953, -2.1256279945373535, -2.095477342605591, -2.065326690673828, -2.0351758003234863, -2.0050251483917236, -1.9748743772506714, -1.9447236061096191, -1.914572834968567, -1.8844220638275146, -1.8542712926864624, -1.8241205215454102, -1.7939698696136475, -1.7638190984725952, -1.733668327331543, -1.7035175561904907, -1.6733667850494385, -1.6432160139083862, -1.613065242767334, -1.5829145908355713, -1.552763819694519, -1.5226130485534668, -1.4924622774124146, -1.4623115062713623, -1.43216073513031, -1.4020099639892578, -1.3718593120574951, -1.3417085409164429, -1.3115577697753906, -1.2814069986343384, -1.2512562274932861, -1.2211054563522339, -1.1909546852111816, -1.160804033279419, -1.1306532621383667, -1.1005024909973145, -1.0703517198562622, -1.04020094871521, -1.0100501775741577, -0.9798994064331055, -0.9497487545013428, -0.919597864151001, -0.8894472122192383, -0.8592963218688965, -0.8291456699371338, -0.7989950180053711, -0.7688441276550293, -0.7386934757232666, -0.7085425853729248, -0.6783919334411621, -0.6482410430908203, -0.6180903911590576, -0.5879397392272949, -0.5577888488769531, -0.5276381969451904, -0.49748730659484863, -0.46733665466308594, -0.43718576431274414, -0.40703511238098145, -0.37688446044921875, -0.34673357009887695, -0.31658291816711426, -0.28643202781677246, -0.25628137588500977, -0.22613048553466797, -0.19597983360290527, -0.16582918167114258, -0.13567829132080078, -0.10552763938903809, -0.07537674903869629, -0.045226097106933594, -0.015075206756591797, 0.015075206756591797, 0.045226097106933594, 0.07537674903869629, 0.10552763938903809, 0.13567829132080078, 0.16582918167114258, 0.19597983360290527, 0.22613048553466797, 0.25628137588500977, 0.28643202781677246, 0.31658291816711426, 0.34673357009887695, 0.37688446044921875, 0.40703511238098145, 0.43718576431274414, 0.46733665466308594, 0.49748730659484863, 0.5276381969451904, 0.5577888488769531, 0.5879397392272949, 0.6180903911590576, 0.6482410430908203, 0.6783919334411621, 0.7085425853729248, 0.7386934757232666, 0.7688441276550293, 0.7989950180053711, 0.8291456699371338, 0.8592963218688965, 0.8894472122192383, 0.919597864151001, 0.9497487545013428, 0.9798994064331055, 1.0100501775741577, 1.04020094871521, 1.0703517198562622, 1.1005024909973145, 1.1306532621383667, 1.160804033279419, 1.1909546852111816, 1.2211054563522339, 1.2512562274932861, 1.2814069986343384, 1.3115577697753906, 1.3417085409164429, 1.3718593120574951, 1.4020099639892578, 1.43216073513031, 1.4623115062713623, 1.4924622774124146, 1.5226130485534668, 1.552763819694519, 1.5829145908355713, 1.613065242767334, 1.6432160139083862, 1.6733667850494385, 1.7035175561904907, 1.733668327331543, 1.7638190984725952, 1.7939698696136475, 1.8241205215454102, 1.8542712926864624, 1.8844220638275146, 1.914572834968567, 1.9447236061096191, 1.9748743772506714, 2.0050251483917236, 2.0351758003234863, 2.065326690673828, 2.095477342605591, 2.1256279945373535, 2.1557788848876953, 2.185929775238037, 2.2160804271698, 2.2462310791015625, 2.2763819694519043, 2.306532621383667, 2.3366832733154297, 2.3668341636657715, 2.3969850540161133, 2.427135705947876, 2.4572863578796387, 2.4874372482299805, 2.517587900161743, 2.547738552093506, 2.5778894424438477, 2.6080400943756104, 2.638190984725952, 2.668341636657715, 2.6984925270080566, 2.7286431789398193, 2.758794069290161, 2.788944721221924, 2.8190953731536865, 2.8492462635040283, 2.879396915435791, 2.909547805786133, 2.9396984577178955, 2.9698493480682373, 3 ], "y": [ 0.2909128665924072, 0.2909488379955292, 0.290986567735672, 0.2910260558128357, 0.2910674810409546, 0.2911108434200287, 0.2911562919616699, 0.29120391607284546, 0.29125380516052246, 0.29130610823631287, 0.29136088490486145, 0.29141828417778015, 0.29147839546203613, 0.2915413975715637, 0.29160740971565247, 0.2916765809059143, 0.2917490303516388, 0.29182496666908264, 0.291904479265213, 0.2919878363609314, 0.29207512736320496, 0.2921665906906128, 0.29226240515708923, 0.292362779378891, 0.29246795177459717, 0.2925781011581421, 0.29269352555274963, 0.2928144037723541, 0.29294106364250183, 0.29307371377944946, 0.2932126820087433, 0.2933582663536072, 0.2935107350349426, 0.2936704456806183, 0.2938377559185028, 0.29401296377182007, 0.2941964864730835, 0.29438871145248413, 0.294590026140213, 0.29480084776878357, 0.295021653175354, 0.29525288939476013, 0.29549503326416016, 0.29574862122535706, 0.2960141599178314, 0.29629218578338623, 0.2965833246707916, 0.296888142824173, 0.2972072660923004, 0.29754140973091125, 0.29789119958877563, 0.29825738072395325, 0.2986406683921814, 0.2990419268608093, 0.29946187138557434, 0.29990142583847046, 0.3003614544868469, 0.30084285140037537, 0.30134662985801697, 0.3018737733364105, 0.3024252951145172, 0.30300232768058777, 0.30360597372055054, 0.304237425327301, 0.3048979341983795, 0.3055887222290039, 0.30631113052368164, 0.30706655979156494, 0.30785641074180603, 0.3086821734905243, 0.3095453977584839, 0.31044769287109375, 0.3113906681537628, 0.31237608194351196, 0.31340569257736206, 0.31448131799697876, 0.31560489535331726, 0.31677836179733276, 0.31800374388694763, 0.319283127784729, 0.3206186592578888, 0.3220125734806061, 0.3234671950340271, 0.3249847888946533, 0.3265678286552429, 0.3282187879085541, 0.32994017004966736, 0.3317345976829529, 0.33360472321510315, 0.33555325865745544, 0.3375829756259918, 0.3396966755390167, 0.34189724922180176, 0.34418758749961853, 0.34657058119773865, 0.34904927015304565, 0.3516266345977783, 0.3543057143688202, 0.35708945989608765, 0.3599810004234314, 0.36298322677612305, 0.3660993278026581, 0.36933213472366333, 0.3726847171783447, 0.3761598467826843, 0.3797604441642761, 0.3834892213344574, 0.38734886050224304, 0.3913419544696808, 0.39547085762023926, 0.39973798394203186, 0.40414535999298096, 0.4086950421333313, 0.4133886992931366, 0.41822800040245056, 0.42321425676345825, 0.42834851145744324, 0.43363165855407715, 0.439064085483551, 0.4446461796760559, 0.4503777027130127, 0.45625829696655273, 0.46228718757629395, 0.46846306324005127, 0.4747845530509949, 0.48124951124191284, 0.4878556728363037, 0.49460017681121826, 0.5014798641204834, 0.508491039276123, 0.5156296491622925, 0.5228911638259888, 0.530270516872406, 0.537762463092804, 0.5453612804412842, 0.5530605316162109, 0.5608538389205933, 0.5687341690063477, 0.5766941905021667, 0.5847262740135193, 0.5928226113319397, 0.6009749174118042, 0.6091747283935547, 0.6174134612083435, 0.6256822943687439, 0.6339722871780396, 0.6422744989395142, 0.6505796909332275, 0.6588789224624634, 0.6671630144119263, 0.6754231452941895, 0.6836502552032471, 0.6918355226516724, 0.699970543384552, 0.7080469131469727, 0.7160565853118896, 0.7239915132522583, 0.7318444848060608, 0.7396079301834106, 0.7472753524780273, 0.7548401355743408, 0.762296199798584, 0.769637942314148, 0.7768601179122925, 0.783957839012146, 0.7909268736839294, 0.7977630496025085, 0.8044630289077759, 0.8110237121582031, 0.8174423575401306, 0.8237167596817017, 0.8298451900482178, 0.8358260989189148, 0.8416584134101868, 0.8473414778709412, 0.8528750538825989, 0.8582590222358704, 0.863493800163269, 0.8685799837112427, 0.8735184669494629, 0.8783103227615356, 0.8829571008682251, 0.8874605298042297, 0.891822099685669, 0.896044135093689, 0.9001287817955017, 0.9040782451629639, 0.9078952074050903, 0.9115821123123169, 0.9151417016983032, 0.9185768365859985, 0.9218902587890625, 0.9250848889350891, 0.9281636476516724, 0.9311297535896301, 0.9339859485626221, 0.9367353916168213, 0.9393811225891113, 0.9419262409210205, 0.9443735480308533 ] }, { "marker": { "color": "#636EFA", "symbol": "circle-open" }, "mode": "markers", "name": "Data", "type": "scatter", "x": [ -1.746874451637268, -1.0607484579086304, -0.6916394233703613, -0.3674386441707611, -0.08883918076753616, 0.16011905670166016, 0.4155515730381012, 0.7223190665245056, 1.0845043659210205, 1.712824821472168 ], "y": [ 0.3216080367565155, 0.25, 0.32663315534591675, 0.3308270573616028, 0.3824999928474426, 0.375, 0.3934836983680725, 0.4449999928474426, 0.5625, 0.75 ] }, { "marker": { "color": "#636EFA", "symbol": "circle" }, "mode": "markers", "name": "Model", "type": "scatter", "x": [ -1.746874451637268, -1.0607484579086304, -0.6916394233703613, -0.3674386441707611, -0.08883918076753616, 0.16011905670166016, 0.4155515730381012, 0.7223190665245056, 1.0845043659210205, 1.712824821472168 ], "y": [ 0.2953946590423584, 0.3050949275493622, 0.3165445029735565, 0.3322709798812866, 0.3529016077518463, 0.37947386503219604, 0.4158913493156433, 0.4719233810901642, 0.5605424046516418, 0.7464352250099182 ] }, { "line": { "color": "#EF553B" }, "mode": "lines", "name": "Option 2", "type": "scatter", "x": [ -3, -2.9698493480682373, -2.9396984577178955, -2.909547805786133, -2.879396915435791, -2.8492462635040283, -2.8190953731536865, -2.788944721221924, -2.758794069290161, -2.7286431789398193, -2.6984925270080566, -2.668341636657715, -2.638190984725952, -2.6080400943756104, -2.5778894424438477, -2.547738552093506, -2.517587900161743, -2.4874372482299805, -2.4572863578796387, -2.427135705947876, -2.3969850540161133, -2.3668341636657715, -2.3366832733154297, -2.306532621383667, -2.2763819694519043, -2.2462310791015625, -2.2160804271698, -2.185929775238037, -2.1557788848876953, -2.1256279945373535, -2.095477342605591, -2.065326690673828, -2.0351758003234863, -2.0050251483917236, -1.9748743772506714, -1.9447236061096191, -1.914572834968567, -1.8844220638275146, -1.8542712926864624, -1.8241205215454102, -1.7939698696136475, -1.7638190984725952, -1.733668327331543, -1.7035175561904907, -1.6733667850494385, -1.6432160139083862, -1.613065242767334, -1.5829145908355713, -1.552763819694519, -1.5226130485534668, -1.4924622774124146, -1.4623115062713623, -1.43216073513031, -1.4020099639892578, -1.3718593120574951, -1.3417085409164429, -1.3115577697753906, -1.2814069986343384, -1.2512562274932861, -1.2211054563522339, -1.1909546852111816, -1.160804033279419, -1.1306532621383667, -1.1005024909973145, -1.0703517198562622, -1.04020094871521, -1.0100501775741577, -0.9798994064331055, -0.9497487545013428, -0.919597864151001, -0.8894472122192383, -0.8592963218688965, -0.8291456699371338, -0.7989950180053711, -0.7688441276550293, -0.7386934757232666, -0.7085425853729248, -0.6783919334411621, -0.6482410430908203, -0.6180903911590576, -0.5879397392272949, -0.5577888488769531, -0.5276381969451904, -0.49748730659484863, -0.46733665466308594, -0.43718576431274414, -0.40703511238098145, -0.37688446044921875, -0.34673357009887695, -0.31658291816711426, -0.28643202781677246, -0.25628137588500977, -0.22613048553466797, -0.19597983360290527, -0.16582918167114258, -0.13567829132080078, -0.10552763938903809, -0.07537674903869629, -0.045226097106933594, -0.015075206756591797, 0.015075206756591797, 0.045226097106933594, 0.07537674903869629, 0.10552763938903809, 0.13567829132080078, 0.16582918167114258, 0.19597983360290527, 0.22613048553466797, 0.25628137588500977, 0.28643202781677246, 0.31658291816711426, 0.34673357009887695, 0.37688446044921875, 0.40703511238098145, 0.43718576431274414, 0.46733665466308594, 0.49748730659484863, 0.5276381969451904, 0.5577888488769531, 0.5879397392272949, 0.6180903911590576, 0.6482410430908203, 0.6783919334411621, 0.7085425853729248, 0.7386934757232666, 0.7688441276550293, 0.7989950180053711, 0.8291456699371338, 0.8592963218688965, 0.8894472122192383, 0.919597864151001, 0.9497487545013428, 0.9798994064331055, 1.0100501775741577, 1.04020094871521, 1.0703517198562622, 1.1005024909973145, 1.1306532621383667, 1.160804033279419, 1.1909546852111816, 1.2211054563522339, 1.2512562274932861, 1.2814069986343384, 1.3115577697753906, 1.3417085409164429, 1.3718593120574951, 1.4020099639892578, 1.43216073513031, 1.4623115062713623, 1.4924622774124146, 1.5226130485534668, 1.552763819694519, 1.5829145908355713, 1.613065242767334, 1.6432160139083862, 1.6733667850494385, 1.7035175561904907, 1.733668327331543, 1.7638190984725952, 1.7939698696136475, 1.8241205215454102, 1.8542712926864624, 1.8844220638275146, 1.914572834968567, 1.9447236061096191, 1.9748743772506714, 2.0050251483917236, 2.0351758003234863, 2.065326690673828, 2.095477342605591, 2.1256279945373535, 2.1557788848876953, 2.185929775238037, 2.2160804271698, 2.2462310791015625, 2.2763819694519043, 2.306532621383667, 2.3366832733154297, 2.3668341636657715, 2.3969850540161133, 2.427135705947876, 2.4572863578796387, 2.4874372482299805, 2.517587900161743, 2.547738552093506, 2.5778894424438477, 2.6080400943756104, 2.638190984725952, 2.668341636657715, 2.6984925270080566, 2.7286431789398193, 2.758794069290161, 2.788944721221924, 2.8190953731536865, 2.8492462635040283, 2.879396915435791, 2.909547805786133, 2.9396984577178955, 2.9698493480682373, 3 ], "y": [ 0.3159308433532715, 0.3241368532180786, 0.33232420682907104, 0.3404700458049774, 0.3485521972179413, 0.3565478026866913, 0.36443468928337097, 0.3721912205219269, 0.37979656457901, 0.38723087310791016, 0.3944757580757141, 0.4015139639377594, 0.40833014249801636, 0.41491061449050903, 0.4212433397769928, 0.4273184835910797, 0.4331280589103699, 0.43866580724716187, 0.4439278244972229, 0.4489116072654724, 0.4536166489124298, 0.4580442011356354, 0.4621969163417816, 0.4660789668560028, 0.46969571709632874, 0.473053902387619, 0.47616103291511536, 0.47902578115463257, 0.481657475233078, 0.4840664267539978, 0.4862632155418396, 0.4882594048976898, 0.4900670349597931, 0.49169889092445374, 0.4931684136390686, 0.4944899082183838, 0.4956788420677185, 0.49675169587135315, 0.49772658944129944, 0.49862346053123474, 0.49946436285972595, 0.5002737641334534, 0.5010791420936584, 0.5019112825393677, 0.5028001666069031, 0.5037547945976257, 0.50477534532547, 0.5058618783950806, 0.5070142149925232, 0.5082315802574158, 0.5095131993293762, 0.5108577013015747, 0.5122630596160889, 0.5137271285057068, 0.515247106552124, 0.516819953918457, 0.5184417366981506, 0.5201083421707153, 0.5218149423599243, 0.5235561728477478, 0.5253264904022217, 0.5271191596984863, 0.528927743434906, 0.5307445526123047, 0.5325619578361511, 0.5343716740608215, 0.5361651182174683, 0.5379330515861511, 0.5396661758422852, 0.5413548350334167, 0.5429891347885132, 0.5445590019226074, 0.5460540652275085, 0.5474637746810913, 0.5487779974937439, 0.5499861240386963, 0.5510777831077576, 0.5520433783531189, 0.5528818368911743, 0.5535972714424133, 0.5541946887969971, 0.5546795725822449, 0.5550583004951477, 0.5553378462791443, 0.5555258393287659, 0.5556303262710571, 0.5556597113609314, 0.555622935295105, 0.5555288195610046, 0.5553861260414124, 0.5552039742469788, 0.5549905896186829, 0.554753839969635, 0.5545009970664978, 0.5542383790016174, 0.5539710521697998, 0.5537027716636658, 0.5534359216690063, 0.5531710982322693, 0.5529070496559143, 0.5526401996612549, 0.5523560047149658, 0.5520302653312683, 0.551638662815094, 0.5511577725410461, 0.5505650043487549, 0.5498389005661011, 0.5489598512649536, 0.5479097366333008, 0.5466717481613159, 0.5452315807342529, 0.5435762405395508, 0.5416950583457947, 0.5395790338516235, 0.53722083568573, 0.5346150398254395, 0.5317574739456177, 0.5286461114883423, 0.5252797603607178, 0.5216587781906128, 0.517784595489502, 0.5136597156524658, 0.5092875361442566, 0.5046725869178772, 0.499820351600647, 0.4947381615638733, 0.4894333779811859, 0.483913779258728, 0.4781871438026428, 0.472261518239975, 0.4661450982093811, 0.45984628796577454, 0.4533737897872925, 0.44673633575439453, 0.43994295597076416, 0.43300315737724304, 0.4259260892868042, 0.418721467256546, 0.411399245262146, 0.4039693772792816, 0.39644181728363037, 0.3888269364833832, 0.3811351954936981, 0.37337690591812134, 0.3655625283718109, 0.35770273208618164, 0.34980785846710205, 0.341888427734375, 0.33395475149154663, 0.3260171711444855, 0.318085640668869, 0.3101702332496643, 0.3022807836532593, 0.2944265902042389, 0.2866169214248657, 0.27886059880256653, 0.2711663842201233, 0.2635423541069031, 0.2559970021247864, 0.24853788316249847, 0.24117223918437958, 0.2339068502187729, 0.2267477959394455, 0.21970079839229584, 0.21277110278606415, 0.20596329867839813, 0.19928181171417236, 0.19273020327091217, 0.18631181120872498, 0.1800295114517212, 0.17388573288917542, 0.16788233816623688, 0.16202105581760406, 0.15630309283733368, 0.1507292240858078, 0.14529989659786224, 0.14001528918743134, 0.13487519323825836, 0.12987911701202393, 0.1250263750553131, 0.12031596899032593, 0.11574654281139374, 0.1113164946436882, 0.10702449828386307, 0.10286837816238403, 0.09884613752365112, 0.09495570510625839, 0.09119456261396408, 0.08756039291620255, 0.08405062556266785, 0.08066250383853912, 0.07739343494176865, 0.07424061745405197, 0.07120129466056824, 0.06827232986688614, 0.06545111536979675, 0.06273461878299713, 0.060119904577732086, 0.057603973895311356, 0.055184122174978256 ] }, { "marker": { "color": "#EF553B", "symbol": "circle-open" }, "mode": "markers", "name": "Data", "type": "scatter", "x": [ -1.746874451637268, -1.0607484579086304, -0.6916394233703613, -0.3674386441707611, -0.08883918076753616, 0.16011905670166016, 0.4155515730381012, 0.7223190665245056, 1.0845043659210205, 1.712824821472168 ], "y": [ 0.4673366844654083, 0.5774999856948853, 0.5326633453369141, 0.5563910007476807, 0.5375000238418579, 0.5475000143051147, 0.5588972568511963, 0.5299999713897705, 0.42750000953674316, 0.24500000476837158 ] }, { "marker": { "color": "#EF553B", "symbol": "circle" }, "mode": "markers", "name": "Model", "type": "scatter", "x": [ -1.746874451637268, -1.0607484579086304, -0.6916394233703613, -0.3674386441707611, -0.08883918076753616, 0.16011905670166016, 0.4155515730381012, 0.7223190665245056, 1.0845043659210205, 1.712824821472168 ], "y": [ 0.48953139781951904, 0.5322911143302917, 0.5508179664611816, 0.5554186701774597, 0.5536087155342102, 0.5503081679344177, 0.5377760529518127, 0.5014486908912659, 0.4257620573043823, 0.24891063570976257 ] }, { "line": { "color": "#00CC96" }, "mode": "lines", "name": "Option 3", "type": "scatter", "x": [ -3, -2.9698493480682373, -2.9396984577178955, -2.909547805786133, -2.879396915435791, -2.8492462635040283, -2.8190953731536865, -2.788944721221924, -2.758794069290161, -2.7286431789398193, -2.6984925270080566, -2.668341636657715, -2.638190984725952, -2.6080400943756104, -2.5778894424438477, -2.547738552093506, -2.517587900161743, -2.4874372482299805, -2.4572863578796387, -2.427135705947876, -2.3969850540161133, -2.3668341636657715, -2.3366832733154297, -2.306532621383667, -2.2763819694519043, -2.2462310791015625, -2.2160804271698, -2.185929775238037, -2.1557788848876953, -2.1256279945373535, -2.095477342605591, -2.065326690673828, -2.0351758003234863, -2.0050251483917236, -1.9748743772506714, -1.9447236061096191, -1.914572834968567, -1.8844220638275146, -1.8542712926864624, -1.8241205215454102, -1.7939698696136475, -1.7638190984725952, -1.733668327331543, -1.7035175561904907, -1.6733667850494385, -1.6432160139083862, -1.613065242767334, -1.5829145908355713, -1.552763819694519, -1.5226130485534668, -1.4924622774124146, -1.4623115062713623, -1.43216073513031, -1.4020099639892578, -1.3718593120574951, -1.3417085409164429, -1.3115577697753906, -1.2814069986343384, -1.2512562274932861, -1.2211054563522339, -1.1909546852111816, -1.160804033279419, -1.1306532621383667, -1.1005024909973145, -1.0703517198562622, -1.04020094871521, -1.0100501775741577, -0.9798994064331055, -0.9497487545013428, -0.919597864151001, -0.8894472122192383, -0.8592963218688965, -0.8291456699371338, -0.7989950180053711, -0.7688441276550293, -0.7386934757232666, -0.7085425853729248, -0.6783919334411621, -0.6482410430908203, -0.6180903911590576, -0.5879397392272949, -0.5577888488769531, -0.5276381969451904, -0.49748730659484863, -0.46733665466308594, -0.43718576431274414, -0.40703511238098145, -0.37688446044921875, -0.34673357009887695, -0.31658291816711426, -0.28643202781677246, -0.25628137588500977, -0.22613048553466797, -0.19597983360290527, -0.16582918167114258, -0.13567829132080078, -0.10552763938903809, -0.07537674903869629, -0.045226097106933594, -0.015075206756591797, 0.015075206756591797, 0.045226097106933594, 0.07537674903869629, 0.10552763938903809, 0.13567829132080078, 0.16582918167114258, 0.19597983360290527, 0.22613048553466797, 0.25628137588500977, 0.28643202781677246, 0.31658291816711426, 0.34673357009887695, 0.37688446044921875, 0.40703511238098145, 0.43718576431274414, 0.46733665466308594, 0.49748730659484863, 0.5276381969451904, 0.5577888488769531, 0.5879397392272949, 0.6180903911590576, 0.6482410430908203, 0.6783919334411621, 0.7085425853729248, 0.7386934757232666, 0.7688441276550293, 0.7989950180053711, 0.8291456699371338, 0.8592963218688965, 0.8894472122192383, 0.919597864151001, 0.9497487545013428, 0.9798994064331055, 1.0100501775741577, 1.04020094871521, 1.0703517198562622, 1.1005024909973145, 1.1306532621383667, 1.160804033279419, 1.1909546852111816, 1.2211054563522339, 1.2512562274932861, 1.2814069986343384, 1.3115577697753906, 1.3417085409164429, 1.3718593120574951, 1.4020099639892578, 1.43216073513031, 1.4623115062713623, 1.4924622774124146, 1.5226130485534668, 1.552763819694519, 1.5829145908355713, 1.613065242767334, 1.6432160139083862, 1.6733667850494385, 1.7035175561904907, 1.733668327331543, 1.7638190984725952, 1.7939698696136475, 1.8241205215454102, 1.8542712926864624, 1.8844220638275146, 1.914572834968567, 1.9447236061096191, 1.9748743772506714, 2.0050251483917236, 2.0351758003234863, 2.065326690673828, 2.095477342605591, 2.1256279945373535, 2.1557788848876953, 2.185929775238037, 2.2160804271698, 2.2462310791015625, 2.2763819694519043, 2.306532621383667, 2.3366832733154297, 2.3668341636657715, 2.3969850540161133, 2.427135705947876, 2.4572863578796387, 2.4874372482299805, 2.517587900161743, 2.547738552093506, 2.5778894424438477, 2.6080400943756104, 2.638190984725952, 2.668341636657715, 2.6984925270080566, 2.7286431789398193, 2.758794069290161, 2.788944721221924, 2.8190953731536865, 2.8492462635040283, 2.879396915435791, 2.909547805786133, 2.9396984577178955, 2.9698493480682373, 3 ], "y": [ 0.36440712213516235, 0.35490694642066956, 0.3453899919986725, 0.33588093519210815, 0.32640454173088074, 0.31698596477508545, 0.3076503872871399, 0.29842257499694824, 0.28932684659957886, 0.28038662672042847, 0.2716244161128998, 0.26306140422821045, 0.2547176480293274, 0.24661120772361755, 0.238758847117424, 0.23117534816265106, 0.2238737940788269, 0.21686524152755737, 0.2101590633392334, 0.20376268029212952, 0.19768182933330536, 0.1919204741716385, 0.18648089468479156, 0.1813640594482422, 0.17656929790973663, 0.17209453880786896, 0.16793659329414368, 0.1640910804271698, 0.16055218875408173, 0.15731343626976013, 0.15436694025993347, 0.15170365571975708, 0.14931349456310272, 0.14718495309352875, 0.1453051120042801, 0.14365950226783752, 0.14223161339759827, 0.14100296795368195, 0.13995252549648285, 0.13905638456344604, 0.13828763365745544, 0.13761544227600098, 0.13700515031814575, 0.13641750812530518, 0.13581404089927673, 0.1351841688156128, 0.13452783226966858, 0.13384509086608887, 0.13313612341880798, 0.13240115344524384, 0.13164052367210388, 0.13085469603538513, 0.13004423677921295, 0.12920980155467987, 0.12835225462913513, 0.12747253477573395, 0.12657171487808228, 0.1256510615348816, 0.12471196055412292, 0.12375601381063461, 0.12278495728969574, 0.12180066853761673, 0.12080533057451248, 0.11980116367340088, 0.11879067867994308, 0.11777659505605698, 0.11676175892353058, 0.11574926972389221, 0.1147424504160881, 0.11374472826719284, 0.1127597913146019, 0.11179157346487045, 0.11084415018558502, 0.10992170125246048, 0.10902873426675797, 0.10816987603902817, 0.10734989494085312, 0.10657292604446411, 0.1058344766497612, 0.10512508451938629, 0.1044347956776619, 0.10375341773033142, 0.10307040065526962, 0.10237501561641693, 0.10165629535913467, 0.10090306401252747, 0.10010424256324768, 0.09924855083227158, 0.0983249768614769, 0.09732271730899811, 0.09623128175735474, 0.09504078328609467, 0.09374195337295532, 0.09232629090547562, 0.09078646451234818, 0.0891161561012268, 0.08731051534414291, 0.08536619693040848, 0.0832814872264862, 0.08105655759572983, 0.07869400084018707, 0.07620733231306076, 0.07362016290426254, 0.07095575332641602, 0.06823661923408508, 0.06548421829938889, 0.0627187043428421, 0.05995858833193779, 0.05722083896398544, 0.054520703852176666, 0.051871538162231445, 0.049285005778074265, 0.04677088186144829, 0.04433728754520416, 0.04199058562517166, 0.03973577916622162, 0.03757626935839653, 0.03551425784826279, 0.03355076536536217, 0.03168573975563049, 0.02991837076842785, 0.028246983885765076, 0.026669353246688843, 0.025182681158185005, 0.02378319390118122, 0.022466028109192848, 0.021226365119218826, 0.02005966752767563, 0.018961569294333458, 0.01792793907225132, 0.016954893246293068, 0.01603875868022442, 0.01517602801322937, 0.014363438822329044, 0.013597885146737099, 0.012876476161181927, 0.012196470983326435, 0.011555316857993603, 0.010950610041618347, 0.010380095802247524, 0.009841661900281906, 0.009333344176411629, 0.008853291161358356, 0.008399776183068752, 0.007971178740262985, 0.007566001731902361, 0.007182822097092867, 0.006820330396294594, 0.00647728843614459, 0.006152554880827665, 0.005845039151608944, 0.005553747992962599, 0.005277740769088268, 0.005016137380152941, 0.004768107086420059, 0.0045328871347010136, 0.00430976552888751, 0.004097943659871817, 0.0038964569102972746, 0.0037044149357825518, 0.003521094797179103, 0.0033458778634667397, 0.0031782547011971474, 0.003017792012542486, 0.0028641256503760815, 0.002716945018619299, 0.002575982827693224, 0.0024410078767687082, 0.0023118075914680958, 0.002188199432566762, 0.002070017158985138, 0.001957095693796873, 0.0018492843955755234, 0.0017464377451688051, 0.0016484111547470093, 0.0015550582902505994, 0.0014662410831078887, 0.0013818127335980535, 0.0013016331940889359, 0.0012255546171218157, 0.0011534338118508458, 0.001085124327801168, 0.0010204771533608437, 0.0009593495051376522, 0.0009015946998260915, 0.0008470680331811309, 0.0007956284680403769, 0.0007471309509128332, 0.0007014413713477552, 0.0006584220100194216, 0.0006179396295920014, 0.0005798667552880943, 0.0005440782406367362, 0.0005104536539874971, 0.00047887314576655626, 0.00044922693632543087, 0.00042140527511946857, 0.00039530530921183527, 0.00037082552444189787, 0.00034787479671649635 ] }, { "marker": { "color": "#00CC96", "symbol": "circle-open" }, "mode": "markers", "name": "Data", "type": "scatter", "x": [ -1.746874451637268, -1.0607484579086304, -0.6916394233703613, -0.3674386441707611, -0.08883918076753616, 0.16011905670166016, 0.4155515730381012, 0.7223190665245056, 1.0845043659210205, 1.712824821472168 ], "y": [ 0.14572864770889282, 0.125, 0.11809045076370239, 0.10025062412023544, 0.07249999791383743, 0.07249999791383743, 0.04511278122663498, 0.02500000037252903, 0.009999999776482582, 0.004999999888241291 ] }, { "marker": { "color": "#00CC96", "symbol": "circle" }, "mode": "markers", "name": "Model", "type": "scatter", "x": [ -1.746874451637268, -1.0607484579086304, -0.6916394233703613, -0.3674386441707611, -0.08883918076753616, 0.16011905670166016, 0.4155515730381012, 0.7223190665245056, 1.0845043659210205, 1.712824821472168 ], "y": [ 0.15313023328781128, 0.11887519806623459, 0.10715742409229279, 0.09888021647930145, 0.0861787348985672, 0.0659286230802536, 0.04366174712777138, 0.02495676279067993, 0.012651592493057251, 0.004157918505370617 ] }, { "line": { "color": "#AB63FA" }, "mode": "lines", "name": "Option 4", "type": "scatter", "x": [ -3, -2.9698493480682373, -2.9396984577178955, -2.909547805786133, -2.879396915435791, -2.8492462635040283, -2.8190953731536865, -2.788944721221924, -2.758794069290161, -2.7286431789398193, -2.6984925270080566, -2.668341636657715, -2.638190984725952, -2.6080400943756104, -2.5778894424438477, -2.547738552093506, -2.517587900161743, -2.4874372482299805, -2.4572863578796387, -2.427135705947876, -2.3969850540161133, -2.3668341636657715, -2.3366832733154297, -2.306532621383667, -2.2763819694519043, -2.2462310791015625, -2.2160804271698, -2.185929775238037, -2.1557788848876953, -2.1256279945373535, -2.095477342605591, -2.065326690673828, -2.0351758003234863, -2.0050251483917236, -1.9748743772506714, -1.9447236061096191, -1.914572834968567, -1.8844220638275146, -1.8542712926864624, -1.8241205215454102, -1.7939698696136475, -1.7638190984725952, -1.733668327331543, -1.7035175561904907, -1.6733667850494385, -1.6432160139083862, -1.613065242767334, -1.5829145908355713, -1.552763819694519, -1.5226130485534668, -1.4924622774124146, -1.4623115062713623, -1.43216073513031, -1.4020099639892578, -1.3718593120574951, -1.3417085409164429, -1.3115577697753906, -1.2814069986343384, -1.2512562274932861, -1.2211054563522339, -1.1909546852111816, -1.160804033279419, -1.1306532621383667, -1.1005024909973145, -1.0703517198562622, -1.04020094871521, -1.0100501775741577, -0.9798994064331055, -0.9497487545013428, -0.919597864151001, -0.8894472122192383, -0.8592963218688965, -0.8291456699371338, -0.7989950180053711, -0.7688441276550293, -0.7386934757232666, -0.7085425853729248, -0.6783919334411621, -0.6482410430908203, -0.6180903911590576, -0.5879397392272949, -0.5577888488769531, -0.5276381969451904, -0.49748730659484863, -0.46733665466308594, -0.43718576431274414, -0.40703511238098145, -0.37688446044921875, -0.34673357009887695, -0.31658291816711426, -0.28643202781677246, -0.25628137588500977, -0.22613048553466797, -0.19597983360290527, -0.16582918167114258, -0.13567829132080078, -0.10552763938903809, -0.07537674903869629, -0.045226097106933594, -0.015075206756591797, 0.015075206756591797, 0.045226097106933594, 0.07537674903869629, 0.10552763938903809, 0.13567829132080078, 0.16582918167114258, 0.19597983360290527, 0.22613048553466797, 0.25628137588500977, 0.28643202781677246, 0.31658291816711426, 0.34673357009887695, 0.37688446044921875, 0.40703511238098145, 0.43718576431274414, 0.46733665466308594, 0.49748730659484863, 0.5276381969451904, 0.5577888488769531, 0.5879397392272949, 0.6180903911590576, 0.6482410430908203, 0.6783919334411621, 0.7085425853729248, 0.7386934757232666, 0.7688441276550293, 0.7989950180053711, 0.8291456699371338, 0.8592963218688965, 0.8894472122192383, 0.919597864151001, 0.9497487545013428, 0.9798994064331055, 1.0100501775741577, 1.04020094871521, 1.0703517198562622, 1.1005024909973145, 1.1306532621383667, 1.160804033279419, 1.1909546852111816, 1.2211054563522339, 1.2512562274932861, 1.2814069986343384, 1.3115577697753906, 1.3417085409164429, 1.3718593120574951, 1.4020099639892578, 1.43216073513031, 1.4623115062713623, 1.4924622774124146, 1.5226130485534668, 1.552763819694519, 1.5829145908355713, 1.613065242767334, 1.6432160139083862, 1.6733667850494385, 1.7035175561904907, 1.733668327331543, 1.7638190984725952, 1.7939698696136475, 1.8241205215454102, 1.8542712926864624, 1.8844220638275146, 1.914572834968567, 1.9447236061096191, 1.9748743772506714, 2.0050251483917236, 2.0351758003234863, 2.065326690673828, 2.095477342605591, 2.1256279945373535, 2.1557788848876953, 2.185929775238037, 2.2160804271698, 2.2462310791015625, 2.2763819694519043, 2.306532621383667, 2.3366832733154297, 2.3668341636657715, 2.3969850540161133, 2.427135705947876, 2.4572863578796387, 2.4874372482299805, 2.517587900161743, 2.547738552093506, 2.5778894424438477, 2.6080400943756104, 2.638190984725952, 2.668341636657715, 2.6984925270080566, 2.7286431789398193, 2.758794069290161, 2.788944721221924, 2.8190953731536865, 2.8492462635040283, 2.879396915435791, 2.909547805786133, 2.9396984577178955, 2.9698493480682373, 3 ], "y": [ 0.0287491362541914, 0.030007345601916313, 0.03129930794239044, 0.03262289613485336, 0.03397580608725548, 0.03535535931587219, 0.03675860911607742, 0.038182247430086136, 0.03962276130914688, 0.04107637703418732, 0.04253898933529854, 0.04400630295276642, 0.04547380283474922, 0.04693680629134178, 0.04839038848876953, 0.04982956871390343, 0.05124915391206741, 0.05264396220445633, 0.05400864779949188, 0.05533789470791817, 0.05662636086344719, 0.05786873400211334, 0.05905970558524132, 0.06019417196512222, 0.06126703321933746, 0.062273476272821426, 0.06320887058973312, 0.06406877934932709, 0.06484919786453247, 0.06554640084505081, 0.06615715473890305, 0.06667866557836533, 0.06710872799158096, 0.06744569540023804, 0.0676887184381485, 0.06783764064311981, 0.06789308786392212, 0.06785666942596436, 0.0677308738231659, 0.06751921772956848, 0.0672263354063034, 0.06685788929462433, 0.06642066687345505, 0.06592264026403427, 0.065371572971344, 0.06476885080337524, 0.06411353498697281, 0.06340492516756058, 0.06264247745275497, 0.06182585656642914, 0.06095507740974426, 0.06003030017018318, 0.059052079916000366, 0.058021169155836105, 0.056938719004392624, 0.05580609291791916, 0.05462508276104927, 0.05339774116873741, 0.052126459777355194, 0.050813980400562286, 0.04946330934762955, 0.0480777882039547, 0.04666101559996605, 0.0452168732881546, 0.04374942183494568, 0.042263004928827286, 0.040762048214673996, 0.03925114497542381, 0.0377349816262722, 0.036218225955963135, 0.034705597907304764, 0.03320174664258957, 0.031711235642433167, 0.030238434672355652, 0.028787588700652122, 0.027362681925296783, 0.025967439636588097, 0.024605348706245422, 0.02327992208302021, 0.021994490176439285, 0.02075188048183918, 0.01955445669591427, 0.018404122442007065, 0.017302317544817924, 0.01625002548098564, 0.015247801318764687, 0.014295843429863453, 0.013393929228186607, 0.012541535310447216, 0.011737844906747341, 0.010981756262481213, 0.01027196366339922, 0.009606965817511082, 0.008985091932117939, 0.008404572494328022, 0.007863542065024376, 0.00736007047817111, 0.006892207078635693, 0.006457961164414883, 0.006055392324924469, 0.005682557821273804, 0.005337307695299387, 0.005017437506467104, 0.004720875062048435, 0.004445751663297415, 0.004190351348370314, 0.003953118342906237, 0.0037326132878661156, 0.0035275251138955355, 0.0033366645220667124, 0.0031589337158948183, 0.0029933368787169456, 0.0028389489743858576, 0.002694931346923113, 0.002560507273301482, 0.0024349710438400507, 0.0023176614195108414, 0.0022079814225435257, 0.0021053683012723923, 0.0020093112252652645, 0.001919336267746985, 0.001835001283325255, 0.0017559045227244496, 0.0016816636780276895, 0.0016119240317493677, 0.0015463382005691528, 0.001484585227444768, 0.001426373259164393, 0.0013714315136894584, 0.0013195093488320708, 0.0012703799875453115, 0.0012238341150805354, 0.00117967720143497, 0.001137732993811369, 0.0010978379286825657, 0.0010598425287753344, 0.0010236076777800918, 0.0009890093933790922, 0.0009559303289279342, 0.000924262567423284, 0.0008939097169786692, 0.0008647815557196736, 0.0008367958362214267, 0.00080987683031708, 0.0007839548634365201, 0.0007589675951749086, 0.0007348569924943149, 0.0007115703192539513, 0.0006890592630952597, 0.0006672794697806239, 0.0006461907178163528, 0.0006257570348680019, 0.0006059453589841723, 0.0005867246654815972, 0.0005680673639290035, 0.0005499485414475203, 0.0005323464283719659, 0.0005152343073859811, 0.0004985806881450117, 0.0004823544295504689, 0.00046653064782731235, 0.0004510889411903918, 0.0004360134480521083, 0.0004212907806504518, 0.00040691031608730555, 0.00039286521496251225, 0.00037914776476100087, 0.00036575470585376024, 0.0003526819054968655, 0.00033992683165706694, 0.00032748866942711174, 0.0003153651487082243, 0.00030355589115060866, 0.00029206034378148615, 0.0002808774879667908, 0.0002700057812035084, 0.00025944472872652113, 0.00024919272982515395, 0.0002392483438597992, 0.00022960892238188535, 0.00022027234081178904, 0.00021123563055880368, 0.00020249515364412218, 0.0001940476504387334, 0.00018588892999105155, 0.00017801426292862743, 0.0001704190217424184, 0.0001630979240871966, 0.0001560458476888016, 0.00014925675350241363, 0.00014272455882746726, 0.0001364435302093625, 0.00013040729390922934, 0.0001246093597728759, 0.00011904264829354361, 0.0001137012368417345, 0.00010857824236154556, 0.00010366673086537048, 0.00009895976836560294, 0.00009445126488571987 ] }, { "marker": { "color": "#AB63FA", "symbol": "circle-open" }, "mode": "markers", "name": "Data", "type": "scatter", "x": [ -1.746874451637268, -1.0607484579086304, -0.6916394233703613, -0.3674386441707611, -0.08883918076753616, 0.16011905670166016, 0.4155515730381012, 0.7223190665245056, 1.0845043659210205, 1.712824821472168 ], "y": [ 0.06532663106918335, 0.04749999940395355, 0.02261306531727314, 0.01253132801502943, 0.007499999832361937, 0.004999999888241291, 0.002506265649572015, 0, 0, 0 ] }, { "marker": { "color": "#AB63FA", "symbol": "circle" }, "mode": "markers", "name": "Model", "type": "scatter", "x": [ -1.746874451637268, -1.0607484579086304, -0.6916394233703613, -0.3674386441707611, -0.08883918076753616, 0.16011905670166016, 0.4155515730381012, 0.7223190665245056, 1.0845043659210205, 1.712824821472168 ], "y": [ 0.06194370239973068, 0.043738726526498795, 0.025480108335614204, 0.01343012135475874, 0.00731090921908617, 0.0042893108911812305, 0.0026707863435149193, 0.0016712045762687922, 0.0010439013130962849, 0.0004962501116096973 ] } ], "layout": { "legend": { "title": { "text": "Item response" } }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "white", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "white", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "#C8D4E3", "linecolor": "#C8D4E3", "minorgridcolor": "#C8D4E3", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "#C8D4E3", "linecolor": "#C8D4E3", "minorgridcolor": "#C8D4E3", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "sequentialminus": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "white", "showlakes": true, "showland": true, "subunitcolor": "#C8D4E3" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "white", "polar": { "angularaxis": { "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "" }, "bgcolor": "white", "radialaxis": { "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "white", "gridcolor": "#DFE8F3", "gridwidth": 2, "linecolor": "#EBF0F8", "showbackground": true, "ticks": "", "zerolinecolor": "#EBF0F8" }, "yaxis": { "backgroundcolor": "white", "gridcolor": "#DFE8F3", "gridwidth": 2, "linecolor": "#EBF0F8", "showbackground": true, "ticks": "", "zerolinecolor": "#EBF0F8" }, "zaxis": { "backgroundcolor": "white", "gridcolor": "#DFE8F3", "gridwidth": 2, "linecolor": "#EBF0F8", "showbackground": true, "ticks": "", "zerolinecolor": "#EBF0F8" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "#DFE8F3", "linecolor": "#A2B1C6", "ticks": "" }, "baxis": { "gridcolor": "#DFE8F3", "linecolor": "#A2B1C6", "ticks": "" }, "bgcolor": "white", "caxis": { "gridcolor": "#DFE8F3", "linecolor": "#A2B1C6", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "#EBF0F8", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "#EBF0F8", "zerolinewidth": 2 } } }, "title": { "text": "IRF - Item 34" }, "xaxis": { "title": { "text": "Latent variable" } }, "yaxis": { "title": { "text": "Probability" } } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "nested_nominal.plot.item_probabilities(item = 34, plot_group_fit=True, group_fit_population_theta=theta_train_nominal).show()\n", "nested_bspline.plot.item_probabilities(item = 34, plot_group_fit=True, group_fit_population_theta=theta_train_bspline).show()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Infit and outfit statistics can be computed using the `infit_outfit()` method for both items and respndents. These statistics are traditional fit statistics in IRT and are typically computed on the training data. Here we compute both statistics for each item with the `level=\"item\"` argument." ] }, { "cell_type": "code", "execution_count": 31, "metadata": {}, "outputs": [], "source": [ "infit_item_nr, outfit_item_nr = nested_nominal.evaluate.infit_outfit(data=train_data, theta=theta_train_nominal, level=\"item\")\n", "infit_item_mmcnn, outfit_item_mmcnn = nested_bspline.evaluate.infit_outfit(data=train_data, theta=theta_train_bspline, level=\"item\")" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Infit and outfit are based on the residuals, and a value of 1 indicates a perfect fit. Values significantly greater than 1 indicate misfit, with higher values suggesting responses were less predictable than expected (possibly due to guessing, cheating, or misunderstanding). Values significantly less than 1 suggest overfit, where responses are too predictable, indicating possible redundancy among items or that the items are not contributing additional useful information about the construct being measured. Below we see that are infit and outfit statistics stay close to one for both models, indicating good fit." ] }, { "cell_type": "code", "execution_count": 32, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "NR infit: tensor([0.9971, 1.0008, 0.9916, 1.0005, 0.9979, 0.9864, 0.9910, 1.0004, 0.9816,\n", " 1.0039, 0.9988, 0.9949, 0.9930, 1.0014, 0.9899, 1.0021, 0.9934, 1.0007,\n", " 0.9990, 0.9981, 0.9998, 0.9947, 0.9869, 1.0023, 0.9884, 0.9998, 0.9955,\n", " 0.9915, 0.9995, 0.9990, 1.0020, 0.9923, 0.9841, 0.9987, 0.9964, 0.9993,\n", " 0.9921, 0.9824, 1.0012, 1.0006, 1.0018, 0.9996, 0.9984, 0.9923, 0.9928,\n", " 0.9990, 0.9815, 0.9993, 0.9899, 0.9949, 0.9952, 0.9559, 1.0025, 1.0020,\n", " 1.0018, 0.9970, 1.0007, 0.9969, 0.9993, 0.9999, 0.9949, 1.0015, 0.9924,\n", " 1.0023, 0.9944, 1.0004, 1.0013, 1.0016, 0.9948, 1.0014, 0.9828, 1.0019,\n", " 0.9999, 0.9861, 1.0027, 0.9979, 0.9880, 0.9987, 0.9903, 1.0023])\n", "MMCNN infit: tensor([0.9986, 1.0011, 0.9911, 1.0012, 0.9992, 0.9956, 0.9963, 0.9992, 0.9932,\n", " 1.0045, 0.9989, 0.9951, 0.9877, 1.0020, 0.9909, 1.0028, 0.9954, 1.0020,\n", " 0.9958, 0.9994, 1.0007, 0.9952, 1.0007, 1.0027, 0.9879, 1.0033, 0.9977,\n", " 0.9873, 0.9998, 0.9982, 1.0035, 0.9981, 0.9860, 0.9992, 0.9956, 0.9998,\n", " 0.9936, 0.9847, 1.0007, 1.0013, 1.0020, 1.0016, 0.9969, 0.9910, 0.9949,\n", " 0.9985, 0.9901, 1.0002, 0.9915, 0.9955, 0.9970, 0.9542, 1.0028, 1.0043,\n", " 1.0029, 0.9954, 1.0011, 0.9976, 0.9975, 1.0011, 0.9932, 1.0003, 0.9902,\n", " 1.0025, 0.9981, 1.0027, 1.0022, 1.0020, 0.9984, 1.0014, 0.9793, 1.0030,\n", " 0.9997, 0.9877, 1.0034, 0.9982, 0.9876, 0.9966, 0.9904, 1.0015])\n", "NR outfit: tensor([0.9888, 0.9997, 1.0142, 0.9990, 1.0185, 0.9856, 0.9624, 1.0040, 0.9785,\n", " 0.9578, 1.0002, 1.0296, 1.0316, 0.9994, 1.0096, 0.9926, 1.0033, 1.0034,\n", " 1.0162, 0.9930, 0.9909, 0.9892, 0.9862, 0.9646, 1.0274, 0.9769, 0.9859,\n", " 1.0154, 0.9966, 0.9957, 0.9981, 0.9919, 0.9444, 0.9997, 0.9942, 0.9587,\n", " 0.9678, 0.9777, 1.0013, 1.0066, 1.0087, 0.9781, 1.0153, 0.9227, 0.9860,\n", " 0.9944, 1.0564, 0.9903, 0.9757, 0.9668, 1.0089, 1.1339, 0.9867, 0.9925,\n", " 0.9808, 0.9978, 0.9991, 0.9870, 0.9770, 1.0553, 1.0218, 0.9961, 1.0832,\n", " 0.9977, 0.9203, 0.9943, 1.0000, 1.0038, 1.0041, 1.0018, 1.0101, 0.9855,\n", " 0.9740, 0.9928, 0.9960, 0.9967, 0.9667, 1.0206, 1.0250, 1.0026])\n", "MMCNN outfit: tensor([1.0006, 0.9959, 1.0240, 0.9992, 1.0195, 1.0174, 0.9767, 0.9998, 0.9760,\n", " 0.9651, 1.0018, 1.0018, 1.0860, 1.0006, 1.0340, 0.9951, 1.0221, 1.0040,\n", " 1.0296, 1.0021, 0.9983, 1.0108, 1.0511, 0.9768, 1.0603, 0.9851, 0.9875,\n", " 1.0505, 0.9992, 0.9994, 1.0014, 1.0014, 0.9457, 1.0018, 1.0345, 0.9735,\n", " 0.9703, 0.9843, 1.0010, 1.0107, 1.0087, 1.0044, 1.0201, 0.9533, 1.0008,\n", " 0.9994, 1.0609, 0.9929, 0.9800, 0.9877, 1.0117, 1.2565, 0.9948, 0.9972,\n", " 0.9864, 1.0114, 0.9993, 1.0010, 0.9835, 1.0723, 1.0423, 1.0028, 1.0911,\n", " 0.9994, 0.9792, 1.0123, 1.0026, 1.0080, 1.0099, 1.0011, 1.0190, 0.9883,\n", " 0.9861, 1.0633, 0.9972, 0.9986, 1.0165, 1.0155, 1.0350, 1.0028])\n" ] } ], "source": [ "print(f\"NR infit: {infit_item_nr}\")\n", "print(f\"MMCNN infit: {infit_item_mmcnn}\")\n", "print(f\"NR outfit: {outfit_item_nr}\")\n", "print(f\"MMCNN outfit: {outfit_item_mmcnn}\")" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Information\n" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "We can plot the Fisher information using the `information()` method for both individual items and the test as a whole. Below, all models suggest that the test provides the most information a bit around $\\theta=0$ (with the exception of the B-spline nested logit model at the lower end, but this is a result of erratic spline behavior where there is close to no data-points)." ] }, { "cell_type": "code", "execution_count": 33, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "INFO: Computing Jacobian for all items and item categories...\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "plotlyServerURL": "https://plot.ly" }, "data": [ { "hovertemplate": "x=%{x}
y=%{y}", "legendgroup": "", "line": { "dash": "solid", "shape": "spline" }, "marker": { "symbol": "circle" }, "mode": "lines", "name": "", "orientation": "v", "showlegend": false, "type": "scatter", "x": [ -3, -2.939393997192383, -2.8787879943847656, -2.8181817531585693, -2.757575750350952, -2.696969747543335, -2.6363635063171387, -2.5757575035095215, -2.5151515007019043, -2.454545497894287, -2.39393949508667, -2.3333332538604736, -2.2727272510528564, -2.2121212482452393, -2.151515007019043, -2.090909004211426, -2.0303030014038086, -1.9696969985961914, -1.9090908765792847, -1.848484754562378, -1.7878787517547607, -1.7272727489471436, -1.6666666269302368, -1.60606050491333, -1.545454502105713, -1.4848484992980957, -1.424242377281189, -1.3636362552642822, -1.303030252456665, -1.2424242496490479, -1.1818181276321411, -1.1212120056152344, -1.0606060028076172, -1, -0.9393939971923828, -0.8787877559661865, -0.8181817531585693, -0.7575757503509521, -0.6969695091247559, -0.6363635063171387, -0.5757575035095215, -0.5151515007019043, -0.4545454978942871, -0.3939392566680908, -0.33333325386047363, -0.27272725105285645, -0.21212100982666016, -0.15151500701904297, -0.09090900421142578, -0.030303001403808594, 0.030303001403808594, 0.09090900421142578, 0.15151500701904297, 0.21212100982666016, 0.27272725105285645, 0.33333325386047363, 0.3939392566680908, 0.4545454978942871, 0.5151515007019043, 0.5757575035095215, 0.6363635063171387, 0.6969695091247559, 0.7575757503509521, 0.8181817531585693, 0.8787877559661865, 0.9393939971923828, 1, 1.0606060028076172, 1.1212120056152344, 1.1818181276321411, 1.2424242496490479, 1.303030252456665, 1.3636362552642822, 1.424242377281189, 1.4848484992980957, 1.545454502105713, 1.60606050491333, 1.6666666269302368, 1.7272727489471436, 1.7878787517547607, 1.848484754562378, 1.9090908765792847, 1.9696969985961914, 2.0303030014038086, 2.090909004211426, 2.151515007019043, 2.2121212482452393, 2.2727272510528564, 2.3333332538604736, 2.39393949508667, 2.454545497894287, 2.5151515007019043, 2.5757575035095215, 2.6363635063171387, 2.696969747543335, 2.757575750350952, 2.8181817531585693, 2.8787879943847656, 2.939393997192383, 3 ], "xaxis": "x", "y": [ 0.41666096448898315, 0.459805428981781, 0.5077020525932312, 0.5609079003334045, 0.6200460195541382, 0.685814619064331, 0.7589940428733826, 0.8404526114463806, 0.9311573505401611, 1.0321779251098633, 1.1446946859359741, 1.2700031995773315, 1.4095144271850586, 1.564758062362671, 1.7373788356781006, 1.929126501083374, 2.1418490409851074, 2.3774733543395996, 2.6379871368408203, 2.925407886505127, 3.241755247116089, 3.5890092849731445, 3.969069480895996, 4.383704662322998, 4.834497928619385, 5.32279634475708, 5.849649906158447, 6.415761947631836, 7.0214385986328125, 7.666561126708984, 8.35056209564209, 9.072421073913574, 9.830683708190918, 10.623495101928711, 11.448641777038574, 12.303597450256348, 13.185559272766113, 14.091463088989258, 15.017997741699219, 15.961543083190918, 16.91815757751465, 17.883487701416016, 18.85271453857422, 19.820507049560547, 20.78098487854004, 21.727718353271484, 22.653730392456055, 23.551475524902344, 24.412870407104492, 25.229278564453125, 25.99151611328125, 26.689861297607422, 27.314151763916016, 27.85391616821289, 28.298646926879883, 28.638147354125977, 28.862995147705078, 28.965049743652344, 28.93804168701172, 28.778093338012695, 28.484220504760742, 28.05868148803711, 27.50713539123535, 26.838579177856445, 26.065006256103516, 25.200801849365234, 24.26203727722168, 23.265535354614258, 22.228073120117188, 21.165626525878906, 20.0927791595459, 19.022335052490234, 17.965145111083984, 16.93004035949707, 15.923972129821777, 14.95215892791748, 14.018321990966797, 13.124924659729004, 12.273420333862305, 11.464433670043945, 10.697975158691406, 9.973566055297852, 9.290377616882324, 8.64731216430664, 8.043095588684082, 7.476306915283203, 6.945436477661133, 6.448915481567383, 5.985139846801758, 5.552485942840576, 5.149331569671631, 4.7740654945373535, 4.425104141235352, 4.100892066955566, 3.7999215126037598, 3.5207290649414062, 3.261906623840332, 3.0221025943756104, 2.800036668777466, 2.594475746154785 ], "yaxis": "y" } ], "layout": { "legend": { "tracegroupgap": 0 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "white", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "white", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "#C8D4E3", "linecolor": "#C8D4E3", "minorgridcolor": "#C8D4E3", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "#C8D4E3", "linecolor": "#C8D4E3", "minorgridcolor": "#C8D4E3", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "sequentialminus": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "white", "showlakes": true, "showland": true, "subunitcolor": "#C8D4E3" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "white", "polar": { "angularaxis": { "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "" }, "bgcolor": "white", "radialaxis": { "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "white", "gridcolor": "#DFE8F3", "gridwidth": 2, "linecolor": "#EBF0F8", "showbackground": true, "ticks": "", "zerolinecolor": "#EBF0F8" }, "yaxis": { "backgroundcolor": "white", "gridcolor": "#DFE8F3", "gridwidth": 2, "linecolor": "#EBF0F8", "showbackground": true, "ticks": "", "zerolinecolor": "#EBF0F8" }, "zaxis": { "backgroundcolor": "white", "gridcolor": "#DFE8F3", "gridwidth": 2, "linecolor": "#EBF0F8", "showbackground": true, "ticks": "", "zerolinecolor": "#EBF0F8" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "#DFE8F3", "linecolor": "#A2B1C6", "ticks": "" }, "baxis": { "gridcolor": "#DFE8F3", "linecolor": "#A2B1C6", "ticks": "" }, "bgcolor": "white", "caxis": { "gridcolor": "#DFE8F3", "linecolor": "#A2B1C6", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "#EBF0F8", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "#EBF0F8", "zerolinewidth": 2 } } }, "title": { "text": "Information" }, "xaxis": { "anchor": "y", "domain": [ 0, 1 ], "title": { "text": "Latent variable" } }, "yaxis": { "anchor": "x", "domain": [ 0, 1 ], "title": { "text": "Information" } } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stderr", "output_type": "stream", "text": [ "INFO: Computing Jacobian for all items and item categories...\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "plotlyServerURL": "https://plot.ly" }, "data": [ { "hovertemplate": "x=%{x}
y=%{y}", "legendgroup": "", "line": { "dash": "solid", "shape": "spline" }, "marker": { "symbol": "circle" }, "mode": "lines", "name": "", "orientation": "v", "showlegend": false, "type": "scatter", "x": [ -3, -2.939393997192383, -2.8787879943847656, -2.8181817531585693, -2.757575750350952, -2.696969747543335, -2.6363635063171387, -2.5757575035095215, -2.5151515007019043, -2.454545497894287, -2.39393949508667, -2.3333332538604736, -2.2727272510528564, -2.2121212482452393, -2.151515007019043, -2.090909004211426, -2.0303030014038086, -1.9696969985961914, -1.9090908765792847, -1.848484754562378, -1.7878787517547607, -1.7272727489471436, -1.6666666269302368, -1.60606050491333, -1.545454502105713, -1.4848484992980957, -1.424242377281189, -1.3636362552642822, -1.303030252456665, -1.2424242496490479, -1.1818181276321411, -1.1212120056152344, -1.0606060028076172, -1, -0.9393939971923828, -0.8787877559661865, -0.8181817531585693, -0.7575757503509521, -0.6969695091247559, -0.6363635063171387, -0.5757575035095215, -0.5151515007019043, -0.4545454978942871, -0.3939392566680908, -0.33333325386047363, -0.27272725105285645, -0.21212100982666016, -0.15151500701904297, -0.09090900421142578, -0.030303001403808594, 0.030303001403808594, 0.09090900421142578, 0.15151500701904297, 0.21212100982666016, 0.27272725105285645, 0.33333325386047363, 0.3939392566680908, 0.4545454978942871, 0.5151515007019043, 0.5757575035095215, 0.6363635063171387, 0.6969695091247559, 0.7575757503509521, 0.8181817531585693, 0.8787877559661865, 0.9393939971923828, 1, 1.0606060028076172, 1.1212120056152344, 1.1818181276321411, 1.2424242496490479, 1.303030252456665, 1.3636362552642822, 1.424242377281189, 1.4848484992980957, 1.545454502105713, 1.60606050491333, 1.6666666269302368, 1.7272727489471436, 1.7878787517547607, 1.848484754562378, 1.9090908765792847, 1.9696969985961914, 2.0303030014038086, 2.090909004211426, 2.151515007019043, 2.2121212482452393, 2.2727272510528564, 2.3333332538604736, 2.39393949508667, 2.454545497894287, 2.5151515007019043, 2.5757575035095215, 2.6363635063171387, 2.696969747543335, 2.757575750350952, 2.8181817531585693, 2.8787879943847656, 2.939393997192383, 3 ], "xaxis": "x", "y": [ 5.326807975769043, 5.488870620727539, 5.655826091766357, 5.827939987182617, 6.005523681640625, 6.188933372497559, 6.37857723236084, 6.57490873336792, 6.778434753417969, 6.989709377288818, 7.20933723449707, 7.437966346740723, 7.676286697387695, 7.925027847290039, 8.184955596923828, 8.456859588623047, 8.74155044555664, 9.039847373962402, 9.352569580078125, 9.680513381958008, 10.02444076538086, 10.38506031036377, 10.7629976272583, 11.158773422241211, 11.572784423828125, 12.00527572631836, 12.456321716308594, 12.925812721252441, 13.413456916809082, 13.918783187866211, 14.441149711608887, 14.979785919189453, 15.53381061553955, 16.102283477783203, 16.684228897094727, 17.278661727905273, 17.88459587097168, 18.50102424621582, 19.126882553100586, 19.760986328125, 20.40195655822754, 21.04813003540039, 21.697458267211914, 22.347429275512695, 22.994976043701172, 23.63640594482422, 24.26734161376953, 24.882648468017578, 25.476394653320312, 26.041799545288086, 26.571243286132812, 27.0562744140625, 27.487730026245117, 27.855892181396484, 28.150774002075195, 28.362491607666016, 28.481721878051758, 28.500211715698242, 28.411375045776367, 28.21078109741211, 27.896690368652344, 27.470361709594727, 26.936248779296875, 26.301944732666016, 25.57780647277832, 24.776430130004883, 23.911840438842773, 22.99863052368164, 22.051109313964844, 21.082555770874023, 20.10468864440918, 19.127357482910156, 18.158470153808594, 17.204118728637695, 16.268875122070312, 15.35610294342041, 14.46830940246582, 13.607471466064453, 12.77525520324707, 11.973140716552734, 11.20249080657959, 10.464550018310547, 9.760382652282715, 9.09083080291748, 8.45643424987793, 7.857413291931152, 7.293641090393066, 6.764664649963379, 6.26971435546875, 5.807755470275879, 5.377540588378906, 4.977650165557861, 4.60655403137207, 4.26264762878418, 3.9442930221557617, 3.6498665809631348, 3.377760648727417, 3.1264188289642334, 2.894350528717041, 2.6801364421844482 ], "yaxis": "y" } ], "layout": { "legend": { "tracegroupgap": 0 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "white", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "white", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "#C8D4E3", "linecolor": "#C8D4E3", "minorgridcolor": "#C8D4E3", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "#C8D4E3", "linecolor": "#C8D4E3", "minorgridcolor": "#C8D4E3", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "sequentialminus": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "white", "showlakes": true, "showland": true, "subunitcolor": "#C8D4E3" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "white", "polar": { "angularaxis": { "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "" }, "bgcolor": "white", "radialaxis": { "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "white", "gridcolor": "#DFE8F3", "gridwidth": 2, "linecolor": "#EBF0F8", "showbackground": true, "ticks": "", "zerolinecolor": "#EBF0F8" }, "yaxis": { "backgroundcolor": "white", "gridcolor": "#DFE8F3", "gridwidth": 2, "linecolor": "#EBF0F8", "showbackground": true, "ticks": "", "zerolinecolor": "#EBF0F8" }, "zaxis": { "backgroundcolor": "white", "gridcolor": "#DFE8F3", "gridwidth": 2, "linecolor": "#EBF0F8", "showbackground": true, "ticks": "", "zerolinecolor": "#EBF0F8" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "#DFE8F3", "linecolor": "#A2B1C6", "ticks": "" }, "baxis": { "gridcolor": "#DFE8F3", "linecolor": "#A2B1C6", "ticks": "" }, "bgcolor": "white", "caxis": { "gridcolor": "#DFE8F3", "linecolor": "#A2B1C6", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "#EBF0F8", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "#EBF0F8", "zerolinewidth": 2 } } }, "title": { "text": "Information" }, "xaxis": { "anchor": "y", "domain": [ 0, 1 ], "title": { "text": "Latent variable" } }, "yaxis": { "anchor": "x", "domain": [ 0, 1 ], "title": { "text": "Information" } } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stderr", "output_type": "stream", "text": [ "INFO: Computing Jacobian for all items and item categories...\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "plotlyServerURL": "https://plot.ly" }, "data": [ { "hovertemplate": "x=%{x}
y=%{y}", "legendgroup": "", "line": { "dash": "solid", "shape": "spline" }, "marker": { "symbol": "circle" }, "mode": "lines", "name": "", "orientation": "v", "showlegend": false, "type": "scatter", "x": [ -3, -2.939393997192383, -2.8787879943847656, -2.8181817531585693, -2.757575750350952, -2.696969747543335, -2.6363635063171387, -2.5757575035095215, -2.5151515007019043, -2.454545497894287, -2.39393949508667, -2.3333332538604736, -2.2727272510528564, -2.2121212482452393, -2.151515007019043, -2.090909004211426, -2.0303030014038086, -1.9696969985961914, -1.9090908765792847, -1.848484754562378, -1.7878787517547607, -1.7272727489471436, -1.6666666269302368, -1.60606050491333, -1.545454502105713, -1.4848484992980957, -1.424242377281189, -1.3636362552642822, -1.303030252456665, -1.2424242496490479, -1.1818181276321411, -1.1212120056152344, -1.0606060028076172, -1, -0.9393939971923828, -0.8787877559661865, -0.8181817531585693, -0.7575757503509521, -0.6969695091247559, -0.6363635063171387, -0.5757575035095215, -0.5151515007019043, -0.4545454978942871, -0.3939392566680908, -0.33333325386047363, -0.27272725105285645, -0.21212100982666016, -0.15151500701904297, -0.09090900421142578, -0.030303001403808594, 0.030303001403808594, 0.09090900421142578, 0.15151500701904297, 0.21212100982666016, 0.27272725105285645, 0.33333325386047363, 0.3939392566680908, 0.4545454978942871, 0.5151515007019043, 0.5757575035095215, 0.6363635063171387, 0.6969695091247559, 0.7575757503509521, 0.8181817531585693, 0.8787877559661865, 0.9393939971923828, 1, 1.0606060028076172, 1.1212120056152344, 1.1818181276321411, 1.2424242496490479, 1.303030252456665, 1.3636362552642822, 1.424242377281189, 1.4848484992980957, 1.545454502105713, 1.60606050491333, 1.6666666269302368, 1.7272727489471436, 1.7878787517547607, 1.848484754562378, 1.9090908765792847, 1.9696969985961914, 2.0303030014038086, 2.090909004211426, 2.151515007019043, 2.2121212482452393, 2.2727272510528564, 2.3333332538604736, 2.39393949508667, 2.454545497894287, 2.5151515007019043, 2.5757575035095215, 2.6363635063171387, 2.696969747543335, 2.757575750350952, 2.8181817531585693, 2.8787879943847656, 2.939393997192383, 3 ], "xaxis": "x", "y": [ 50.40946960449219, 52.09592056274414, 52.93096160888672, 52.84102249145508, 51.832923889160156, 49.98444366455078, 47.418251037597656, 44.27729415893555, 40.712928771972656, 36.886451721191406, 32.97939682006836, 29.20401382446289, 25.805431365966797, 23.046710968017578, 21.17327117919922, 20.357769012451172, 20.632261276245117, 21.821165084838867, 23.495750427246094, 24.97954750061035, 25.441532135009766, 24.114521026611328, 21.0385799407959, 18.224958419799805, 16.062013626098633, 14.648842811584473, 14.046460151672363, 14.268144607543945, 15.26881217956543, 16.93518829345703, 19.079710006713867, 21.443052291870117, 23.711042404174805, 25.550771713256836, 26.66650390625, 26.869861602783203, 26.153583526611328, 24.757179260253906, 23.217723846435547, 22.594207763671875, 23.045425415039062, 24.12886619567871, 25.442602157592773, 26.664289474487305, 27.582685470581055, 28.117488861083984, 28.324106216430664, 28.382333755493164, 28.57101821899414, 29.23239517211914, 30.65912437438965, 32.38594055175781, 33.83699035644531, 34.72085952758789, 34.96278381347656, 34.64580154418945, 33.94978332519531, 33.09593200683594, 32.300907135009766, 31.742982864379883, 31.541460037231445, 31.748096466064453, 32.015716552734375, 31.74851417541504, 30.900020599365234, 29.617643356323242, 28.117839813232422, 26.605579376220703, 25.23241424560547, 24.083301544189453, 23.181171417236328, 22.499977111816406, 21.980260848999023, 21.545021057128906, 21.115598678588867, 20.626964569091797, 20.03826332092285, 19.334012985229492, 18.458389282226562, 17.14664649963379, 15.763571739196777, 14.691218376159668, 14.130343437194824, 14.124601364135742, 14.60837173461914, 15.439996719360352, 16.429147720336914, 17.38207244873047, 18.149585723876953, 18.589962005615234, 18.423547744750977, 17.266386032104492, 15.072256088256836, 12.3780517578125, 9.854508399963379, 7.837820053100586, 6.337148666381836, 5.2367448806762695, 4.420111179351807, 3.8013312816619873 ], "yaxis": "y" } ], "layout": { "legend": { "tracegroupgap": 0 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "white", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "white", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "#C8D4E3", "linecolor": "#C8D4E3", "minorgridcolor": "#C8D4E3", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "#C8D4E3", "linecolor": "#C8D4E3", "minorgridcolor": "#C8D4E3", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "sequentialminus": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "white", "showlakes": true, "showland": true, "subunitcolor": "#C8D4E3" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "white", "polar": { "angularaxis": { "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "" }, "bgcolor": "white", "radialaxis": { "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "white", "gridcolor": "#DFE8F3", "gridwidth": 2, "linecolor": "#EBF0F8", "showbackground": true, "ticks": "", "zerolinecolor": "#EBF0F8" }, "yaxis": { "backgroundcolor": "white", "gridcolor": "#DFE8F3", "gridwidth": 2, "linecolor": "#EBF0F8", "showbackground": true, "ticks": "", "zerolinecolor": "#EBF0F8" }, "zaxis": { "backgroundcolor": "white", "gridcolor": "#DFE8F3", "gridwidth": 2, "linecolor": "#EBF0F8", "showbackground": true, "ticks": "", "zerolinecolor": "#EBF0F8" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "#DFE8F3", "linecolor": "#A2B1C6", "ticks": "" }, "baxis": { "gridcolor": "#DFE8F3", "linecolor": "#A2B1C6", "ticks": "" }, "bgcolor": "white", "caxis": { "gridcolor": "#DFE8F3", "linecolor": "#A2B1C6", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "#EBF0F8", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "#EBF0F8", "linecolor": "#EBF0F8", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "#EBF0F8", "zerolinewidth": 2 } } }, "title": { "text": "Information" }, "xaxis": { "anchor": "y", "domain": [ 0, 1 ], "title": { "text": "Latent variable" } }, "yaxis": { "anchor": "x", "domain": [ 0, 1 ], "title": { "text": "Information" } } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "threepl.plot.information().show()\n", "nested_nominal.plot.information().show()\n", "nested_bspline.plot.information().show()" ] } ], "metadata": { "kernelspec": { "display_name": "pytorch", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.11.5" } }, "nbformat": 4, "nbformat_minor": 4 }