Switch to unified view

a b/brainDecode/towardMoabbIntegration/temp.ipynb
1
{
2
 "cells": [
3
  {
4
   "cell_type": "markdown",
5
   "metadata": {
6
    "colab_type": "text",
7
    "id": "eegpnTbImFUE"
8
   },
9
   "source": [
10
    "# Two-Stages Deep Learning Project\n",
11
    "\n",
12
    "<p>This project has been developped by the Montreal Hacknight community. It derives from the braindecode framework and is aimed at being integrable into the Moabb project.</p>\n",
13
    "\n",
14
    "<p><ul>https://github.com/robintibor/braindecode</ul>\n",
15
    "<ul>https://github.com/NeuroTechX/moabb</ul></p>\n",
16
    "\n",
17
    "<p>This project wouldn't have been possible without the contribution of these people: Arna (...), Justin (...), Yannick Roy, Eamon Egan, (...) and it is currently being supported by Fred Simard (fs@re-ak.com)</p>"
18
   ]
19
  },
20
  {
21
   "cell_type": "markdown",
22
   "metadata": {
23
    "colab_type": "text",
24
    "id": "lBXnRujl24VO"
25
   },
26
   "source": [
27
    "<p>This project consist in deriving a two-stages training process from the brain decode implementation of a Shallow Convolutional Network. The core motivation is to combine the strenghts of deep learning - that is being one of the most powerful ML algorithms out-there - while grinding down it's fall back - it requires an immense of data.</p>\n",
28
    "\n",
29
    "<p>The goal is to develop a method to train the network in two stages:</p>\n",
30
    "<p><ul>1) Train the network over a large dataset, this training forms some kind of prior over the network</ul>\n",
31
    "<ul>2) Train the network a second time, this time on the dataset of interest</ul>\n",
32
    "</p>\n",
33
    "\n",
34
    "<p>The premise motivating this approach is that the second training is likely to proceed faster than what is normally required to train a deep net, without sacrificing the performance; and, we suspect that the second training will be able to exploit the specificities of the dataset of interest in a way to surpasses the first training, which was trained on a generalistic dataset.</p>"
35
   ]
36
  },
37
  {
38
   "cell_type": "code",
39
   "execution_count": 0,
40
   "metadata": {
41
    "colab": {
42
     "base_uri": "https://localhost:8080/",
43
     "height": 136
44
    },
45
    "colab_type": "code",
46
    "id": "4ci1qeJ39mY9",
47
    "outputId": "e7694d42-30cf-4cf4-8ca5-13f17972638a"
48
   },
49
   "outputs": [
50
    {
51
     "name": "stdout",
52
     "output_type": "stream",
53
     "text": [
54
      "Cloning into 'dl-eeg-playground'...\n",
55
      "remote: Enumerating objects: 25, done.\u001b[K\n",
56
      "remote: Counting objects: 100% (25/25), done.\u001b[K\n",
57
      "remote: Compressing objects: 100% (12/12), done.\u001b[K\n",
58
      "remote: Total 286 (delta 13), reused 22 (delta 12), pack-reused 261\u001b[K\n",
59
      "Receiving objects: 100% (286/286), 1.97 MiB | 2.15 MiB/s, done.\n",
60
      "Resolving deltas: 100% (141/141), done.\n"
61
     ]
62
    }
63
   ],
64
   "source": [
65
    "\"\"\"\n",
66
    "#\n",
67
    "# Download the github, which contains the package with the networks\n",
68
    "#\n",
69
    "\"\"\"\n",
70
    "\n",
71
    "# reset to default base path\n",
72
    "import os\n",
73
    "os.chdir('/content/')\n",
74
    "\n",
75
    "# if dl-eeg-playground already here, erase\n",
76
    "!rm -rf dl-eeg-playground\n",
77
    "\n",
78
    "# clone dl-eeg-playground and cd to it\n",
79
    "!git clone https://github.com/NeuroTechX/dl-eeg-playground.git\n",
80
    "os.chdir('dl-eeg-playground/brainDecode/towardMoabbIntegration')\n"
81
   ]
82
  },
83
  {
84
   "cell_type": "code",
85
   "execution_count": 0,
86
   "metadata": {
87
    "colab": {
88
     "base_uri": "https://localhost:8080/",
89
     "height": 7721
90
    },
91
    "colab_type": "code",
92
    "id": "NSi52lWjPNN4",
93
    "outputId": "1e0331cb-d3c1-4cc2-fe1c-1f3f9da83396"
94
   },
95
   "outputs": [
96
    {
97
     "name": "stdout",
98
     "output_type": "stream",
99
     "text": [
100
      "--2018-12-06 23:51:20--  http://bnci-horizon-2020.eu/database/data-sets/002-2014/S01T.mat\n",
101
      "Resolving bnci-horizon-2020.eu (bnci-horizon-2020.eu)... 91.227.204.35\n",
102
      "Connecting to bnci-horizon-2020.eu (bnci-horizon-2020.eu)|91.227.204.35|:80... connected.\n",
103
      "HTTP request sent, awaiting response... 302 Found\n",
104
      "Location: https://lampx.tugraz.at/~bci/database/002-2014/S01T.mat [following]\n",
105
      "--2018-12-06 23:51:20--  https://lampx.tugraz.at/~bci/database/002-2014/S01T.mat\n",
106
      "Resolving lampx.tugraz.at (lampx.tugraz.at)... 129.27.124.207\n",
107
      "Connecting to lampx.tugraz.at (lampx.tugraz.at)|129.27.124.207|:443... connected.\n",
108
      "HTTP request sent, awaiting response... 200 OK\n",
109
      "Length: 39794870 (38M)\n",
110
      "Saving to: ‘S01T.mat’\n",
111
      "\n",
112
      "S01T.mat            100%[===================>]  37.95M  6.83MB/s    in 11s     \n",
113
      "\n",
114
      "2018-12-06 23:51:33 (3.41 MB/s) - ‘S01T.mat’ saved [39794870/39794870]\n",
115
      "\n",
116
      "--2018-12-06 23:51:34--  http://bnci-horizon-2020.eu/database/data-sets/002-2014/S01E.mat\n",
117
      "Resolving bnci-horizon-2020.eu (bnci-horizon-2020.eu)... 91.227.204.35\n",
118
      "Connecting to bnci-horizon-2020.eu (bnci-horizon-2020.eu)|91.227.204.35|:80... connected.\n",
119
      "HTTP request sent, awaiting response... 302 Found\n",
120
      "Location: https://lampx.tugraz.at/~bci/database/002-2014/S01E.mat [following]\n",
121
      "--2018-12-06 23:51:35--  https://lampx.tugraz.at/~bci/database/002-2014/S01E.mat\n",
122
      "Resolving lampx.tugraz.at (lampx.tugraz.at)... 129.27.124.207\n",
123
      "Connecting to lampx.tugraz.at (lampx.tugraz.at)|129.27.124.207|:443... connected.\n",
124
      "HTTP request sent, awaiting response... 200 OK\n",
125
      "Length: 23769588 (23M)\n",
126
      "Saving to: ‘S01E.mat’\n",
127
      "\n",
128
      "S01E.mat            100%[===================>]  22.67M  3.98MB/s    in 10s     \n",
129
      "\n",
130
      "2018-12-06 23:51:46 (2.27 MB/s) - ‘S01E.mat’ saved [23769588/23769588]\n",
131
      "\n",
132
      "--2018-12-06 23:51:47--  http://bnci-horizon-2020.eu/database/data-sets/002-2014/S02T.mat\n",
133
      "Resolving bnci-horizon-2020.eu (bnci-horizon-2020.eu)... 91.227.204.35\n",
134
      "Connecting to bnci-horizon-2020.eu (bnci-horizon-2020.eu)|91.227.204.35|:80... connected.\n",
135
      "HTTP request sent, awaiting response... 302 Found\n",
136
      "Location: https://lampx.tugraz.at/~bci/database/002-2014/S02T.mat [following]\n",
137
      "--2018-12-06 23:51:47--  https://lampx.tugraz.at/~bci/database/002-2014/S02T.mat\n",
138
      "Resolving lampx.tugraz.at (lampx.tugraz.at)... 129.27.124.207\n",
139
      "Connecting to lampx.tugraz.at (lampx.tugraz.at)|129.27.124.207|:443... connected.\n",
140
      "HTTP request sent, awaiting response... 200 OK\n",
141
      "Length: 38364523 (37M)\n",
142
      "Saving to: ‘S02T.mat’\n",
143
      "\n",
144
      "S02T.mat            100%[===================>]  36.59M  7.04MB/s    in 10s     \n",
145
      "\n",
146
      "2018-12-06 23:51:59 (3.60 MB/s) - ‘S02T.mat’ saved [38364523/38364523]\n",
147
      "\n",
148
      "--2018-12-06 23:52:00--  http://bnci-horizon-2020.eu/database/data-sets/002-2014/S02E.mat\n",
149
      "Resolving bnci-horizon-2020.eu (bnci-horizon-2020.eu)... 91.227.204.35\n",
150
      "Connecting to bnci-horizon-2020.eu (bnci-horizon-2020.eu)|91.227.204.35|:80... connected.\n",
151
      "HTTP request sent, awaiting response... 302 Found\n",
152
      "Location: https://lampx.tugraz.at/~bci/database/002-2014/S02E.mat [following]\n",
153
      "--2018-12-06 23:52:00--  https://lampx.tugraz.at/~bci/database/002-2014/S02E.mat\n",
154
      "Resolving lampx.tugraz.at (lampx.tugraz.at)... 129.27.124.207\n",
155
      "Connecting to lampx.tugraz.at (lampx.tugraz.at)|129.27.124.207|:443... connected.\n",
156
      "HTTP request sent, awaiting response... 200 OK\n",
157
      "Length: 22998442 (22M)\n",
158
      "Saving to: ‘S02E.mat’\n",
159
      "\n",
160
      "S02E.mat            100%[===================>]  21.93M  3.82MB/s    in 8.7s    \n",
161
      "\n",
162
      "2018-12-06 23:52:10 (2.52 MB/s) - ‘S02E.mat’ saved [22998442/22998442]\n",
163
      "\n",
164
      "--2018-12-06 23:52:11--  http://bnci-horizon-2020.eu/database/data-sets/002-2014/S03T.mat\n",
165
      "Resolving bnci-horizon-2020.eu (bnci-horizon-2020.eu)... 91.227.204.35\n",
166
      "Connecting to bnci-horizon-2020.eu (bnci-horizon-2020.eu)|91.227.204.35|:80... connected.\n",
167
      "HTTP request sent, awaiting response... 302 Found\n",
168
      "Location: https://lampx.tugraz.at/~bci/database/002-2014/S03T.mat [following]\n",
169
      "--2018-12-06 23:52:11--  https://lampx.tugraz.at/~bci/database/002-2014/S03T.mat\n",
170
      "Resolving lampx.tugraz.at (lampx.tugraz.at)... 129.27.124.207\n",
171
      "Connecting to lampx.tugraz.at (lampx.tugraz.at)|129.27.124.207|:443... connected.\n",
172
      "HTTP request sent, awaiting response... 200 OK\n",
173
      "Length: 39739945 (38M)\n",
174
      "Saving to: ‘S03T.mat’\n",
175
      "\n",
176
      "S03T.mat            100%[===================>]  37.90M  7.44MB/s    in 11s     \n",
177
      "\n",
178
      "2018-12-06 23:52:23 (3.51 MB/s) - ‘S03T.mat’ saved [39739945/39739945]\n",
179
      "\n",
180
      "--2018-12-06 23:52:25--  http://bnci-horizon-2020.eu/database/data-sets/002-2014/S03E.mat\n",
181
      "Resolving bnci-horizon-2020.eu (bnci-horizon-2020.eu)... 91.227.204.35\n",
182
      "Connecting to bnci-horizon-2020.eu (bnci-horizon-2020.eu)|91.227.204.35|:80... connected.\n",
183
      "HTTP request sent, awaiting response... 302 Found\n",
184
      "Location: https://lampx.tugraz.at/~bci/database/002-2014/S03E.mat [following]\n",
185
      "--2018-12-06 23:52:25--  https://lampx.tugraz.at/~bci/database/002-2014/S03E.mat\n",
186
      "Resolving lampx.tugraz.at (lampx.tugraz.at)... 129.27.124.207\n",
187
      "Connecting to lampx.tugraz.at (lampx.tugraz.at)|129.27.124.207|:443... connected.\n",
188
      "HTTP request sent, awaiting response... 200 OK\n",
189
      "Length: 23797275 (23M)\n",
190
      "Saving to: ‘S03E.mat’\n",
191
      "\n",
192
      "S03E.mat            100%[===================>]  22.69M  3.86MB/s    in 9.7s    \n",
193
      "\n",
194
      "2018-12-06 23:52:36 (2.34 MB/s) - ‘S03E.mat’ saved [23797275/23797275]\n",
195
      "\n",
196
      "--2018-12-06 23:52:37--  http://bnci-horizon-2020.eu/database/data-sets/002-2014/S04T.mat\n",
197
      "Resolving bnci-horizon-2020.eu (bnci-horizon-2020.eu)... 91.227.204.35\n",
198
      "Connecting to bnci-horizon-2020.eu (bnci-horizon-2020.eu)|91.227.204.35|:80... connected.\n",
199
      "HTTP request sent, awaiting response... 302 Found\n",
200
      "Location: https://lampx.tugraz.at/~bci/database/002-2014/S04T.mat [following]\n",
201
      "--2018-12-06 23:52:37--  https://lampx.tugraz.at/~bci/database/002-2014/S04T.mat\n",
202
      "Resolving lampx.tugraz.at (lampx.tugraz.at)... 129.27.124.207\n",
203
      "Connecting to lampx.tugraz.at (lampx.tugraz.at)|129.27.124.207|:443... connected.\n",
204
      "HTTP request sent, awaiting response... 200 OK\n",
205
      "Length: 39607931 (38M)\n",
206
      "Saving to: ‘S04T.mat’\n",
207
      "\n",
208
      "S04T.mat            100%[===================>]  37.77M  7.19MB/s    in 10s     \n",
209
      "\n",
210
      "2018-12-06 23:52:48 (3.79 MB/s) - ‘S04T.mat’ saved [39607931/39607931]\n",
211
      "\n",
212
      "--2018-12-06 23:52:50--  http://bnci-horizon-2020.eu/database/data-sets/002-2014/S04E.mat\n",
213
      "Resolving bnci-horizon-2020.eu (bnci-horizon-2020.eu)... 91.227.204.35\n",
214
      "Connecting to bnci-horizon-2020.eu (bnci-horizon-2020.eu)|91.227.204.35|:80... connected.\n",
215
      "HTTP request sent, awaiting response... 302 Found\n",
216
      "Location: https://lampx.tugraz.at/~bci/database/002-2014/S04E.mat [following]\n",
217
      "--2018-12-06 23:52:50--  https://lampx.tugraz.at/~bci/database/002-2014/S04E.mat\n",
218
      "Resolving lampx.tugraz.at (lampx.tugraz.at)... 129.27.124.207\n",
219
      "Connecting to lampx.tugraz.at (lampx.tugraz.at)|129.27.124.207|:443... connected.\n",
220
      "HTTP request sent, awaiting response... 200 OK\n",
221
      "Length: 23752764 (23M)\n",
222
      "Saving to: ‘S04E.mat’\n",
223
      "\n",
224
      "S04E.mat            100%[===================>]  22.65M  3.88MB/s    in 8.8s    \n",
225
      "\n",
226
      "2018-12-06 23:53:00 (2.56 MB/s) - ‘S04E.mat’ saved [23752764/23752764]\n",
227
      "\n",
228
      "--2018-12-06 23:53:01--  http://bnci-horizon-2020.eu/database/data-sets/002-2014/S05T.mat\n",
229
      "Resolving bnci-horizon-2020.eu (bnci-horizon-2020.eu)... 91.227.204.35\n",
230
      "Connecting to bnci-horizon-2020.eu (bnci-horizon-2020.eu)|91.227.204.35|:80... connected.\n",
231
      "HTTP request sent, awaiting response... 302 Found\n",
232
      "Location: https://lampx.tugraz.at/~bci/database/002-2014/S05T.mat [following]\n",
233
      "--2018-12-06 23:53:02--  https://lampx.tugraz.at/~bci/database/002-2014/S05T.mat\n",
234
      "Resolving lampx.tugraz.at (lampx.tugraz.at)... 129.27.124.207\n",
235
      "Connecting to lampx.tugraz.at (lampx.tugraz.at)|129.27.124.207|:443... connected.\n",
236
      "HTTP request sent, awaiting response... 200 OK\n",
237
      "Length: 39091212 (37M)\n",
238
      "Saving to: ‘S05T.mat’\n",
239
      "\n",
240
      "S05T.mat            100%[===================>]  37.28M  7.07MB/s    in 11s     \n",
241
      "\n",
242
      "2018-12-06 23:53:13 (3.54 MB/s) - ‘S05T.mat’ saved [39091212/39091212]\n",
243
      "\n",
244
      "--2018-12-06 23:53:14--  http://bnci-horizon-2020.eu/database/data-sets/002-2014/S05E.mat\n",
245
      "Resolving bnci-horizon-2020.eu (bnci-horizon-2020.eu)... 91.227.204.35\n",
246
      "Connecting to bnci-horizon-2020.eu (bnci-horizon-2020.eu)|91.227.204.35|:80... connected.\n",
247
      "HTTP request sent, awaiting response... 302 Found\n",
248
      "Location: https://lampx.tugraz.at/~bci/database/002-2014/S05E.mat [following]\n",
249
      "--2018-12-06 23:53:15--  https://lampx.tugraz.at/~bci/database/002-2014/S05E.mat\n",
250
      "Resolving lampx.tugraz.at (lampx.tugraz.at)... 129.27.124.207\n",
251
      "Connecting to lampx.tugraz.at (lampx.tugraz.at)|129.27.124.207|:443... connected.\n",
252
      "HTTP request sent, awaiting response... 200 OK\n",
253
      "Length: 23628634 (23M)\n",
254
      "Saving to: ‘S05E.mat’\n",
255
      "\n",
256
      "S05E.mat            100%[===================>]  22.53M  3.85MB/s    in 10s     \n",
257
      "\n",
258
      "2018-12-06 23:53:26 (2.22 MB/s) - ‘S05E.mat’ saved [23628634/23628634]\n",
259
      "\n",
260
      "--2018-12-06 23:53:27--  http://bnci-horizon-2020.eu/database/data-sets/002-2014/S06T.mat\n",
261
      "Resolving bnci-horizon-2020.eu (bnci-horizon-2020.eu)... 91.227.204.35\n",
262
      "Connecting to bnci-horizon-2020.eu (bnci-horizon-2020.eu)|91.227.204.35|:80... connected.\n",
263
      "HTTP request sent, awaiting response... 302 Found\n",
264
      "Location: https://lampx.tugraz.at/~bci/database/002-2014/S06T.mat [following]\n",
265
      "--2018-12-06 23:53:27--  https://lampx.tugraz.at/~bci/database/002-2014/S06T.mat\n",
266
      "Resolving lampx.tugraz.at (lampx.tugraz.at)... 129.27.124.207\n",
267
      "Connecting to lampx.tugraz.at (lampx.tugraz.at)|129.27.124.207|:443... connected.\n",
268
      "HTTP request sent, awaiting response... 200 OK\n",
269
      "Length: 40027626 (38M)\n",
270
      "Saving to: ‘S06T.mat’\n",
271
      "\n",
272
      "S06T.mat            100%[===================>]  38.17M  8.20MB/s    in 11s     \n",
273
      "\n",
274
      "2018-12-06 23:53:40 (3.38 MB/s) - ‘S06T.mat’ saved [40027626/40027626]\n",
275
      "\n",
276
      "--2018-12-06 23:53:42--  http://bnci-horizon-2020.eu/database/data-sets/002-2014/S06E.mat\n",
277
      "Resolving bnci-horizon-2020.eu (bnci-horizon-2020.eu)... 91.227.204.35\n",
278
      "Connecting to bnci-horizon-2020.eu (bnci-horizon-2020.eu)|91.227.204.35|:80... connected.\n",
279
      "HTTP request sent, awaiting response... 302 Found\n",
280
      "Location: https://lampx.tugraz.at/~bci/database/002-2014/S06E.mat [following]\n",
281
      "--2018-12-06 23:53:43--  https://lampx.tugraz.at/~bci/database/002-2014/S06E.mat\n",
282
      "Resolving lampx.tugraz.at (lampx.tugraz.at)... 129.27.124.207\n",
283
      "Connecting to lampx.tugraz.at (lampx.tugraz.at)|129.27.124.207|:443... connected.\n",
284
      "HTTP request sent, awaiting response... 200 OK\n",
285
      "Length: 23850651 (23M)\n",
286
      "Saving to: ‘S06E.mat’\n",
287
      "\n",
288
      "S06E.mat            100%[===================>]  22.75M  3.90MB/s    in 9.5s    \n",
289
      "\n",
290
      "2018-12-06 23:53:53 (2.39 MB/s) - ‘S06E.mat’ saved [23850651/23850651]\n",
291
      "\n",
292
      "--2018-12-06 23:53:54--  http://bnci-horizon-2020.eu/database/data-sets/002-2014/S07T.mat\n",
293
      "Resolving bnci-horizon-2020.eu (bnci-horizon-2020.eu)... 91.227.204.35\n",
294
      "Connecting to bnci-horizon-2020.eu (bnci-horizon-2020.eu)|91.227.204.35|:80... connected.\n",
295
      "HTTP request sent, awaiting response... 302 Found\n",
296
      "Location: https://lampx.tugraz.at/~bci/database/002-2014/S07T.mat [following]\n",
297
      "--2018-12-06 23:53:55--  https://lampx.tugraz.at/~bci/database/002-2014/S07T.mat\n",
298
      "Resolving lampx.tugraz.at (lampx.tugraz.at)... 129.27.124.207\n",
299
      "Connecting to lampx.tugraz.at (lampx.tugraz.at)|129.27.124.207|:443... connected.\n",
300
      "HTTP request sent, awaiting response... 200 OK\n",
301
      "Length: 40261257 (38M)\n",
302
      "Saving to: ‘S07T.mat’\n",
303
      "\n",
304
      "S07T.mat            100%[===================>]  38.40M  7.25MB/s    in 11s     \n",
305
      "\n",
306
      "2018-12-06 23:54:06 (3.63 MB/s) - ‘S07T.mat’ saved [40261257/40261257]\n",
307
      "\n",
308
      "--2018-12-06 23:54:07--  http://bnci-horizon-2020.eu/database/data-sets/002-2014/S07E.mat\n",
309
      "Resolving bnci-horizon-2020.eu (bnci-horizon-2020.eu)... 91.227.204.35\n",
310
      "Connecting to bnci-horizon-2020.eu (bnci-horizon-2020.eu)|91.227.204.35|:80... connected.\n",
311
      "HTTP request sent, awaiting response... 302 Found\n",
312
      "Location: https://lampx.tugraz.at/~bci/database/002-2014/S07E.mat [following]\n",
313
      "--2018-12-06 23:54:08--  https://lampx.tugraz.at/~bci/database/002-2014/S07E.mat\n",
314
      "Resolving lampx.tugraz.at (lampx.tugraz.at)... 129.27.124.207\n",
315
      "Connecting to lampx.tugraz.at (lampx.tugraz.at)|129.27.124.207|:443... connected.\n",
316
      "HTTP request sent, awaiting response... 200 OK\n",
317
      "Length: 23997847 (23M)\n",
318
      "Saving to: ‘S07E.mat’\n",
319
      "\n",
320
      "S07E.mat            100%[===================>]  22.89M  3.89MB/s    in 9.7s    \n",
321
      "\n",
322
      "2018-12-06 23:54:19 (2.36 MB/s) - ‘S07E.mat’ saved [23997847/23997847]\n",
323
      "\n",
324
      "--2018-12-06 23:54:20--  http://bnci-horizon-2020.eu/database/data-sets/002-2014/S08T.mat\n",
325
      "Resolving bnci-horizon-2020.eu (bnci-horizon-2020.eu)... 91.227.204.35\n",
326
      "Connecting to bnci-horizon-2020.eu (bnci-horizon-2020.eu)|91.227.204.35|:80... connected.\n",
327
      "HTTP request sent, awaiting response... 302 Found\n",
328
      "Location: https://lampx.tugraz.at/~bci/database/002-2014/S08T.mat [following]\n",
329
      "--2018-12-06 23:54:20--  https://lampx.tugraz.at/~bci/database/002-2014/S08T.mat\n",
330
      "Resolving lampx.tugraz.at (lampx.tugraz.at)... 129.27.124.207\n",
331
      "Connecting to lampx.tugraz.at (lampx.tugraz.at)|129.27.124.207|:443... connected.\n",
332
      "HTTP request sent, awaiting response... 200 OK\n",
333
      "Length: 39735612 (38M)\n",
334
      "Saving to: ‘S08T.mat’\n",
335
      "\n",
336
      "S08T.mat            100%[===================>]  37.89M  5.59MB/s    in 13s     \n",
337
      "\n",
338
      "2018-12-06 23:54:34 (2.99 MB/s) - ‘S08T.mat’ saved [39735612/39735612]\n",
339
      "\n",
340
      "--2018-12-06 23:54:35--  http://bnci-horizon-2020.eu/database/data-sets/002-2014/S08E.mat\n",
341
      "Resolving bnci-horizon-2020.eu (bnci-horizon-2020.eu)... 91.227.204.35\n",
342
      "Connecting to bnci-horizon-2020.eu (bnci-horizon-2020.eu)|91.227.204.35|:80... connected.\n",
343
      "HTTP request sent, awaiting response... 302 Found\n",
344
      "Location: https://lampx.tugraz.at/~bci/database/002-2014/S08E.mat [following]\n",
345
      "--2018-12-06 23:54:35--  https://lampx.tugraz.at/~bci/database/002-2014/S08E.mat\n",
346
      "Resolving lampx.tugraz.at (lampx.tugraz.at)... 129.27.124.207\n",
347
      "Connecting to lampx.tugraz.at (lampx.tugraz.at)|129.27.124.207|:443... connected.\n",
348
      "HTTP request sent, awaiting response... 200 OK\n",
349
      "Length: 23791571 (23M)\n",
350
      "Saving to: ‘S08E.mat’\n",
351
      "\n",
352
      "S08E.mat            100%[===================>]  22.69M  3.96MB/s    in 9.5s    \n",
353
      "\n",
354
      "2018-12-06 23:54:46 (2.40 MB/s) - ‘S08E.mat’ saved [23791571/23791571]\n",
355
      "\n",
356
      "--2018-12-06 23:54:47--  http://bnci-horizon-2020.eu/database/data-sets/002-2014/S09T.mat\n",
357
      "Resolving bnci-horizon-2020.eu (bnci-horizon-2020.eu)... 91.227.204.35\n",
358
      "Connecting to bnci-horizon-2020.eu (bnci-horizon-2020.eu)|91.227.204.35|:80... connected.\n",
359
      "HTTP request sent, awaiting response... 302 Found\n",
360
      "Location: https://lampx.tugraz.at/~bci/database/002-2014/S09T.mat [following]\n",
361
      "--2018-12-06 23:54:47--  https://lampx.tugraz.at/~bci/database/002-2014/S09T.mat\n",
362
      "Resolving lampx.tugraz.at (lampx.tugraz.at)... 129.27.124.207\n",
363
      "Connecting to lampx.tugraz.at (lampx.tugraz.at)|129.27.124.207|:443... connected.\n",
364
      "HTTP request sent, awaiting response... 200 OK\n",
365
      "Length: 39805150 (38M)\n",
366
      "Saving to: ‘S09T.mat’\n",
367
      "\n",
368
      "S09T.mat            100%[===================>]  37.96M  7.31MB/s    in 11s     \n",
369
      "\n",
370
      "2018-12-06 23:54:59 (3.46 MB/s) - ‘S09T.mat’ saved [39805150/39805150]\n",
371
      "\n",
372
      "--2018-12-06 23:55:00--  http://bnci-horizon-2020.eu/database/data-sets/002-2014/S09E.mat\n",
373
      "Resolving bnci-horizon-2020.eu (bnci-horizon-2020.eu)... 91.227.204.35\n",
374
      "Connecting to bnci-horizon-2020.eu (bnci-horizon-2020.eu)|91.227.204.35|:80... connected.\n",
375
      "HTTP request sent, awaiting response... 302 Found\n",
376
      "Location: https://lampx.tugraz.at/~bci/database/002-2014/S09E.mat [following]\n",
377
      "--2018-12-06 23:55:01--  https://lampx.tugraz.at/~bci/database/002-2014/S09E.mat\n",
378
      "Resolving lampx.tugraz.at (lampx.tugraz.at)... 129.27.124.207\n",
379
      "Connecting to lampx.tugraz.at (lampx.tugraz.at)|129.27.124.207|:443... connected.\n",
380
      "HTTP request sent, awaiting response... 200 OK\n",
381
      "Length: 23610622 (23M)\n",
382
      "Saving to: ‘S09E.mat’\n",
383
      "\n",
384
      "S09E.mat            100%[===================>]  22.52M  3.96MB/s    in 9.4s    \n",
385
      "\n",
386
      "2018-12-06 23:55:11 (2.39 MB/s) - ‘S09E.mat’ saved [23610622/23610622]\n",
387
      "\n",
388
      "--2018-12-06 23:55:12--  http://bnci-horizon-2020.eu/database/data-sets/002-2014/S10T.mat\n",
389
      "Resolving bnci-horizon-2020.eu (bnci-horizon-2020.eu)... 91.227.204.35\n",
390
      "Connecting to bnci-horizon-2020.eu (bnci-horizon-2020.eu)|91.227.204.35|:80... connected.\n",
391
      "HTTP request sent, awaiting response... 302 Found\n",
392
      "Location: https://lampx.tugraz.at/~bci/database/002-2014/S10T.mat [following]\n",
393
      "--2018-12-06 23:55:13--  https://lampx.tugraz.at/~bci/database/002-2014/S10T.mat\n",
394
      "Resolving lampx.tugraz.at (lampx.tugraz.at)... 129.27.124.207\n",
395
      "Connecting to lampx.tugraz.at (lampx.tugraz.at)|129.27.124.207|:443... connected.\n",
396
      "HTTP request sent, awaiting response... 200 OK\n",
397
      "Length: 39871971 (38M)\n",
398
      "Saving to: ‘S10T.mat’\n",
399
      "\n",
400
      "S10T.mat            100%[===================>]  38.02M  3.44MB/s    in 17s     \n",
401
      "\n",
402
      "2018-12-06 23:55:31 (2.22 MB/s) - ‘S10T.mat’ saved [39871971/39871971]\n",
403
      "\n",
404
      "--2018-12-06 23:55:32--  http://bnci-horizon-2020.eu/database/data-sets/002-2014/S10E.mat\n",
405
      "Resolving bnci-horizon-2020.eu (bnci-horizon-2020.eu)... 91.227.204.35\n",
406
      "Connecting to bnci-horizon-2020.eu (bnci-horizon-2020.eu)|91.227.204.35|:80... connected.\n",
407
      "HTTP request sent, awaiting response... 302 Found\n",
408
      "Location: https://lampx.tugraz.at/~bci/database/002-2014/S10E.mat [following]\n",
409
      "--2018-12-06 23:55:32--  https://lampx.tugraz.at/~bci/database/002-2014/S10E.mat\n",
410
      "Resolving lampx.tugraz.at (lampx.tugraz.at)... 129.27.124.207\n",
411
      "Connecting to lampx.tugraz.at (lampx.tugraz.at)|129.27.124.207|:443... connected.\n",
412
      "HTTP request sent, awaiting response... 200 OK\n",
413
      "Length: 23750112 (23M)\n",
414
      "Saving to: ‘S10E.mat’\n",
415
      "\n",
416
      "S10E.mat            100%[===================>]  22.65M  3.88MB/s    in 9.4s    \n",
417
      "\n",
418
      "2018-12-06 23:55:43 (2.42 MB/s) - ‘S10E.mat’ saved [23750112/23750112]\n",
419
      "\n",
420
      "--2018-12-06 23:55:43--  http://bnci-horizon-2020.eu/database/data-sets/002-2014/S11T.mat\n",
421
      "Resolving bnci-horizon-2020.eu (bnci-horizon-2020.eu)... 91.227.204.35\n",
422
      "Connecting to bnci-horizon-2020.eu (bnci-horizon-2020.eu)|91.227.204.35|:80... connected.\n",
423
      "HTTP request sent, awaiting response... 302 Found\n",
424
      "Location: https://lampx.tugraz.at/~bci/database/002-2014/S11T.mat [following]\n",
425
      "--2018-12-06 23:55:44--  https://lampx.tugraz.at/~bci/database/002-2014/S11T.mat\n",
426
      "Resolving lampx.tugraz.at (lampx.tugraz.at)... 129.27.124.207\n",
427
      "Connecting to lampx.tugraz.at (lampx.tugraz.at)|129.27.124.207|:443... connected.\n",
428
      "HTTP request sent, awaiting response... 200 OK\n",
429
      "Length: 40140184 (38M)\n",
430
      "Saving to: ‘S11T.mat’\n",
431
      "\n",
432
      "S11T.mat            100%[===================>]  38.28M  3.33MB/s    in 24s     \n",
433
      "\n",
434
      "2018-12-06 23:56:09 (1.58 MB/s) - ‘S11T.mat’ saved [40140184/40140184]\n",
435
      "\n",
436
      "--2018-12-06 23:56:10--  http://bnci-horizon-2020.eu/database/data-sets/002-2014/S11E.mat\n",
437
      "Resolving bnci-horizon-2020.eu (bnci-horizon-2020.eu)... 91.227.204.35\n",
438
      "Connecting to bnci-horizon-2020.eu (bnci-horizon-2020.eu)|91.227.204.35|:80... connected.\n",
439
      "HTTP request sent, awaiting response... 302 Found\n",
440
      "Location: https://lampx.tugraz.at/~bci/database/002-2014/S11E.mat [following]\n",
441
      "--2018-12-06 23:56:11--  https://lampx.tugraz.at/~bci/database/002-2014/S11E.mat\n",
442
      "Resolving lampx.tugraz.at (lampx.tugraz.at)... 129.27.124.207\n",
443
      "Connecting to lampx.tugraz.at (lampx.tugraz.at)|129.27.124.207|:443... connected.\n",
444
      "HTTP request sent, awaiting response... 200 OK\n",
445
      "Length: 24171700 (23M)\n",
446
      "Saving to: ‘S11E.mat’\n",
447
      "\n",
448
      "S11E.mat            100%[===================>]  23.05M  3.95MB/s    in 10s     \n",
449
      "\n",
450
      "2018-12-06 23:56:22 (2.23 MB/s) - ‘S11E.mat’ saved [24171700/24171700]\n",
451
      "\n",
452
      "--2018-12-06 23:56:23--  http://bnci-horizon-2020.eu/database/data-sets/002-2014/S12T.mat\n",
453
      "Resolving bnci-horizon-2020.eu (bnci-horizon-2020.eu)... 91.227.204.35\n",
454
      "Connecting to bnci-horizon-2020.eu (bnci-horizon-2020.eu)|91.227.204.35|:80... connected.\n",
455
      "HTTP request sent, awaiting response... 302 Found\n",
456
      "Location: https://lampx.tugraz.at/~bci/database/002-2014/S12T.mat [following]\n",
457
      "--2018-12-06 23:56:24--  https://lampx.tugraz.at/~bci/database/002-2014/S12T.mat\n",
458
      "Resolving lampx.tugraz.at (lampx.tugraz.at)... 129.27.124.207\n",
459
      "Connecting to lampx.tugraz.at (lampx.tugraz.at)|129.27.124.207|:443... connected.\n",
460
      "HTTP request sent, awaiting response... 200 OK\n",
461
      "Length: 40093093 (38M)\n",
462
      "Saving to: ‘S12T.mat’\n",
463
      "\n",
464
      "S12T.mat            100%[===================>]  38.24M  7.46MB/s    in 11s     \n",
465
      "\n",
466
      "2018-12-06 23:56:35 (3.60 MB/s) - ‘S12T.mat’ saved [40093093/40093093]\n",
467
      "\n",
468
      "--2018-12-06 23:56:36--  http://bnci-horizon-2020.eu/database/data-sets/002-2014/S12E.mat\n",
469
      "Resolving bnci-horizon-2020.eu (bnci-horizon-2020.eu)... 91.227.204.35\n",
470
      "Connecting to bnci-horizon-2020.eu (bnci-horizon-2020.eu)|91.227.204.35|:80... connected.\n",
471
      "HTTP request sent, awaiting response... 302 Found\n",
472
      "Location: https://lampx.tugraz.at/~bci/database/002-2014/S12E.mat [following]\n",
473
      "--2018-12-06 23:56:37--  https://lampx.tugraz.at/~bci/database/002-2014/S12E.mat\n",
474
      "Resolving lampx.tugraz.at (lampx.tugraz.at)... 129.27.124.207\n",
475
      "Connecting to lampx.tugraz.at (lampx.tugraz.at)|129.27.124.207|:443... connected.\n",
476
      "HTTP request sent, awaiting response... 200 OK\n",
477
      "Length: 23905075 (23M)\n",
478
      "Saving to: ‘S12E.mat’\n",
479
      "\n",
480
      "S12E.mat            100%[===================>]  22.80M  3.92MB/s    in 10s     \n",
481
      "\n",
482
      "2018-12-06 23:56:48 (2.26 MB/s) - ‘S12E.mat’ saved [23905075/23905075]\n",
483
      "\n",
484
      "--2018-12-06 23:56:49--  http://bnci-horizon-2020.eu/database/data-sets/002-2014/S13T.mat\n",
485
      "Resolving bnci-horizon-2020.eu (bnci-horizon-2020.eu)... 91.227.204.35\n",
486
      "Connecting to bnci-horizon-2020.eu (bnci-horizon-2020.eu)|91.227.204.35|:80... connected.\n",
487
      "HTTP request sent, awaiting response... 302 Found\n",
488
      "Location: https://lampx.tugraz.at/~bci/database/002-2014/S13T.mat [following]\n",
489
      "--2018-12-06 23:56:49--  https://lampx.tugraz.at/~bci/database/002-2014/S13T.mat\n",
490
      "Resolving lampx.tugraz.at (lampx.tugraz.at)... 129.27.124.207\n",
491
      "Connecting to lampx.tugraz.at (lampx.tugraz.at)|129.27.124.207|:443... connected.\n",
492
      "HTTP request sent, awaiting response... 200 OK\n",
493
      "Length: 39819174 (38M)\n",
494
      "Saving to: ‘S13T.mat’\n",
495
      "\n",
496
      "S13T.mat            100%[===================>]  37.97M  7.05MB/s    in 11s     \n",
497
      "\n",
498
      "2018-12-06 23:57:01 (3.57 MB/s) - ‘S13T.mat’ saved [39819174/39819174]\n",
499
      "\n",
500
      "--2018-12-06 23:57:02--  http://bnci-horizon-2020.eu/database/data-sets/002-2014/S13E.mat\n",
501
      "Resolving bnci-horizon-2020.eu (bnci-horizon-2020.eu)... 91.227.204.35\n",
502
      "Connecting to bnci-horizon-2020.eu (bnci-horizon-2020.eu)|91.227.204.35|:80... connected.\n",
503
      "HTTP request sent, awaiting response... 302 Found\n",
504
      "Location: https://lampx.tugraz.at/~bci/database/002-2014/S13E.mat [following]\n",
505
      "--2018-12-06 23:57:02--  https://lampx.tugraz.at/~bci/database/002-2014/S13E.mat\n",
506
      "Resolving lampx.tugraz.at (lampx.tugraz.at)... 129.27.124.207\n",
507
      "Connecting to lampx.tugraz.at (lampx.tugraz.at)|129.27.124.207|:443... connected.\n",
508
      "HTTP request sent, awaiting response... 200 OK\n",
509
      "Length: 23669359 (23M)\n",
510
      "Saving to: ‘S13E.mat’\n",
511
      "\n",
512
      "S13E.mat            100%[===================>]  22.57M  3.94MB/s    in 9.7s    \n",
513
      "\n",
514
      "2018-12-06 23:57:13 (2.33 MB/s) - ‘S13E.mat’ saved [23669359/23669359]\n",
515
      "\n",
516
      "--2018-12-06 23:57:14--  http://bnci-horizon-2020.eu/database/data-sets/002-2014/S14T.mat\n",
517
      "Resolving bnci-horizon-2020.eu (bnci-horizon-2020.eu)... 91.227.204.35\n",
518
      "Connecting to bnci-horizon-2020.eu (bnci-horizon-2020.eu)|91.227.204.35|:80... connected.\n",
519
      "HTTP request sent, awaiting response... 302 Found\n",
520
      "Location: https://lampx.tugraz.at/~bci/database/002-2014/S14T.mat [following]\n",
521
      "--2018-12-06 23:57:15--  https://lampx.tugraz.at/~bci/database/002-2014/S14T.mat\n",
522
      "Resolving lampx.tugraz.at (lampx.tugraz.at)... 129.27.124.207\n",
523
      "Connecting to lampx.tugraz.at (lampx.tugraz.at)|129.27.124.207|:443... connected.\n",
524
      "HTTP request sent, awaiting response... 200 OK\n",
525
      "Length: 39859134 (38M)\n",
526
      "Saving to: ‘S14T.mat’\n",
527
      "\n",
528
      "S14T.mat            100%[===================>]  38.01M  6.97MB/s    in 12s     \n",
529
      "\n",
530
      "2018-12-06 23:57:28 (3.25 MB/s) - ‘S14T.mat’ saved [39859134/39859134]\n",
531
      "\n",
532
      "--2018-12-06 23:57:29--  http://bnci-horizon-2020.eu/database/data-sets/002-2014/S14E.mat\n",
533
      "Resolving bnci-horizon-2020.eu (bnci-horizon-2020.eu)... 91.227.204.35\n",
534
      "Connecting to bnci-horizon-2020.eu (bnci-horizon-2020.eu)|91.227.204.35|:80... connected.\n",
535
      "HTTP request sent, awaiting response... 302 Found\n",
536
      "Location: https://lampx.tugraz.at/~bci/database/002-2014/S14E.mat [following]\n",
537
      "--2018-12-06 23:57:29--  https://lampx.tugraz.at/~bci/database/002-2014/S14E.mat\n",
538
      "Resolving lampx.tugraz.at (lampx.tugraz.at)... 129.27.124.207\n",
539
      "Connecting to lampx.tugraz.at (lampx.tugraz.at)|129.27.124.207|:443... connected.\n",
540
      "HTTP request sent, awaiting response... 200 OK\n",
541
      "Length: 23970887 (23M)\n",
542
      "Saving to: ‘S14E.mat’\n",
543
      "\n",
544
      "S14E.mat            100%[===================>]  22.86M  3.95MB/s    in 9.3s    \n",
545
      "\n",
546
      "2018-12-06 23:57:40 (2.46 MB/s) - ‘S14E.mat’ saved [23970887/23970887]\n",
547
      "\n",
548
      "tcmalloc: large alloc 1073750016 bytes == 0x5bf96000 @  0x7f2fcd6b42a4 0x591a07 0x5b5d56 0x502e9a 0x506859 0x502209 0x502f3d 0x506859 0x504c28 0x502540 0x502f3d 0x506859 0x504c28 0x502540 0x502f3d 0x506859 0x504c28 0x502540 0x502f3d 0x507641 0x502209 0x502f3d 0x506859 0x504c28 0x502540 0x502f3d 0x507641 0x504c28 0x502540 0x502f3d 0x507641\n",
549
      "\n",
550
      "(2240, 15, 3584)\n",
551
      "(2240,)\n"
552
     ]
553
    }
554
   ],
555
   "source": [
556
    "#\n",
557
    "# Download the whole BNCI 002-2014 dataset\n",
558
    "#\n",
559
    "!wget http://bnci-horizon-2020.eu/database/data-sets/002-2014/S01T.mat\n",
560
    "!wget http://bnci-horizon-2020.eu/database/data-sets/002-2014/S01E.mat\n",
561
    "!wget http://bnci-horizon-2020.eu/database/data-sets/002-2014/S02T.mat\n",
562
    "!wget http://bnci-horizon-2020.eu/database/data-sets/002-2014/S02E.mat\n",
563
    "!wget http://bnci-horizon-2020.eu/database/data-sets/002-2014/S03T.mat\n",
564
    "!wget http://bnci-horizon-2020.eu/database/data-sets/002-2014/S03E.mat\n",
565
    "!wget http://bnci-horizon-2020.eu/database/data-sets/002-2014/S04T.mat\n",
566
    "!wget http://bnci-horizon-2020.eu/database/data-sets/002-2014/S04E.mat\n",
567
    "!wget http://bnci-horizon-2020.eu/database/data-sets/002-2014/S05T.mat\n",
568
    "!wget http://bnci-horizon-2020.eu/database/data-sets/002-2014/S05E.mat\n",
569
    "!wget http://bnci-horizon-2020.eu/database/data-sets/002-2014/S06T.mat\n",
570
    "!wget http://bnci-horizon-2020.eu/database/data-sets/002-2014/S06E.mat\n",
571
    "!wget http://bnci-horizon-2020.eu/database/data-sets/002-2014/S07T.mat\n",
572
    "!wget http://bnci-horizon-2020.eu/database/data-sets/002-2014/S07E.mat\n",
573
    "!wget http://bnci-horizon-2020.eu/database/data-sets/002-2014/S08T.mat\n",
574
    "!wget http://bnci-horizon-2020.eu/database/data-sets/002-2014/S08E.mat\n",
575
    "!wget http://bnci-horizon-2020.eu/database/data-sets/002-2014/S09T.mat\n",
576
    "!wget http://bnci-horizon-2020.eu/database/data-sets/002-2014/S09E.mat\n",
577
    "!wget http://bnci-horizon-2020.eu/database/data-sets/002-2014/S10T.mat\n",
578
    "!wget http://bnci-horizon-2020.eu/database/data-sets/002-2014/S10E.mat\n",
579
    "!wget http://bnci-horizon-2020.eu/database/data-sets/002-2014/S11T.mat\n",
580
    "!wget http://bnci-horizon-2020.eu/database/data-sets/002-2014/S11E.mat\n",
581
    "!wget http://bnci-horizon-2020.eu/database/data-sets/002-2014/S12T.mat\n",
582
    "!wget http://bnci-horizon-2020.eu/database/data-sets/002-2014/S12E.mat\n",
583
    "!wget http://bnci-horizon-2020.eu/database/data-sets/002-2014/S13T.mat\n",
584
    "!wget http://bnci-horizon-2020.eu/database/data-sets/002-2014/S13E.mat\n",
585
    "!wget http://bnci-horizon-2020.eu/database/data-sets/002-2014/S14T.mat\n",
586
    "!wget http://bnci-horizon-2020.eu/database/data-sets/002-2014/S14E.mat\n",
587
    "\n",
588
    "# move files into a dedicated folder\n",
589
    "!mkdir BBCIData\n",
590
    "!mv *.mat BBCIData\n",
591
    "\n",
592
    "#install brain decode\n",
593
    "!pip install braindecode -q\n",
594
    "\n",
595
    "# install pytorch\n",
596
    "# ref: http://pytorch.org/\n",
597
    "from os import path\n",
598
    "from wheel.pep425tags import get_abbr_impl, get_impl_ver, get_abi_tag\n",
599
    "platform = '{}{}-{}'.format(get_abbr_impl(), get_impl_ver(), get_abi_tag())\n",
600
    "\n",
601
    "accelerator = 'cu80' if path.exists('/opt/bin/nvidia-smi') else 'cpu'\n",
602
    "\n",
603
    "#!pip install -q http://download.pytorch.org/whl/{accelerator}/torch-0.3.0.post4-{platform}-linux_x86_64.whl torchvision\n",
604
    "!pip install -q http://download.pytorch.org/whl/{accelerator}/torch-0.4.0-{platform}-linux_x86_64.whl torchvision\n",
605
    "#  cu91/torch-0.4.0-cp36-cp36m-linux_x86_64.whl\n",
606
    "import torch\n",
607
    "\n",
608
    "import scipy.io as sio\n",
609
    "import numpy as np\n",
610
    "from os import listdir\n",
611
    "from os.path import isfile, join\n",
612
    "\n",
613
    "# prepare data containers\n",
614
    "y = []\n",
615
    "X = []\n",
616
    "\n",
617
    "\"\"\"\n",
618
    "Now, let's load data.\n",
619
    "\n",
620
    "We read the file for the desired subject, and parse the data to extract:\n",
621
    "- samplingRate\n",
622
    "- trialLength\n",
623
    "- X, a M x N x K matrix, which stands for trial x chan x samples\n",
624
    "    - the actual values are 160 x 15 x 2560\n",
625
    "- y, a M vector containing the labels {0,1}\n",
626
    "\n",
627
    "ref: Dataset description: https://lampx.tugraz.at/~bci/database/002-2014/description.pdf\n",
628
    "\"\"\"\n",
629
    "\n",
630
    "folder = \"BBCIData\"\n",
631
    "\n",
632
    "for f in listdir(folder):\n",
633
    "    # read file\n",
634
    "    d1T = sio.loadmat(folder + \"/\" + f)\n",
635
    "    \n",
636
    "    samplingRate = d1T['data'][0][0][0][0][3][0][0]\n",
637
    "    trialLength = 7*samplingRate\n",
638
    "\n",
639
    "    # run through all training runs\n",
640
    "    for run in range(len(d1T['data'][0])):\n",
641
    "        y.append(d1T['data'][0][run][0][0][2][0]) # labels\n",
642
    "        timestamps = d1T['data'][0][run][0][0][1][0] # timestamps\n",
643
    "        rawData = d1T['data'][0][run][0][0][0].transpose() # chan x data\n",
644
    "\n",
645
    "        # parse out data based on timestamps\n",
646
    "        for start in timestamps:\n",
647
    "            end = start + trialLength\n",
648
    "            X.append(rawData[:,start:end]) #15 x 2560\n",
649
    "\n",
650
    "    del rawData\n",
651
    "    del d1T\n",
652
    "\n",
653
    "# arrange data into num7py arrays\n",
654
    "# also torch expect float32 for samples\n",
655
    "# and int64 for labels {0,1}\n",
656
    "X = np.array(X).astype(np.float32)\n",
657
    "y = (np.array(y).flatten()-1).astype(np.int64)\n",
658
    "print()\n",
659
    "print(X.shape)\n",
660
    "print(y.shape)\n",
661
    "\n",
662
    "\n",
663
    "# rand permute dataset\n",
664
    "idx = np.random.permutation(X.shape[0])\n",
665
    "\n",
666
    "X = X[idx,:,:]\n",
667
    "y = y[idx]"
668
   ]
669
  },
670
  {
671
   "cell_type": "code",
672
   "execution_count": 0,
673
   "metadata": {
674
    "colab": {
675
     "base_uri": "https://localhost:8080/",
676
     "height": 5168
677
    },
678
    "colab_type": "code",
679
    "id": "6PUAO5bSPfN3",
680
    "outputId": "3ea68044-ddfd-4de8-b6b7-f08939a490f3"
681
   },
682
   "outputs": [
683
    {
684
     "name": "stdout",
685
     "output_type": "stream",
686
     "text": [
687
      "Epoch 0\n",
688
      "Train  Loss: 2.08115\n",
689
      "Train  Accuracy: 49.6%\n",
690
      "Test   Loss: 2.04731\n",
691
      "Test   Accuracy: 52.1%\n",
692
      "Epoch 1\n",
693
      "Train  Loss: 0.75969\n",
694
      "Train  Accuracy: 50.4%\n",
695
      "Test   Loss: 0.75388\n",
696
      "Test   Accuracy: 53.2%\n",
697
      "Epoch 2\n",
698
      "Train  Loss: 1.25856\n",
699
      "Train  Accuracy: 49.6%\n",
700
      "Test   Loss: 1.23456\n",
701
      "Test   Accuracy: 52.1%\n",
702
      "Epoch 3\n",
703
      "Train  Loss: 0.70035\n",
704
      "Train  Accuracy: 56.2%\n",
705
      "Test   Loss: 0.72591\n",
706
      "Test   Accuracy: 53.9%\n",
707
      "Epoch 4\n",
708
      "Train  Loss: 0.69096\n",
709
      "Train  Accuracy: 55.5%\n",
710
      "Test   Loss: 0.72498\n",
711
      "Test   Accuracy: 51.1%\n",
712
      "Epoch 5\n",
713
      "Train  Loss: 0.67922\n",
714
      "Train  Accuracy: 56.9%\n",
715
      "Test   Loss: 0.72395\n",
716
      "Test   Accuracy: 52.5%\n",
717
      "Epoch 6\n",
718
      "Train  Loss: 0.68005\n",
719
      "Train  Accuracy: 56.7%\n",
720
      "Test   Loss: 0.72818\n",
721
      "Test   Accuracy: 50.4%\n",
722
      "Epoch 7\n",
723
      "Train  Loss: 0.66926\n",
724
      "Train  Accuracy: 58.4%\n",
725
      "Test   Loss: 0.70863\n",
726
      "Test   Accuracy: 52.9%\n",
727
      "Epoch 8\n",
728
      "Train  Loss: 0.65986\n",
729
      "Train  Accuracy: 60.5%\n",
730
      "Test   Loss: 0.69376\n",
731
      "Test   Accuracy: 50.7%\n",
732
      "Epoch 9\n",
733
      "Train  Loss: 0.65886\n",
734
      "Train  Accuracy: 60.8%\n",
735
      "Test   Loss: 0.70577\n",
736
      "Test   Accuracy: 50.7%\n",
737
      "Epoch 10\n",
738
      "Train  Loss: 0.73277\n",
739
      "Train  Accuracy: 52.5%\n",
740
      "Test   Loss: 0.80172\n",
741
      "Test   Accuracy: 48.9%\n",
742
      "Epoch 11\n",
743
      "Train  Loss: 0.68138\n",
744
      "Train  Accuracy: 57.2%\n",
745
      "Test   Loss: 0.73720\n",
746
      "Test   Accuracy: 52.1%\n",
747
      "Epoch 12\n",
748
      "Train  Loss: 0.72220\n",
749
      "Train  Accuracy: 53.3%\n",
750
      "Test   Loss: 0.75291\n",
751
      "Test   Accuracy: 51.8%\n",
752
      "Epoch 13\n",
753
      "Train  Loss: 0.60971\n",
754
      "Train  Accuracy: 66.5%\n",
755
      "Test   Loss: 0.66757\n",
756
      "Test   Accuracy: 58.6%\n",
757
      "Epoch 14\n",
758
      "Train  Loss: 0.58040\n",
759
      "Train  Accuracy: 69.1%\n",
760
      "Test   Loss: 0.63830\n",
761
      "Test   Accuracy: 63.6%\n",
762
      "Epoch 15\n",
763
      "Train  Loss: 0.79680\n",
764
      "Train  Accuracy: 58.9%\n",
765
      "Test   Loss: 0.88658\n",
766
      "Test   Accuracy: 55.7%\n",
767
      "Epoch 16\n",
768
      "Train  Loss: 0.54808\n",
769
      "Train  Accuracy: 71.7%\n",
770
      "Test   Loss: 0.60998\n",
771
      "Test   Accuracy: 66.1%\n",
772
      "Epoch 17\n",
773
      "Train  Loss: 0.54252\n",
774
      "Train  Accuracy: 71.9%\n",
775
      "Test   Loss: 0.60957\n",
776
      "Test   Accuracy: 66.4%\n",
777
      "Epoch 18\n",
778
      "Train  Loss: 0.51975\n",
779
      "Train  Accuracy: 74.1%\n",
780
      "Test   Loss: 0.58788\n",
781
      "Test   Accuracy: 66.8%\n",
782
      "Epoch 19\n",
783
      "Train  Loss: 0.59082\n",
784
      "Train  Accuracy: 65.0%\n",
785
      "Test   Loss: 0.65070\n",
786
      "Test   Accuracy: 60.7%\n",
787
      "Epoch 20\n",
788
      "Train  Loss: 0.60372\n",
789
      "Train  Accuracy: 64.6%\n",
790
      "Test   Loss: 0.65467\n",
791
      "Test   Accuracy: 62.9%\n",
792
      "Epoch 21\n",
793
      "Train  Loss: 0.50760\n",
794
      "Train  Accuracy: 74.5%\n",
795
      "Test   Loss: 0.58017\n",
796
      "Test   Accuracy: 70.7%\n",
797
      "Epoch 22\n",
798
      "Train  Loss: 0.51147\n",
799
      "Train  Accuracy: 73.1%\n",
800
      "Test   Loss: 0.58066\n",
801
      "Test   Accuracy: 67.5%\n",
802
      "Epoch 23\n",
803
      "Train  Loss: 0.48559\n",
804
      "Train  Accuracy: 77.7%\n",
805
      "Test   Loss: 0.58163\n",
806
      "Test   Accuracy: 69.3%\n",
807
      "Epoch 24\n",
808
      "Train  Loss: 0.47749\n",
809
      "Train  Accuracy: 77.8%\n",
810
      "Test   Loss: 0.56588\n",
811
      "Test   Accuracy: 70.0%\n",
812
      "Epoch 25\n",
813
      "Train  Loss: 0.52517\n",
814
      "Train  Accuracy: 72.2%\n",
815
      "Test   Loss: 0.62275\n",
816
      "Test   Accuracy: 64.6%\n",
817
      "Epoch 26\n",
818
      "Train  Loss: 0.47597\n",
819
      "Train  Accuracy: 77.8%\n",
820
      "Test   Loss: 0.57183\n",
821
      "Test   Accuracy: 69.3%\n",
822
      "Epoch 27\n",
823
      "Train  Loss: 1.09261\n",
824
      "Train  Accuracy: 60.1%\n",
825
      "Test   Loss: 1.26858\n",
826
      "Test   Accuracy: 55.0%\n",
827
      "Epoch 28\n",
828
      "Train  Loss: 0.47144\n",
829
      "Train  Accuracy: 78.5%\n",
830
      "Test   Loss: 0.59414\n",
831
      "Test   Accuracy: 67.1%\n",
832
      "Epoch 29\n",
833
      "Train  Loss: 0.46306\n",
834
      "Train  Accuracy: 78.4%\n",
835
      "Test   Loss: 0.57667\n",
836
      "Test   Accuracy: 69.3%\n",
837
      "Epoch 30\n",
838
      "Train  Loss: 0.45248\n",
839
      "Train  Accuracy: 79.9%\n",
840
      "Test   Loss: 0.58262\n",
841
      "Test   Accuracy: 68.6%\n",
842
      "Epoch 31\n",
843
      "Train  Loss: 0.77807\n",
844
      "Train  Accuracy: 65.4%\n",
845
      "Test   Loss: 0.92063\n",
846
      "Test   Accuracy: 61.4%\n",
847
      "Epoch 32\n",
848
      "Train  Loss: 0.47432\n",
849
      "Train  Accuracy: 75.5%\n",
850
      "Test   Loss: 0.57162\n",
851
      "Test   Accuracy: 70.0%\n",
852
      "Epoch 33\n",
853
      "Train  Loss: 0.46333\n",
854
      "Train  Accuracy: 77.9%\n",
855
      "Test   Loss: 0.58067\n",
856
      "Test   Accuracy: 69.6%\n",
857
      "Epoch 34\n",
858
      "Train  Loss: 0.44035\n",
859
      "Train  Accuracy: 80.1%\n",
860
      "Test   Loss: 0.58571\n",
861
      "Test   Accuracy: 68.9%\n",
862
      "Epoch 35\n",
863
      "Train  Loss: 0.45210\n",
864
      "Train  Accuracy: 79.2%\n",
865
      "Test   Loss: 0.56440\n",
866
      "Test   Accuracy: 70.4%\n",
867
      "Epoch 36\n",
868
      "Train  Loss: 0.49392\n",
869
      "Train  Accuracy: 74.8%\n",
870
      "Test   Loss: 0.59989\n",
871
      "Test   Accuracy: 68.6%\n",
872
      "Epoch 37\n",
873
      "Train  Loss: 0.51339\n",
874
      "Train  Accuracy: 74.3%\n",
875
      "Test   Loss: 0.63082\n",
876
      "Test   Accuracy: 68.6%\n",
877
      "Epoch 38\n",
878
      "Train  Loss: 0.43237\n",
879
      "Train  Accuracy: 80.3%\n",
880
      "Test   Loss: 0.56310\n",
881
      "Test   Accuracy: 68.9%\n",
882
      "Epoch 39\n",
883
      "Train  Loss: 0.43999\n",
884
      "Train  Accuracy: 80.1%\n",
885
      "Test   Loss: 0.55284\n",
886
      "Test   Accuracy: 70.7%\n",
887
      "Epoch 40\n",
888
      "Train  Loss: 0.50042\n",
889
      "Train  Accuracy: 74.8%\n",
890
      "Test   Loss: 0.59341\n",
891
      "Test   Accuracy: 70.7%\n",
892
      "Epoch 41\n",
893
      "Train  Loss: 0.71897\n",
894
      "Train  Accuracy: 61.5%\n",
895
      "Test   Loss: 0.81649\n",
896
      "Test   Accuracy: 59.6%\n",
897
      "Epoch 42\n",
898
      "Train  Loss: 0.47271\n",
899
      "Train  Accuracy: 75.2%\n",
900
      "Test   Loss: 0.56315\n",
901
      "Test   Accuracy: 70.4%\n",
902
      "Epoch 43\n",
903
      "Train  Loss: 0.41700\n",
904
      "Train  Accuracy: 81.6%\n",
905
      "Test   Loss: 0.55485\n",
906
      "Test   Accuracy: 72.5%\n",
907
      "Epoch 44\n",
908
      "Train  Loss: 0.84395\n",
909
      "Train  Accuracy: 58.4%\n",
910
      "Test   Loss: 0.91747\n",
911
      "Test   Accuracy: 56.8%\n",
912
      "Epoch 45\n",
913
      "Train  Loss: 0.42418\n",
914
      "Train  Accuracy: 80.1%\n",
915
      "Test   Loss: 0.56180\n",
916
      "Test   Accuracy: 70.0%\n",
917
      "Epoch 46\n",
918
      "Train  Loss: 0.41274\n",
919
      "Train  Accuracy: 81.2%\n",
920
      "Test   Loss: 0.54673\n",
921
      "Test   Accuracy: 68.9%\n",
922
      "Epoch 47\n",
923
      "Train  Loss: 0.83730\n",
924
      "Train  Accuracy: 57.0%\n",
925
      "Test   Loss: 0.87217\n",
926
      "Test   Accuracy: 57.1%\n",
927
      "Epoch 48\n",
928
      "Train  Loss: 0.44743\n",
929
      "Train  Accuracy: 77.1%\n",
930
      "Test   Loss: 0.55114\n",
931
      "Test   Accuracy: 71.8%\n",
932
      "Epoch 49\n",
933
      "Train  Loss: 0.41979\n",
934
      "Train  Accuracy: 80.4%\n",
935
      "Test   Loss: 0.57880\n",
936
      "Test   Accuracy: 68.2%\n",
937
      "Epoch 50\n",
938
      "Train  Loss: 0.40166\n",
939
      "Train  Accuracy: 82.7%\n",
940
      "Test   Loss: 0.55398\n",
941
      "Test   Accuracy: 71.1%\n",
942
      "Epoch 51\n",
943
      "Train  Loss: 0.85434\n",
944
      "Train  Accuracy: 59.0%\n",
945
      "Test   Loss: 0.95994\n",
946
      "Test   Accuracy: 57.1%\n",
947
      "Epoch 52\n",
948
      "Train  Loss: 0.42632\n",
949
      "Train  Accuracy: 80.4%\n",
950
      "Test   Loss: 0.57108\n",
951
      "Test   Accuracy: 71.4%\n",
952
      "Epoch 53\n",
953
      "Train  Loss: 0.99225\n",
954
      "Train  Accuracy: 55.3%\n",
955
      "Test   Loss: 1.05140\n",
956
      "Test   Accuracy: 55.4%\n",
957
      "Epoch 54\n",
958
      "Train  Loss: 0.40169\n",
959
      "Train  Accuracy: 81.6%\n",
960
      "Test   Loss: 0.56904\n",
961
      "Test   Accuracy: 68.2%\n",
962
      "Epoch 55\n",
963
      "Train  Loss: 0.39920\n",
964
      "Train  Accuracy: 82.2%\n",
965
      "Test   Loss: 0.59583\n",
966
      "Test   Accuracy: 69.6%\n",
967
      "Epoch 56\n",
968
      "Train  Loss: 0.51478\n",
969
      "Train  Accuracy: 71.3%\n",
970
      "Test   Loss: 0.65656\n",
971
      "Test   Accuracy: 65.4%\n",
972
      "Epoch 57\n",
973
      "Train  Loss: 0.39562\n",
974
      "Train  Accuracy: 82.7%\n",
975
      "Test   Loss: 0.60420\n",
976
      "Test   Accuracy: 68.9%\n",
977
      "Epoch 58\n",
978
      "Train  Loss: 0.45859\n",
979
      "Train  Accuracy: 76.2%\n",
980
      "Test   Loss: 0.59354\n",
981
      "Test   Accuracy: 70.0%\n",
982
      "Epoch 59\n",
983
      "Train  Loss: 0.53055\n",
984
      "Train  Accuracy: 70.7%\n",
985
      "Test   Loss: 0.69716\n",
986
      "Test   Accuracy: 64.6%\n"
987
     ]
988
    },
989
    {
990
     "data": {
991
      "text/plain": [
992
       "ShallowFBCSPNet_GeneralTrainer(filter_time_length=75, n_filters_spat=5,\n",
993
       "                n_filters_time=10, nb_epoch=60, pool_time_length=60,\n",
994
       "                pool_time_stride=30)"
995
      ]
996
     },
997
     "execution_count": 8,
998
     "metadata": {
999
      "tags": []
1000
     },
1001
     "output_type": "execute_result"
1002
    }
1003
   ],
1004
   "source": [
1005
    "\n",
1006
    "# load the general network Trainer\n",
1007
    "from brainDecodeSKLearnWrapper.ShallowFBCSPNet_GeneralTrainer import ShallowFBCSPNet_GeneralTrainer\n",
1008
    "\n",
1009
    "classifier = ShallowFBCSPNet_GeneralTrainer(nb_epoch=60)\n",
1010
    "classifier.fit(X,y)\n"
1011
   ]
1012
  },
1013
  {
1014
   "cell_type": "code",
1015
   "execution_count": 0,
1016
   "metadata": {
1017
    "colab": {},
1018
    "colab_type": "code",
1019
    "id": "OdkIjcgr1qmh"
1020
   },
1021
   "outputs": [],
1022
   "source": []
1023
  },
1024
  {
1025
   "cell_type": "code",
1026
   "execution_count": 0,
1027
   "metadata": {
1028
    "colab": {
1029
     "base_uri": "https://localhost:8080/",
1030
     "height": 34
1031
    },
1032
    "colab_type": "code",
1033
    "id": "S1xGwZjcAz4b",
1034
    "outputId": "053ae4a5-0f2c-4b0e-d75b-44734a7feaf6"
1035
   },
1036
   "outputs": [
1037
    {
1038
     "data": {
1039
      "text/plain": [
1040
       "<generator object Module.parameters at 0x7fa40a6c1990>"
1041
      ]
1042
     },
1043
     "execution_count": 9,
1044
     "metadata": {
1045
      "tags": []
1046
     },
1047
     "output_type": "execute_result"
1048
    }
1049
   ],
1050
   "source": [
1051
    "classifier.model.parameters()"
1052
   ]
1053
  },
1054
  {
1055
   "cell_type": "code",
1056
   "execution_count": 0,
1057
   "metadata": {
1058
    "colab": {
1059
     "base_uri": "https://localhost:8080/",
1060
     "height": 4267
1061
    },
1062
    "colab_type": "code",
1063
    "id": "bkXIatn-2lxV",
1064
    "outputId": "9844cdda-5f0c-49da-fd59-4adb5aac0412"
1065
   },
1066
   "outputs": [
1067
    {
1068
     "name": "stdout",
1069
     "output_type": "stream",
1070
     "text": [
1071
      "Epoch 0\n",
1072
      "Train  Loss: 0.45825\n",
1073
      "Train  Accuracy: 79.7%\n",
1074
      "Test   Loss: 0.48396\n",
1075
      "Test   Accuracy: 76.4%\n",
1076
      "Epoch 1\n",
1077
      "Train  Loss: 0.43202\n",
1078
      "Train  Accuracy: 78.1%\n",
1079
      "Test   Loss: 0.49042\n",
1080
      "Test   Accuracy: 75.0%\n",
1081
      "Epoch 2\n",
1082
      "Train  Loss: 0.42766\n",
1083
      "Train  Accuracy: 77.3%\n",
1084
      "Test   Loss: 0.50944\n",
1085
      "Test   Accuracy: 72.9%\n",
1086
      "Epoch 3\n",
1087
      "Train  Loss: 0.67299\n",
1088
      "Train  Accuracy: 64.4%\n",
1089
      "Test   Loss: 0.79049\n",
1090
      "Test   Accuracy: 57.9%\n",
1091
      "Epoch 4\n",
1092
      "Train  Loss: 0.34711\n",
1093
      "Train  Accuracy: 86.8%\n",
1094
      "Test   Loss: 0.43078\n",
1095
      "Test   Accuracy: 79.3%\n",
1096
      "Epoch 5\n",
1097
      "Train  Loss: 0.85764\n",
1098
      "Train  Accuracy: 59.7%\n",
1099
      "Test   Loss: 0.98398\n",
1100
      "Test   Accuracy: 55.0%\n",
1101
      "Epoch 6\n",
1102
      "Train  Loss: 0.73597\n",
1103
      "Train  Accuracy: 63.9%\n",
1104
      "Test   Loss: 0.85601\n",
1105
      "Test   Accuracy: 58.6%\n",
1106
      "Epoch 7\n",
1107
      "Train  Loss: 0.46463\n",
1108
      "Train  Accuracy: 75.3%\n",
1109
      "Test   Loss: 0.58487\n",
1110
      "Test   Accuracy: 71.1%\n",
1111
      "Epoch 8\n",
1112
      "Train  Loss: 0.33387\n",
1113
      "Train  Accuracy: 86.5%\n",
1114
      "Test   Loss: 0.45445\n",
1115
      "Test   Accuracy: 77.1%\n",
1116
      "Epoch 9\n",
1117
      "Train  Loss: 0.32303\n",
1118
      "Train  Accuracy: 87.7%\n",
1119
      "Test   Loss: 0.45208\n",
1120
      "Test   Accuracy: 78.9%\n",
1121
      "Epoch 10\n",
1122
      "Train  Loss: 0.31797\n",
1123
      "Train  Accuracy: 87.8%\n",
1124
      "Test   Loss: 0.45144\n",
1125
      "Test   Accuracy: 80.7%\n",
1126
      "Epoch 11\n",
1127
      "Train  Loss: 0.47277\n",
1128
      "Train  Accuracy: 74.6%\n",
1129
      "Test   Loss: 0.66623\n",
1130
      "Test   Accuracy: 67.5%\n",
1131
      "Epoch 12\n",
1132
      "Train  Loss: 0.32887\n",
1133
      "Train  Accuracy: 86.7%\n",
1134
      "Test   Loss: 0.48419\n",
1135
      "Test   Accuracy: 76.8%\n",
1136
      "Epoch 13\n",
1137
      "Train  Loss: 0.33205\n",
1138
      "Train  Accuracy: 85.2%\n",
1139
      "Test   Loss: 0.48284\n",
1140
      "Test   Accuracy: 76.8%\n",
1141
      "Epoch 14\n",
1142
      "Train  Loss: 0.30129\n",
1143
      "Train  Accuracy: 87.7%\n",
1144
      "Test   Loss: 0.45273\n",
1145
      "Test   Accuracy: 80.0%\n",
1146
      "Epoch 15\n",
1147
      "Train  Loss: 0.69373\n",
1148
      "Train  Accuracy: 66.1%\n",
1149
      "Test   Loss: 0.84741\n",
1150
      "Test   Accuracy: 60.0%\n",
1151
      "Epoch 16\n",
1152
      "Train  Loss: 0.90043\n",
1153
      "Train  Accuracy: 60.2%\n",
1154
      "Test   Loss: 1.10525\n",
1155
      "Test   Accuracy: 55.4%\n",
1156
      "Epoch 17\n",
1157
      "Train  Loss: 0.31883\n",
1158
      "Train  Accuracy: 86.2%\n",
1159
      "Test   Loss: 0.47711\n",
1160
      "Test   Accuracy: 78.2%\n",
1161
      "Epoch 18\n",
1162
      "Train  Loss: 0.68496\n",
1163
      "Train  Accuracy: 65.2%\n",
1164
      "Test   Loss: 0.87739\n",
1165
      "Test   Accuracy: 59.3%\n",
1166
      "Epoch 19\n",
1167
      "Train  Loss: 0.33017\n",
1168
      "Train  Accuracy: 85.9%\n",
1169
      "Test   Loss: 0.52678\n",
1170
      "Test   Accuracy: 76.8%\n",
1171
      "Epoch 20\n",
1172
      "Train  Loss: 0.29584\n",
1173
      "Train  Accuracy: 88.6%\n",
1174
      "Test   Loss: 0.43470\n",
1175
      "Test   Accuracy: 80.7%\n",
1176
      "Epoch 21\n",
1177
      "Train  Loss: 0.29099\n",
1178
      "Train  Accuracy: 89.4%\n",
1179
      "Test   Loss: 0.45623\n",
1180
      "Test   Accuracy: 79.3%\n",
1181
      "Epoch 22\n",
1182
      "Train  Loss: 0.79201\n",
1183
      "Train  Accuracy: 63.3%\n",
1184
      "Test   Loss: 0.95356\n",
1185
      "Test   Accuracy: 58.6%\n",
1186
      "Epoch 23\n",
1187
      "Train  Loss: 0.35573\n",
1188
      "Train  Accuracy: 83.0%\n",
1189
      "Test   Loss: 0.53456\n",
1190
      "Test   Accuracy: 71.8%\n",
1191
      "Epoch 24\n",
1192
      "Train  Loss: 0.29094\n",
1193
      "Train  Accuracy: 89.9%\n",
1194
      "Test   Loss: 0.43990\n",
1195
      "Test   Accuracy: 79.3%\n",
1196
      "Epoch 25\n",
1197
      "Train  Loss: 0.29328\n",
1198
      "Train  Accuracy: 89.1%\n",
1199
      "Test   Loss: 0.43468\n",
1200
      "Test   Accuracy: 79.6%\n",
1201
      "Epoch 26\n",
1202
      "Train  Loss: 0.29041\n",
1203
      "Train  Accuracy: 88.7%\n",
1204
      "Test   Loss: 0.44635\n",
1205
      "Test   Accuracy: 79.6%\n",
1206
      "Epoch 27\n",
1207
      "Train  Loss: 0.55998\n",
1208
      "Train  Accuracy: 69.6%\n",
1209
      "Test   Loss: 0.73803\n",
1210
      "Test   Accuracy: 63.2%\n",
1211
      "Epoch 28\n",
1212
      "Train  Loss: 0.35123\n",
1213
      "Train  Accuracy: 83.4%\n",
1214
      "Test   Loss: 0.51747\n",
1215
      "Test   Accuracy: 72.9%\n",
1216
      "Epoch 29\n",
1217
      "Train  Loss: 1.69520\n",
1218
      "Train  Accuracy: 54.5%\n",
1219
      "Test   Loss: 1.91036\n",
1220
      "Test   Accuracy: 52.1%\n",
1221
      "Epoch 30\n",
1222
      "Train  Loss: 0.29160\n",
1223
      "Train  Accuracy: 88.5%\n",
1224
      "Test   Loss: 0.43362\n",
1225
      "Test   Accuracy: 81.1%\n",
1226
      "Epoch 31\n",
1227
      "Train  Loss: 1.02346\n",
1228
      "Train  Accuracy: 57.9%\n",
1229
      "Test   Loss: 1.20691\n",
1230
      "Test   Accuracy: 53.2%\n",
1231
      "Epoch 32\n",
1232
      "Train  Loss: 0.28926\n",
1233
      "Train  Accuracy: 88.9%\n",
1234
      "Test   Loss: 0.44636\n",
1235
      "Test   Accuracy: 78.9%\n",
1236
      "Epoch 33\n",
1237
      "Train  Loss: 0.28356\n",
1238
      "Train  Accuracy: 89.3%\n",
1239
      "Test   Loss: 0.45554\n",
1240
      "Test   Accuracy: 77.1%\n",
1241
      "Epoch 34\n",
1242
      "Train  Loss: 0.89516\n",
1243
      "Train  Accuracy: 59.5%\n",
1244
      "Test   Loss: 1.08729\n",
1245
      "Test   Accuracy: 53.9%\n",
1246
      "Epoch 35\n",
1247
      "Train  Loss: 0.63140\n",
1248
      "Train  Accuracy: 67.3%\n",
1249
      "Test   Loss: 0.82585\n",
1250
      "Test   Accuracy: 60.0%\n",
1251
      "Epoch 36\n",
1252
      "Train  Loss: 0.33272\n",
1253
      "Train  Accuracy: 85.7%\n",
1254
      "Test   Loss: 0.52124\n",
1255
      "Test   Accuracy: 76.1%\n",
1256
      "Epoch 37\n",
1257
      "Train  Loss: 0.90068\n",
1258
      "Train  Accuracy: 59.7%\n",
1259
      "Test   Loss: 1.10443\n",
1260
      "Test   Accuracy: 53.9%\n",
1261
      "Epoch 38\n",
1262
      "Train  Loss: 0.41728\n",
1263
      "Train  Accuracy: 79.1%\n",
1264
      "Test   Loss: 0.59645\n",
1265
      "Test   Accuracy: 72.1%\n",
1266
      "Epoch 39\n",
1267
      "Train  Loss: 0.29578\n",
1268
      "Train  Accuracy: 89.3%\n",
1269
      "Test   Loss: 0.46959\n",
1270
      "Test   Accuracy: 78.6%\n",
1271
      "Epoch 40\n",
1272
      "Train  Loss: 0.28477\n",
1273
      "Train  Accuracy: 89.8%\n",
1274
      "Test   Loss: 0.47290\n",
1275
      "Test   Accuracy: 77.1%\n",
1276
      "Epoch 41\n",
1277
      "Train  Loss: 0.79603\n",
1278
      "Train  Accuracy: 61.6%\n",
1279
      "Test   Loss: 1.00241\n",
1280
      "Test   Accuracy: 56.4%\n",
1281
      "Epoch 42\n",
1282
      "Train  Loss: 0.29634\n",
1283
      "Train  Accuracy: 88.7%\n",
1284
      "Test   Loss: 0.47950\n",
1285
      "Test   Accuracy: 79.3%\n",
1286
      "Epoch 43\n",
1287
      "Train  Loss: 0.29162\n",
1288
      "Train  Accuracy: 88.5%\n",
1289
      "Test   Loss: 0.47160\n",
1290
      "Test   Accuracy: 76.4%\n",
1291
      "Epoch 44\n",
1292
      "Train  Loss: 0.74748\n",
1293
      "Train  Accuracy: 64.7%\n",
1294
      "Test   Loss: 0.97208\n",
1295
      "Test   Accuracy: 57.5%\n",
1296
      "Epoch 45\n",
1297
      "Train  Loss: 0.32037\n",
1298
      "Train  Accuracy: 85.1%\n",
1299
      "Test   Loss: 0.52109\n",
1300
      "Test   Accuracy: 75.0%\n",
1301
      "Epoch 46\n",
1302
      "Train  Loss: 0.28124\n",
1303
      "Train  Accuracy: 89.3%\n",
1304
      "Test   Loss: 0.49289\n",
1305
      "Test   Accuracy: 78.6%\n",
1306
      "Epoch 47\n",
1307
      "Train  Loss: 0.38134\n",
1308
      "Train  Accuracy: 80.9%\n",
1309
      "Test   Loss: 0.59058\n",
1310
      "Test   Accuracy: 71.8%\n",
1311
      "Epoch 48\n",
1312
      "Train  Loss: 0.57638\n",
1313
      "Train  Accuracy: 70.3%\n",
1314
      "Test   Loss: 0.79985\n",
1315
      "Test   Accuracy: 63.2%\n",
1316
      "Epoch 49\n",
1317
      "Train  Loss: 1.44346\n",
1318
      "Train  Accuracy: 53.6%\n",
1319
      "Test   Loss: 1.70621\n",
1320
      "Test   Accuracy: 50.4%\n"
1321
     ]
1322
    }
1323
   ],
1324
   "source": [
1325
    "from torch import optim\n",
1326
    "from torch import nn\n",
1327
    "from braindecode.datautil.signal_target import SignalAndTarget\n",
1328
    "\n",
1329
    "# define a number of train/test trials\n",
1330
    "#nb_train_trials = int(np.floor(7/8*X.shape[0]))\n",
1331
    "classifier.model.conv_classifier = nn.Conv2d(5, 2,(116, 1), bias=True).cuda()\n",
1332
    "\n",
1333
    "# split the dataset\n",
1334
    "#train_set = SignalAndTarget(X[:nb_train_trials], y=y[:nb_train_trials]) # confound, sets are mixed again\n",
1335
    "#test_set = SignalAndTarget(X[nb_train_trials:], y=y[nb_train_trials:])\n",
1336
    "train_set = classifier.train_set\n",
1337
    "test_set = classifier.test_set # that's the fix, but need to update classifier\n",
1338
    "\n",
1339
    "classifier.optimizer = optim.Adam(classifier.model.parameters())\n",
1340
    "\n",
1341
    "nbIter = 50\n",
1342
    "\n",
1343
    "# array that tracks results\n",
1344
    "classifier.loss_rec = np.zeros((nbIter,2))\n",
1345
    "classifier.accuracy_rec = np.zeros((nbIter,2))\n",
1346
    "\n",
1347
    "# run all epoch\n",
1348
    "for i_epoch in range(nbIter):\n",
1349
    "\n",
1350
    "    classifier._batchTrain(i_epoch, train_set)\n",
1351
    "    classifier._evalTraining(i_epoch, train_set, test_set)"
1352
   ]
1353
  },
1354
  {
1355
   "cell_type": "code",
1356
   "execution_count": 0,
1357
   "metadata": {
1358
    "colab": {
1359
     "base_uri": "https://localhost:8080/",
1360
     "height": 4879
1361
    },
1362
    "colab_type": "code",
1363
    "id": "xHpKkopr2iFS",
1364
    "outputId": "fb8b8a13-cdad-48c0-abbb-3ea5cdbb8f82"
1365
   },
1366
   "outputs": [
1367
    {
1368
     "name": "stdout",
1369
     "output_type": "stream",
1370
     "text": [
1371
      "--2018-12-07 00:14:15--  http://bnci-horizon-2020.eu/database/data-sets/002-2014/S01T.mat\n",
1372
      "Resolving bnci-horizon-2020.eu (bnci-horizon-2020.eu)... 91.227.204.35\n",
1373
      "Connecting to bnci-horizon-2020.eu (bnci-horizon-2020.eu)|91.227.204.35|:80... connected.\n",
1374
      "HTTP request sent, awaiting response... 302 Found\n",
1375
      "Location: https://lampx.tugraz.at/~bci/database/002-2014/S01T.mat [following]\n",
1376
      "--2018-12-07 00:14:15--  https://lampx.tugraz.at/~bci/database/002-2014/S01T.mat\n",
1377
      "Resolving lampx.tugraz.at (lampx.tugraz.at)... 129.27.124.207\n",
1378
      "Connecting to lampx.tugraz.at (lampx.tugraz.at)|129.27.124.207|:443... connected.\n",
1379
      "HTTP request sent, awaiting response... 200 OK\n",
1380
      "Length: 39794870 (38M)\n",
1381
      "Saving to: ‘S01T.mat’\n",
1382
      "\n",
1383
      "S01T.mat            100%[===================>]  37.95M  6.84MB/s    in 12s     \n",
1384
      "\n",
1385
      "2018-12-07 00:14:28 (3.27 MB/s) - ‘S01T.mat’ saved [39794870/39794870]\n",
1386
      "\n",
1387
      "--2018-12-07 00:14:29--  http://bnci-horizon-2020.eu/database/data-sets/002-2014/S01E.mat\n",
1388
      "Resolving bnci-horizon-2020.eu (bnci-horizon-2020.eu)... 91.227.204.35\n",
1389
      "Connecting to bnci-horizon-2020.eu (bnci-horizon-2020.eu)|91.227.204.35|:80... connected.\n",
1390
      "HTTP request sent, awaiting response... 302 Found\n",
1391
      "Location: https://lampx.tugraz.at/~bci/database/002-2014/S01E.mat [following]\n",
1392
      "--2018-12-07 00:14:29--  https://lampx.tugraz.at/~bci/database/002-2014/S01E.mat\n",
1393
      "Resolving lampx.tugraz.at (lampx.tugraz.at)... 129.27.124.207\n",
1394
      "Connecting to lampx.tugraz.at (lampx.tugraz.at)|129.27.124.207|:443... connected.\n",
1395
      "HTTP request sent, awaiting response... 200 OK\n",
1396
      "Length: 23769588 (23M)\n",
1397
      "Saving to: ‘S01E.mat’\n",
1398
      "\n",
1399
      "S01E.mat            100%[===================>]  22.67M  3.95MB/s    in 8.7s    \n",
1400
      "\n",
1401
      "2018-12-07 00:14:39 (2.61 MB/s) - ‘S01E.mat’ saved [23769588/23769588]\n",
1402
      "\n",
1403
      "mkdir: cannot create directory ‘BBCIData’: File exists\n",
1404
      "\n",
1405
      "(60, 15, 3584)\n",
1406
      "(60,)\n",
1407
      "Epoch 0\n",
1408
      "Train  Loss: 0.59035\n",
1409
      "Train  Accuracy: 63.5%\n",
1410
      "Test   Loss: 0.71795\n",
1411
      "Test   Accuracy: 50.0%\n",
1412
      "Epoch 1\n",
1413
      "Train  Loss: 0.53741\n",
1414
      "Train  Accuracy: 69.2%\n",
1415
      "Test   Loss: 0.69791\n",
1416
      "Test   Accuracy: 62.5%\n",
1417
      "Epoch 2\n",
1418
      "Train  Loss: 0.48028\n",
1419
      "Train  Accuracy: 82.7%\n",
1420
      "Test   Loss: 0.67063\n",
1421
      "Test   Accuracy: 62.5%\n",
1422
      "Epoch 3\n",
1423
      "Train  Loss: 0.42742\n",
1424
      "Train  Accuracy: 90.4%\n",
1425
      "Test   Loss: 0.64467\n",
1426
      "Test   Accuracy: 75.0%\n",
1427
      "Epoch 4\n",
1428
      "Train  Loss: 0.38158\n",
1429
      "Train  Accuracy: 92.3%\n",
1430
      "Test   Loss: 0.61856\n",
1431
      "Test   Accuracy: 87.5%\n",
1432
      "Epoch 5\n",
1433
      "Train  Loss: 0.34126\n",
1434
      "Train  Accuracy: 94.2%\n",
1435
      "Test   Loss: 0.58863\n",
1436
      "Test   Accuracy: 87.5%\n",
1437
      "Epoch 6\n",
1438
      "Train  Loss: 0.30431\n",
1439
      "Train  Accuracy: 94.2%\n",
1440
      "Test   Loss: 0.55712\n",
1441
      "Test   Accuracy: 87.5%\n",
1442
      "Epoch 7\n",
1443
      "Train  Loss: 0.27281\n",
1444
      "Train  Accuracy: 96.2%\n",
1445
      "Test   Loss: 0.53117\n",
1446
      "Test   Accuracy: 87.5%\n",
1447
      "Epoch 8\n",
1448
      "Train  Loss: 0.24420\n",
1449
      "Train  Accuracy: 100.0%\n",
1450
      "Test   Loss: 0.50117\n",
1451
      "Test   Accuracy: 87.5%\n",
1452
      "Epoch 9\n",
1453
      "Train  Loss: 0.22009\n",
1454
      "Train  Accuracy: 100.0%\n",
1455
      "Test   Loss: 0.47334\n",
1456
      "Test   Accuracy: 87.5%\n",
1457
      "Epoch 10\n",
1458
      "Train  Loss: 0.19978\n",
1459
      "Train  Accuracy: 100.0%\n",
1460
      "Test   Loss: 0.44829\n",
1461
      "Test   Accuracy: 87.5%\n",
1462
      "Epoch 11\n",
1463
      "Train  Loss: 0.18170\n",
1464
      "Train  Accuracy: 100.0%\n",
1465
      "Test   Loss: 0.42519\n",
1466
      "Test   Accuracy: 87.5%\n",
1467
      "Epoch 12\n",
1468
      "Train  Loss: 0.16582\n",
1469
      "Train  Accuracy: 100.0%\n",
1470
      "Test   Loss: 0.40238\n",
1471
      "Test   Accuracy: 87.5%\n",
1472
      "Epoch 13\n",
1473
      "Train  Loss: 0.15176\n",
1474
      "Train  Accuracy: 100.0%\n",
1475
      "Test   Loss: 0.38288\n",
1476
      "Test   Accuracy: 87.5%\n",
1477
      "Epoch 14\n",
1478
      "Train  Loss: 0.13941\n",
1479
      "Train  Accuracy: 100.0%\n",
1480
      "Test   Loss: 0.36684\n",
1481
      "Test   Accuracy: 87.5%\n",
1482
      "Epoch 15\n",
1483
      "Train  Loss: 0.12825\n",
1484
      "Train  Accuracy: 100.0%\n",
1485
      "Test   Loss: 0.35460\n",
1486
      "Test   Accuracy: 87.5%\n",
1487
      "Epoch 16\n",
1488
      "Train  Loss: 0.11822\n",
1489
      "Train  Accuracy: 100.0%\n",
1490
      "Test   Loss: 0.34499\n",
1491
      "Test   Accuracy: 100.0%\n",
1492
      "Epoch 17\n",
1493
      "Train  Loss: 0.10870\n",
1494
      "Train  Accuracy: 100.0%\n",
1495
      "Test   Loss: 0.33678\n",
1496
      "Test   Accuracy: 100.0%\n",
1497
      "Epoch 18\n",
1498
      "Train  Loss: 0.10051\n",
1499
      "Train  Accuracy: 100.0%\n",
1500
      "Test   Loss: 0.32920\n",
1501
      "Test   Accuracy: 100.0%\n",
1502
      "Epoch 19\n",
1503
      "Train  Loss: 0.09312\n",
1504
      "Train  Accuracy: 100.0%\n",
1505
      "Test   Loss: 0.32177\n",
1506
      "Test   Accuracy: 100.0%\n",
1507
      "Epoch 20\n",
1508
      "Train  Loss: 0.08638\n",
1509
      "Train  Accuracy: 100.0%\n",
1510
      "Test   Loss: 0.31344\n",
1511
      "Test   Accuracy: 100.0%\n",
1512
      "Epoch 21\n",
1513
      "Train  Loss: 0.08014\n",
1514
      "Train  Accuracy: 100.0%\n",
1515
      "Test   Loss: 0.30799\n",
1516
      "Test   Accuracy: 100.0%\n",
1517
      "Epoch 22\n",
1518
      "Train  Loss: 0.07451\n",
1519
      "Train  Accuracy: 100.0%\n",
1520
      "Test   Loss: 0.30423\n",
1521
      "Test   Accuracy: 100.0%\n",
1522
      "Epoch 23\n",
1523
      "Train  Loss: 0.06921\n",
1524
      "Train  Accuracy: 100.0%\n",
1525
      "Test   Loss: 0.29714\n",
1526
      "Test   Accuracy: 100.0%\n",
1527
      "Epoch 24\n",
1528
      "Train  Loss: 0.06443\n",
1529
      "Train  Accuracy: 100.0%\n",
1530
      "Test   Loss: 0.29052\n",
1531
      "Test   Accuracy: 100.0%\n",
1532
      "Epoch 25\n",
1533
      "Train  Loss: 0.06031\n",
1534
      "Train  Accuracy: 100.0%\n",
1535
      "Test   Loss: 0.28300\n",
1536
      "Test   Accuracy: 100.0%\n",
1537
      "Epoch 26\n",
1538
      "Train  Loss: 0.05658\n",
1539
      "Train  Accuracy: 100.0%\n",
1540
      "Test   Loss: 0.27913\n",
1541
      "Test   Accuracy: 100.0%\n",
1542
      "Epoch 27\n",
1543
      "Train  Loss: 0.05328\n",
1544
      "Train  Accuracy: 100.0%\n",
1545
      "Test   Loss: 0.27572\n",
1546
      "Test   Accuracy: 100.0%\n",
1547
      "Epoch 28\n",
1548
      "Train  Loss: 0.05030\n",
1549
      "Train  Accuracy: 100.0%\n",
1550
      "Test   Loss: 0.27514\n",
1551
      "Test   Accuracy: 100.0%\n",
1552
      "Epoch 29\n",
1553
      "Train  Loss: 0.04759\n",
1554
      "Train  Accuracy: 100.0%\n",
1555
      "Test   Loss: 0.27249\n",
1556
      "Test   Accuracy: 100.0%\n",
1557
      "Epoch 30\n",
1558
      "Train  Loss: 0.04497\n",
1559
      "Train  Accuracy: 100.0%\n",
1560
      "Test   Loss: 0.26947\n",
1561
      "Test   Accuracy: 100.0%\n",
1562
      "Epoch 31\n",
1563
      "Train  Loss: 0.04251\n",
1564
      "Train  Accuracy: 100.0%\n",
1565
      "Test   Loss: 0.26470\n",
1566
      "Test   Accuracy: 100.0%\n",
1567
      "Epoch 32\n",
1568
      "Train  Loss: 0.04012\n",
1569
      "Train  Accuracy: 100.0%\n",
1570
      "Test   Loss: 0.25948\n",
1571
      "Test   Accuracy: 100.0%\n",
1572
      "Epoch 33\n",
1573
      "Train  Loss: 0.03803\n",
1574
      "Train  Accuracy: 100.0%\n",
1575
      "Test   Loss: 0.25503\n",
1576
      "Test   Accuracy: 100.0%\n",
1577
      "Epoch 34\n",
1578
      "Train  Loss: 0.03593\n",
1579
      "Train  Accuracy: 100.0%\n",
1580
      "Test   Loss: 0.25090\n",
1581
      "Test   Accuracy: 100.0%\n",
1582
      "Epoch 35\n",
1583
      "Train  Loss: 0.03400\n",
1584
      "Train  Accuracy: 100.0%\n",
1585
      "Test   Loss: 0.24655\n",
1586
      "Test   Accuracy: 100.0%\n",
1587
      "Epoch 36\n",
1588
      "Train  Loss: 0.03225\n",
1589
      "Train  Accuracy: 100.0%\n",
1590
      "Test   Loss: 0.24253\n",
1591
      "Test   Accuracy: 100.0%\n",
1592
      "Epoch 37\n",
1593
      "Train  Loss: 0.03067\n",
1594
      "Train  Accuracy: 100.0%\n",
1595
      "Test   Loss: 0.23928\n",
1596
      "Test   Accuracy: 100.0%\n",
1597
      "Epoch 38\n",
1598
      "Train  Loss: 0.02915\n",
1599
      "Train  Accuracy: 100.0%\n",
1600
      "Test   Loss: 0.23697\n",
1601
      "Test   Accuracy: 100.0%\n",
1602
      "Epoch 39\n",
1603
      "Train  Loss: 0.02792\n",
1604
      "Train  Accuracy: 100.0%\n",
1605
      "Test   Loss: 0.23510\n",
1606
      "Test   Accuracy: 100.0%\n",
1607
      "Epoch 40\n",
1608
      "Train  Loss: 0.02682\n",
1609
      "Train  Accuracy: 100.0%\n",
1610
      "Test   Loss: 0.23309\n",
1611
      "Test   Accuracy: 100.0%\n",
1612
      "Epoch 41\n",
1613
      "Train  Loss: 0.02554\n",
1614
      "Train  Accuracy: 100.0%\n",
1615
      "Test   Loss: 0.22865\n",
1616
      "Test   Accuracy: 100.0%\n",
1617
      "Epoch 42\n",
1618
      "Train  Loss: 0.02444\n",
1619
      "Train  Accuracy: 100.0%\n",
1620
      "Test   Loss: 0.22469\n",
1621
      "Test   Accuracy: 100.0%\n",
1622
      "Epoch 43\n",
1623
      "Train  Loss: 0.02354\n",
1624
      "Train  Accuracy: 100.0%\n",
1625
      "Test   Loss: 0.22113\n",
1626
      "Test   Accuracy: 100.0%\n",
1627
      "Epoch 44\n",
1628
      "Train  Loss: 0.02257\n",
1629
      "Train  Accuracy: 100.0%\n",
1630
      "Test   Loss: 0.21919\n",
1631
      "Test   Accuracy: 100.0%\n",
1632
      "Epoch 45\n",
1633
      "Train  Loss: 0.02160\n",
1634
      "Train  Accuracy: 100.0%\n",
1635
      "Test   Loss: 0.21884\n",
1636
      "Test   Accuracy: 100.0%\n",
1637
      "Epoch 46\n",
1638
      "Train  Loss: 0.02074\n",
1639
      "Train  Accuracy: 100.0%\n",
1640
      "Test   Loss: 0.21870\n",
1641
      "Test   Accuracy: 87.5%\n",
1642
      "Epoch 47\n",
1643
      "Train  Loss: 0.01996\n",
1644
      "Train  Accuracy: 100.0%\n",
1645
      "Test   Loss: 0.21850\n",
1646
      "Test   Accuracy: 87.5%\n",
1647
      "Epoch 48\n",
1648
      "Train  Loss: 0.01929\n",
1649
      "Train  Accuracy: 100.0%\n",
1650
      "Test   Loss: 0.21899\n",
1651
      "Test   Accuracy: 87.5%\n",
1652
      "Epoch 49\n",
1653
      "Train  Loss: 0.01867\n",
1654
      "Train  Accuracy: 100.0%\n",
1655
      "Test   Loss: 0.21831\n",
1656
      "Test   Accuracy: 87.5%\n"
1657
     ]
1658
    }
1659
   ],
1660
   "source": [
1661
    "from torch import optim\n",
1662
    "from torch import nn\n",
1663
    "from braindecode.datautil.signal_target import SignalAndTarget\n",
1664
    "\n",
1665
    "!wget http://bnci-horizon-2020.eu/database/data-sets/002-2014/S02T.mat\n",
1666
    "!wget http://bnci-horizon-2020.eu/database/data-sets/002-2014/S02E.mat\n",
1667
    "!mkdir BBCIData\n",
1668
    "!mv *.mat BBCIData\n",
1669
    "\n",
1670
    "\n",
1671
    "\"\"\"\n",
1672
    "Now, let's load data.\n",
1673
    "\n",
1674
    "We read the file for the desired subject, and parse the data to extract:\n",
1675
    "- samplingRate\n",
1676
    "- trialLength\n",
1677
    "- X, a M x N x K matrix, which stands for trial x chan x samples\n",
1678
    "    - the actual values are 160 x 15 x 2560\n",
1679
    "- y, a M vector containing the labels {0,1}\n",
1680
    "\n",
1681
    "ref: Dataset description: https://lampx.tugraz.at/~bci/database/002-2014/description.pdf\n",
1682
    "\"\"\"\n",
1683
    "\n",
1684
    "folder = \"BBCIData\"\n",
1685
    "datasetID = 1\n",
1686
    "\n",
1687
    "# prepare data containers\n",
1688
    "y_subset = []\n",
1689
    "X_subset = []\n",
1690
    "\n",
1691
    "f = listdir(folder)[datasetID]\n",
1692
    "  \n",
1693
    "# read file\n",
1694
    "d1T = sio.loadmat(folder + \"/\" + f)\n",
1695
    "\n",
1696
    "samplingRate = d1T['data'][0][0][0][0][3][0][0]\n",
1697
    "trialLength = 7*samplingRate\n",
1698
    "\n",
1699
    "# run through all training runs\n",
1700
    "for run in range(len(d1T['data'][0])):\n",
1701
    "    y_subset.append(d1T['data'][0][run][0][0][2][0]) # labels\n",
1702
    "    timestamps = d1T['data'][0][run][0][0][1][0] # timestamps\n",
1703
    "    rawData = d1T['data'][0][run][0][0][0].transpose() # chan x data\n",
1704
    "\n",
1705
    "    # parse out data based on timestamps\n",
1706
    "    for start in timestamps:\n",
1707
    "        end = start + trialLength\n",
1708
    "        X_subset.append(rawData[:,start:end]) #15 x 2560\n",
1709
    "\n",
1710
    "del rawData\n",
1711
    "del d1T\n",
1712
    "\n",
1713
    "# arrange data into num7py arrays\n",
1714
    "# also torch expect float32 for samples\n",
1715
    "# and int64 for labels {0,1}\n",
1716
    "X_subset = np.array(X_subset).astype(np.float32)\n",
1717
    "y_subset = (np.array(y_subset).flatten()-1).astype(np.int64)\n",
1718
    "print()\n",
1719
    "print(X_subset.shape)\n",
1720
    "print(y_subset.shape)\n",
1721
    "\n",
1722
    "\n",
1723
    "# rand permute dataset\n",
1724
    "idx = np.random.permutation(X_subset.shape[0])\n",
1725
    "\n",
1726
    "X_subset = X_subset[idx,:,:]\n",
1727
    "y_subset = y_subset[idx]\n",
1728
    "\n",
1729
    "\n",
1730
    "# define a number of train/test trials\n",
1731
    "nb_train_trials = int(np.floor(7/8*X_subset.shape[0]))\n",
1732
    "\n",
1733
    "# split the dataset\n",
1734
    "train_set_subset = SignalAndTarget(X_subset[:nb_train_trials], y=y_subset[:nb_train_trials])\n",
1735
    "test_set_subset = SignalAndTarget(X_subset[nb_train_trials:], y=y_subset[nb_train_trials:])\n",
1736
    "\n",
1737
    "\n",
1738
    "\n",
1739
    "\n",
1740
    "\n",
1741
    "\n",
1742
    "\n",
1743
    "from torch import optim\n",
1744
    "from torch import nn\n",
1745
    "from braindecode.datautil.signal_target import SignalAndTarget\n",
1746
    "\n",
1747
    "# define a number of train/test trials\n",
1748
    "classifier.model.conv_classifier = nn.Conv2d(5, 2,(116, 1), bias=True).cuda()\n",
1749
    "\n",
1750
    "classifier.optimizer = optim.Adam(classifier.model.parameters())\n",
1751
    "\n",
1752
    "nbIter = 50\n",
1753
    "\n",
1754
    "# array that tracks results\n",
1755
    "classifier.loss_rec = np.zeros((nbIter,2))\n",
1756
    "classifier.accuracy_rec = np.zeros((nbIter,2))\n",
1757
    "\n",
1758
    "# run all epoch\n",
1759
    "for i_epoch in range(nbIter):\n",
1760
    "\n",
1761
    "    classifier._batchTrain(i_epoch, train_set_subset)\n",
1762
    "    classifier._evalTraining(i_epoch, train_set_subset, test_set_subset)\n"
1763
   ]
1764
  },
1765
  {
1766
   "cell_type": "code",
1767
   "execution_count": 0,
1768
   "metadata": {
1769
    "colab": {
1770
     "base_uri": "https://localhost:8080/",
1771
     "height": 4267
1772
    },
1773
    "colab_type": "code",
1774
    "id": "stBQvDoj19dR",
1775
    "outputId": "8e83a16e-1286-4d9c-8ac1-4ad8bf486892"
1776
   },
1777
   "outputs": [
1778
    {
1779
     "name": "stdout",
1780
     "output_type": "stream",
1781
     "text": [
1782
      "Epoch 0\n",
1783
      "Train  Loss: 0.01411\n",
1784
      "Train  Accuracy: 100.0%\n",
1785
      "Test   Loss: 0.45631\n",
1786
      "Test   Accuracy: 87.5%\n",
1787
      "Epoch 1\n",
1788
      "Train  Loss: 0.01369\n",
1789
      "Train  Accuracy: 100.0%\n",
1790
      "Test   Loss: 0.45678\n",
1791
      "Test   Accuracy: 87.5%\n",
1792
      "Epoch 2\n",
1793
      "Train  Loss: 0.01326\n",
1794
      "Train  Accuracy: 100.0%\n",
1795
      "Test   Loss: 0.45545\n",
1796
      "Test   Accuracy: 87.5%\n",
1797
      "Epoch 3\n",
1798
      "Train  Loss: 0.01289\n",
1799
      "Train  Accuracy: 100.0%\n",
1800
      "Test   Loss: 0.45607\n",
1801
      "Test   Accuracy: 87.5%\n",
1802
      "Epoch 4\n",
1803
      "Train  Loss: 0.01253\n",
1804
      "Train  Accuracy: 100.0%\n",
1805
      "Test   Loss: 0.45559\n",
1806
      "Test   Accuracy: 87.5%\n",
1807
      "Epoch 5\n",
1808
      "Train  Loss: 0.01216\n",
1809
      "Train  Accuracy: 100.0%\n",
1810
      "Test   Loss: 0.45258\n",
1811
      "Test   Accuracy: 87.5%\n",
1812
      "Epoch 6\n",
1813
      "Train  Loss: 0.01182\n",
1814
      "Train  Accuracy: 100.0%\n",
1815
      "Test   Loss: 0.44866\n",
1816
      "Test   Accuracy: 87.5%\n",
1817
      "Epoch 7\n",
1818
      "Train  Loss: 0.01151\n",
1819
      "Train  Accuracy: 100.0%\n",
1820
      "Test   Loss: 0.44688\n",
1821
      "Test   Accuracy: 87.5%\n",
1822
      "Epoch 8\n",
1823
      "Train  Loss: 0.01122\n",
1824
      "Train  Accuracy: 100.0%\n",
1825
      "Test   Loss: 0.44529\n",
1826
      "Test   Accuracy: 87.5%\n",
1827
      "Epoch 9\n",
1828
      "Train  Loss: 0.01096\n",
1829
      "Train  Accuracy: 100.0%\n",
1830
      "Test   Loss: 0.44381\n",
1831
      "Test   Accuracy: 87.5%\n",
1832
      "Epoch 10\n",
1833
      "Train  Loss: 0.01070\n",
1834
      "Train  Accuracy: 100.0%\n",
1835
      "Test   Loss: 0.44116\n",
1836
      "Test   Accuracy: 87.5%\n",
1837
      "Epoch 11\n",
1838
      "Train  Loss: 0.01046\n",
1839
      "Train  Accuracy: 100.0%\n",
1840
      "Test   Loss: 0.43645\n",
1841
      "Test   Accuracy: 87.5%\n",
1842
      "Epoch 12\n",
1843
      "Train  Loss: 0.01023\n",
1844
      "Train  Accuracy: 100.0%\n",
1845
      "Test   Loss: 0.43478\n",
1846
      "Test   Accuracy: 87.5%\n",
1847
      "Epoch 13\n",
1848
      "Train  Loss: 0.01001\n",
1849
      "Train  Accuracy: 100.0%\n",
1850
      "Test   Loss: 0.43866\n",
1851
      "Test   Accuracy: 87.5%\n",
1852
      "Epoch 14\n",
1853
      "Train  Loss: 0.00976\n",
1854
      "Train  Accuracy: 100.0%\n",
1855
      "Test   Loss: 0.44634\n",
1856
      "Test   Accuracy: 87.5%\n",
1857
      "Epoch 15\n",
1858
      "Train  Loss: 0.00949\n",
1859
      "Train  Accuracy: 100.0%\n",
1860
      "Test   Loss: 0.45189\n",
1861
      "Test   Accuracy: 87.5%\n",
1862
      "Epoch 16\n",
1863
      "Train  Loss: 0.00920\n",
1864
      "Train  Accuracy: 100.0%\n",
1865
      "Test   Loss: 0.45601\n",
1866
      "Test   Accuracy: 87.5%\n",
1867
      "Epoch 17\n",
1868
      "Train  Loss: 0.00890\n",
1869
      "Train  Accuracy: 100.0%\n",
1870
      "Test   Loss: 0.45772\n",
1871
      "Test   Accuracy: 87.5%\n",
1872
      "Epoch 18\n",
1873
      "Train  Loss: 0.00861\n",
1874
      "Train  Accuracy: 100.0%\n",
1875
      "Test   Loss: 0.45853\n",
1876
      "Test   Accuracy: 87.5%\n",
1877
      "Epoch 19\n",
1878
      "Train  Loss: 0.00832\n",
1879
      "Train  Accuracy: 100.0%\n",
1880
      "Test   Loss: 0.45800\n",
1881
      "Test   Accuracy: 87.5%\n",
1882
      "Epoch 20\n",
1883
      "Train  Loss: 0.00806\n",
1884
      "Train  Accuracy: 100.0%\n",
1885
      "Test   Loss: 0.45809\n",
1886
      "Test   Accuracy: 87.5%\n",
1887
      "Epoch 21\n",
1888
      "Train  Loss: 0.00780\n",
1889
      "Train  Accuracy: 100.0%\n",
1890
      "Test   Loss: 0.45934\n",
1891
      "Test   Accuracy: 87.5%\n",
1892
      "Epoch 22\n",
1893
      "Train  Loss: 0.00757\n",
1894
      "Train  Accuracy: 100.0%\n",
1895
      "Test   Loss: 0.46104\n",
1896
      "Test   Accuracy: 87.5%\n",
1897
      "Epoch 23\n",
1898
      "Train  Loss: 0.00733\n",
1899
      "Train  Accuracy: 100.0%\n",
1900
      "Test   Loss: 0.45554\n",
1901
      "Test   Accuracy: 87.5%\n",
1902
      "Epoch 24\n",
1903
      "Train  Loss: 0.00714\n",
1904
      "Train  Accuracy: 100.0%\n",
1905
      "Test   Loss: 0.45005\n",
1906
      "Test   Accuracy: 87.5%\n",
1907
      "Epoch 25\n",
1908
      "Train  Loss: 0.00699\n",
1909
      "Train  Accuracy: 100.0%\n",
1910
      "Test   Loss: 0.44585\n",
1911
      "Test   Accuracy: 87.5%\n",
1912
      "Epoch 26\n",
1913
      "Train  Loss: 0.00684\n",
1914
      "Train  Accuracy: 100.0%\n",
1915
      "Test   Loss: 0.44494\n",
1916
      "Test   Accuracy: 87.5%\n",
1917
      "Epoch 27\n",
1918
      "Train  Loss: 0.00670\n",
1919
      "Train  Accuracy: 100.0%\n",
1920
      "Test   Loss: 0.44465\n",
1921
      "Test   Accuracy: 87.5%\n",
1922
      "Epoch 28\n",
1923
      "Train  Loss: 0.00656\n",
1924
      "Train  Accuracy: 100.0%\n",
1925
      "Test   Loss: 0.44659\n",
1926
      "Test   Accuracy: 87.5%\n",
1927
      "Epoch 29\n",
1928
      "Train  Loss: 0.00643\n",
1929
      "Train  Accuracy: 100.0%\n",
1930
      "Test   Loss: 0.45250\n",
1931
      "Test   Accuracy: 87.5%\n",
1932
      "Epoch 30\n",
1933
      "Train  Loss: 0.00634\n",
1934
      "Train  Accuracy: 100.0%\n",
1935
      "Test   Loss: 0.45858\n",
1936
      "Test   Accuracy: 87.5%\n",
1937
      "Epoch 31\n",
1938
      "Train  Loss: 0.00624\n",
1939
      "Train  Accuracy: 100.0%\n",
1940
      "Test   Loss: 0.46391\n",
1941
      "Test   Accuracy: 87.5%\n",
1942
      "Epoch 32\n",
1943
      "Train  Loss: 0.00615\n",
1944
      "Train  Accuracy: 100.0%\n",
1945
      "Test   Loss: 0.46770\n",
1946
      "Test   Accuracy: 87.5%\n",
1947
      "Epoch 33\n",
1948
      "Train  Loss: 0.00602\n",
1949
      "Train  Accuracy: 100.0%\n",
1950
      "Test   Loss: 0.47048\n",
1951
      "Test   Accuracy: 87.5%\n",
1952
      "Epoch 34\n",
1953
      "Train  Loss: 0.00588\n",
1954
      "Train  Accuracy: 100.0%\n",
1955
      "Test   Loss: 0.47247\n",
1956
      "Test   Accuracy: 87.5%\n",
1957
      "Epoch 35\n",
1958
      "Train  Loss: 0.00576\n",
1959
      "Train  Accuracy: 100.0%\n",
1960
      "Test   Loss: 0.47522\n",
1961
      "Test   Accuracy: 87.5%\n",
1962
      "Epoch 36\n",
1963
      "Train  Loss: 0.00564\n",
1964
      "Train  Accuracy: 100.0%\n",
1965
      "Test   Loss: 0.47548\n",
1966
      "Test   Accuracy: 87.5%\n",
1967
      "Epoch 37\n",
1968
      "Train  Loss: 0.00550\n",
1969
      "Train  Accuracy: 100.0%\n",
1970
      "Test   Loss: 0.47629\n",
1971
      "Test   Accuracy: 87.5%\n",
1972
      "Epoch 38\n",
1973
      "Train  Loss: 0.00538\n",
1974
      "Train  Accuracy: 100.0%\n",
1975
      "Test   Loss: 0.48025\n",
1976
      "Test   Accuracy: 87.5%\n",
1977
      "Epoch 39\n",
1978
      "Train  Loss: 0.00528\n",
1979
      "Train  Accuracy: 100.0%\n",
1980
      "Test   Loss: 0.48644\n",
1981
      "Test   Accuracy: 87.5%\n",
1982
      "Epoch 40\n",
1983
      "Train  Loss: 0.00518\n",
1984
      "Train  Accuracy: 100.0%\n",
1985
      "Test   Loss: 0.49224\n",
1986
      "Test   Accuracy: 87.5%\n",
1987
      "Epoch 41\n",
1988
      "Train  Loss: 0.00509\n",
1989
      "Train  Accuracy: 100.0%\n",
1990
      "Test   Loss: 0.49633\n",
1991
      "Test   Accuracy: 87.5%\n",
1992
      "Epoch 42\n",
1993
      "Train  Loss: 0.00504\n",
1994
      "Train  Accuracy: 100.0%\n",
1995
      "Test   Loss: 0.50633\n",
1996
      "Test   Accuracy: 87.5%\n",
1997
      "Epoch 43\n",
1998
      "Train  Loss: 0.00497\n",
1999
      "Train  Accuracy: 100.0%\n",
2000
      "Test   Loss: 0.51250\n",
2001
      "Test   Accuracy: 87.5%\n",
2002
      "Epoch 44\n",
2003
      "Train  Loss: 0.00488\n",
2004
      "Train  Accuracy: 100.0%\n",
2005
      "Test   Loss: 0.51696\n",
2006
      "Test   Accuracy: 87.5%\n",
2007
      "Epoch 45\n",
2008
      "Train  Loss: 0.00477\n",
2009
      "Train  Accuracy: 100.0%\n",
2010
      "Test   Loss: 0.51926\n",
2011
      "Test   Accuracy: 87.5%\n",
2012
      "Epoch 46\n",
2013
      "Train  Loss: 0.00465\n",
2014
      "Train  Accuracy: 100.0%\n",
2015
      "Test   Loss: 0.51979\n",
2016
      "Test   Accuracy: 87.5%\n",
2017
      "Epoch 47\n",
2018
      "Train  Loss: 0.00452\n",
2019
      "Train  Accuracy: 100.0%\n",
2020
      "Test   Loss: 0.51986\n",
2021
      "Test   Accuracy: 87.5%\n",
2022
      "Epoch 48\n",
2023
      "Train  Loss: 0.00438\n",
2024
      "Train  Accuracy: 100.0%\n",
2025
      "Test   Loss: 0.51918\n",
2026
      "Test   Accuracy: 87.5%\n",
2027
      "Epoch 49\n",
2028
      "Train  Loss: 0.00424\n",
2029
      "Train  Accuracy: 100.0%\n",
2030
      "Test   Loss: 0.51738\n",
2031
      "Test   Accuracy: 87.5%\n"
2032
     ]
2033
    }
2034
   ],
2035
   "source": [
2036
    "nbIter = 50\n",
2037
    "\n",
2038
    "# array that tracks results\n",
2039
    "classifier.loss_rec = np.zeros((nbIter,2))\n",
2040
    "classifier.accuracy_rec = np.zeros((nbIter,2))\n",
2041
    "\n",
2042
    "# run all epoch\n",
2043
    "for i_epoch in range(nbIter):\n",
2044
    "\n",
2045
    "    classifier._batchTrain(i_epoch, train_set_subset)\n",
2046
    "    classifier._evalTraining(i_epoch, train_set_subset, test_set_subset)\n"
2047
   ]
2048
  },
2049
  {
2050
   "cell_type": "code",
2051
   "execution_count": 0,
2052
   "metadata": {
2053
    "colab": {
2054
     "base_uri": "https://localhost:8080/",
2055
     "height": 612
2056
    },
2057
    "colab_type": "code",
2058
    "id": "SeSZLoSi0yE7",
2059
    "outputId": "d031112f-ff67-4502-add7-68259c8848d2"
2060
   },
2061
   "outputs": [
2062
    {
2063
     "name": "stdout",
2064
     "output_type": "stream",
2065
     "text": [
2066
      "--2018-10-12 01:02:30--  http://bnci-horizon-2020.eu/database/data-sets/002-2014/S01T.mat\n",
2067
      "Resolving bnci-horizon-2020.eu (bnci-horizon-2020.eu)... 91.227.204.35\n",
2068
      "Connecting to bnci-horizon-2020.eu (bnci-horizon-2020.eu)|91.227.204.35|:80... connected.\n",
2069
      "HTTP request sent, awaiting response... 302 Found\n",
2070
      "Location: https://lampx.tugraz.at/~bci/database/002-2014/S01T.mat [following]\n",
2071
      "--2018-10-12 01:02:30--  https://lampx.tugraz.at/~bci/database/002-2014/S01T.mat\n",
2072
      "Resolving lampx.tugraz.at (lampx.tugraz.at)... 129.27.124.207\n",
2073
      "Connecting to lampx.tugraz.at (lampx.tugraz.at)|129.27.124.207|:443... connected.\n",
2074
      "HTTP request sent, awaiting response... 200 OK\n",
2075
      "Length: 39794870 (38M)\n",
2076
      "Saving to: ‘S01T.mat’\n",
2077
      "\n",
2078
      "S01T.mat            100%[===================>]  37.95M  10.4MB/s    in 5.9s    \n",
2079
      "\n",
2080
      "2018-10-12 01:02:37 (6.44 MB/s) - ‘S01T.mat’ saved [39794870/39794870]\n",
2081
      "\n",
2082
      "--2018-10-12 01:02:38--  http://bnci-horizon-2020.eu/database/data-sets/002-2014/S01E.mat\n",
2083
      "Resolving bnci-horizon-2020.eu (bnci-horizon-2020.eu)... 91.227.204.35\n",
2084
      "Connecting to bnci-horizon-2020.eu (bnci-horizon-2020.eu)|91.227.204.35|:80... connected.\n",
2085
      "HTTP request sent, awaiting response... 302 Found\n",
2086
      "Location: https://lampx.tugraz.at/~bci/database/002-2014/S01E.mat [following]\n",
2087
      "--2018-10-12 01:02:39--  https://lampx.tugraz.at/~bci/database/002-2014/S01E.mat\n",
2088
      "Resolving lampx.tugraz.at (lampx.tugraz.at)... 129.27.124.207\n",
2089
      "Connecting to lampx.tugraz.at (lampx.tugraz.at)|129.27.124.207|:443... connected.\n",
2090
      "HTTP request sent, awaiting response... 200 OK\n",
2091
      "Length: 23769588 (23M)\n",
2092
      "Saving to: ‘S01E.mat’\n",
2093
      "\n",
2094
      "S01E.mat            100%[===================>]  22.67M  5.50MB/s    in 5.1s    \n",
2095
      "\n",
2096
      "2018-10-12 01:02:44 (4.43 MB/s) - ‘S01E.mat’ saved [23769588/23769588]\n",
2097
      "\n",
2098
      "\n",
2099
      "(100, 15, 3584)\n",
2100
      "(100,)\n"
2101
     ]
2102
    }
2103
   ],
2104
   "source": [
2105
    "\"\"\"\n",
2106
    "#from brainDecodeSKLearnWrapper.ShallowFBCSPNet_SpecializedTrainer import ShallowFBCSPNet_SpecializedTrainer\n",
2107
    "\n",
2108
    "\n",
2109
    "!wget http://bnci-horizon-2020.eu/database/data-sets/002-2014/S01T.mat\n",
2110
    "!wget http://bnci-horizon-2020.eu/database/data-sets/002-2014/S01E.mat\n",
2111
    "!mkdir BBCIData\n",
2112
    "!mv *.mat BBCIData\n",
2113
    "\n",
2114
    "\n",
2115
    "\"\"\"\n",
2116
    "Now, let's load data.\n",
2117
    "\n",
2118
    "We read the file for the desired subject, and parse the data to extract:\n",
2119
    "- samplingRate\n",
2120
    "- trialLength\n",
2121
    "- X, a M x N x K matrix, which stands for trial x chan x samples\n",
2122
    "    - the actual values are 160 x 15 x 2560\n",
2123
    "- y, a M vector containing the labels {0,1}\n",
2124
    "\n",
2125
    "ref: Dataset description: https://lampx.tugraz.at/~bci/database/002-2014/description.pdf\n",
2126
    "\"\"\"\n",
2127
    "\n",
2128
    "folder = \"BBCIData\"\n",
2129
    "datasetID = 1\n",
2130
    "\n",
2131
    "# prepare data containers\n",
2132
    "y = []\n",
2133
    "X = []\n",
2134
    "\n",
2135
    "f = listdir(folder)[datasetID]\n",
2136
    "  \n",
2137
    "# read file\n",
2138
    "d1T = sio.loadmat(folder + \"/\" + f)\n",
2139
    "\n",
2140
    "samplingRate = d1T['data'][0][0][0][0][3][0][0]\n",
2141
    "trialLength = 7*samplingRate\n",
2142
    "\n",
2143
    "# run through all training runs\n",
2144
    "for run in range(len(d1T['data'][0])):\n",
2145
    "    y.append(d1T['data'][0][run][0][0][2][0]) # labels\n",
2146
    "    timestamps = d1T['data'][0][run][0][0][1][0] # timestamps\n",
2147
    "    rawData = d1T['data'][0][run][0][0][0].transpose() # chan x data\n",
2148
    "\n",
2149
    "    # parse out data based on timestamps\n",
2150
    "    for start in timestamps:\n",
2151
    "        end = start + trialLength\n",
2152
    "        X.append(rawData[:,start:end]) #15 x 2560\n",
2153
    "\n",
2154
    "del rawData\n",
2155
    "del d1T\n",
2156
    "\n",
2157
    "# arrange data into num7py arrays\n",
2158
    "# also torch expect float32 for samples\n",
2159
    "# and int64 for labels {0,1}\n",
2160
    "X = np.array(X).astype(np.float32)\n",
2161
    "y = (np.array(y).flatten()-1).astype(np.int64)\n",
2162
    "print()\n",
2163
    "print(X.shape)\n",
2164
    "print(y.shape)\n",
2165
    "\n",
2166
    "\n",
2167
    "# rand permute dataset\n",
2168
    "idx = np.random.permutation(X.shape[0])\n",
2169
    "\n",
2170
    "X = X[idx,:,:]\n",
2171
    "y = y[idx]\n",
2172
    "\n",
2173
    "\n",
2174
    "\n",
2175
    "\n",
2176
    "\n",
2177
    "\n",
2178
    "\n",
2179
    "#specializedClassifier = ShallowFBCSPNet_SpecializedTrainer(network=classifier.model)\n",
2180
    "#specializedClassifier.lr = 0.01\n",
2181
    "#specializedClassifier.configure(initial_lr=0.01)\n",
2182
    "#specializedClassifier.fit(X,y)\n",
2183
    "\n",
2184
    "\n",
2185
    "\"\"\"\n",
2186
    "\n"
2187
   ]
2188
  },
2189
  {
2190
   "cell_type": "code",
2191
   "execution_count": 0,
2192
   "metadata": {
2193
    "colab": {
2194
     "base_uri": "https://localhost:8080/",
2195
     "height": 13634
2196
    },
2197
    "colab_type": "code",
2198
    "id": "qwZGsiv2S653",
2199
    "outputId": "0a10306c-ef39-454d-8174-96ca8debab0a"
2200
   },
2201
   "outputs": [
2202
    {
2203
     "name": "stdout",
2204
     "output_type": "stream",
2205
     "text": [
2206
      "Epoch 0\n",
2207
      "Train  Loss: 0.40867\n",
2208
      "Train  Accuracy: 79.3%\n",
2209
      "Test   Loss: 1.06219\n",
2210
      "Test   Accuracy: 38.5%\n",
2211
      "Epoch 1\n",
2212
      "Train  Loss: 0.24243\n",
2213
      "Train  Accuracy: 97.7%\n",
2214
      "Test   Loss: 1.22067\n",
2215
      "Test   Accuracy: 30.8%\n",
2216
      "Epoch 2\n",
2217
      "Train  Loss: 0.15374\n",
2218
      "Train  Accuracy: 98.9%\n",
2219
      "Test   Loss: 1.23056\n",
2220
      "Test   Accuracy: 46.2%\n",
2221
      "Epoch 3\n",
2222
      "Train  Loss: 0.10635\n",
2223
      "Train  Accuracy: 100.0%\n",
2224
      "Test   Loss: 1.24592\n",
2225
      "Test   Accuracy: 53.8%\n",
2226
      "Epoch 4\n",
2227
      "Train  Loss: 0.07798\n",
2228
      "Train  Accuracy: 100.0%\n",
2229
      "Test   Loss: 1.24732\n",
2230
      "Test   Accuracy: 46.2%\n",
2231
      "Epoch 5\n",
2232
      "Train  Loss: 0.05839\n",
2233
      "Train  Accuracy: 100.0%\n",
2234
      "Test   Loss: 1.29423\n",
2235
      "Test   Accuracy: 46.2%\n",
2236
      "Epoch 6\n",
2237
      "Train  Loss: 0.04658\n",
2238
      "Train  Accuracy: 100.0%\n",
2239
      "Test   Loss: 1.35518\n",
2240
      "Test   Accuracy: 46.2%\n",
2241
      "Epoch 7\n",
2242
      "Train  Loss: 0.03919\n",
2243
      "Train  Accuracy: 100.0%\n",
2244
      "Test   Loss: 1.43166\n",
2245
      "Test   Accuracy: 46.2%\n",
2246
      "Epoch 8\n",
2247
      "Train  Loss: 0.03243\n",
2248
      "Train  Accuracy: 100.0%\n",
2249
      "Test   Loss: 1.48398\n",
2250
      "Test   Accuracy: 46.2%\n",
2251
      "Epoch 9\n",
2252
      "Train  Loss: 0.02648\n",
2253
      "Train  Accuracy: 100.0%\n",
2254
      "Test   Loss: 1.53610\n",
2255
      "Test   Accuracy: 46.2%\n",
2256
      "Epoch 10\n",
2257
      "Train  Loss: 0.02174\n",
2258
      "Train  Accuracy: 100.0%\n",
2259
      "Test   Loss: 1.57515\n",
2260
      "Test   Accuracy: 46.2%\n",
2261
      "Epoch 11\n",
2262
      "Train  Loss: 0.01962\n",
2263
      "Train  Accuracy: 100.0%\n",
2264
      "Test   Loss: 1.59625\n",
2265
      "Test   Accuracy: 46.2%\n",
2266
      "Epoch 12\n",
2267
      "Train  Loss: 0.01830\n",
2268
      "Train  Accuracy: 100.0%\n",
2269
      "Test   Loss: 1.60808\n",
2270
      "Test   Accuracy: 46.2%\n",
2271
      "Epoch 13\n",
2272
      "Train  Loss: 0.01781\n",
2273
      "Train  Accuracy: 100.0%\n",
2274
      "Test   Loss: 1.61399\n",
2275
      "Test   Accuracy: 46.2%\n",
2276
      "Epoch 14\n",
2277
      "Train  Loss: 0.01724\n",
2278
      "Train  Accuracy: 100.0%\n",
2279
      "Test   Loss: 1.62325\n",
2280
      "Test   Accuracy: 46.2%\n",
2281
      "Epoch 15\n",
2282
      "Train  Loss: 0.01621\n",
2283
      "Train  Accuracy: 100.0%\n",
2284
      "Test   Loss: 1.62646\n",
2285
      "Test   Accuracy: 53.8%\n",
2286
      "Epoch 16\n",
2287
      "Train  Loss: 0.01563\n",
2288
      "Train  Accuracy: 100.0%\n",
2289
      "Test   Loss: 1.64470\n",
2290
      "Test   Accuracy: 53.8%\n",
2291
      "Epoch 17\n",
2292
      "Train  Loss: 0.01386\n",
2293
      "Train  Accuracy: 100.0%\n",
2294
      "Test   Loss: 1.67457\n",
2295
      "Test   Accuracy: 53.8%\n",
2296
      "Epoch 18\n",
2297
      "Train  Loss: 0.01249\n",
2298
      "Train  Accuracy: 100.0%\n",
2299
      "Test   Loss: 1.72219\n",
2300
      "Test   Accuracy: 46.2%\n",
2301
      "Epoch 19\n",
2302
      "Train  Loss: 0.01077\n",
2303
      "Train  Accuracy: 100.0%\n",
2304
      "Test   Loss: 1.75488\n",
2305
      "Test   Accuracy: 46.2%\n",
2306
      "Epoch 20\n",
2307
      "Train  Loss: 0.00932\n",
2308
      "Train  Accuracy: 100.0%\n",
2309
      "Test   Loss: 1.76248\n",
2310
      "Test   Accuracy: 46.2%\n",
2311
      "Epoch 21\n",
2312
      "Train  Loss: 0.00881\n",
2313
      "Train  Accuracy: 100.0%\n",
2314
      "Test   Loss: 1.77271\n",
2315
      "Test   Accuracy: 46.2%\n",
2316
      "Epoch 22\n",
2317
      "Train  Loss: 0.00799\n",
2318
      "Train  Accuracy: 100.0%\n",
2319
      "Test   Loss: 1.81269\n",
2320
      "Test   Accuracy: 46.2%\n",
2321
      "Epoch 23\n",
2322
      "Train  Loss: 0.00725\n",
2323
      "Train  Accuracy: 100.0%\n",
2324
      "Test   Loss: 1.86557\n",
2325
      "Test   Accuracy: 46.2%\n",
2326
      "Epoch 24\n",
2327
      "Train  Loss: 0.00632\n",
2328
      "Train  Accuracy: 100.0%\n",
2329
      "Test   Loss: 1.97068\n",
2330
      "Test   Accuracy: 46.2%\n",
2331
      "Epoch 25\n",
2332
      "Train  Loss: 0.00730\n",
2333
      "Train  Accuracy: 100.0%\n",
2334
      "Test   Loss: 2.08166\n",
2335
      "Test   Accuracy: 53.8%\n",
2336
      "Epoch 26\n",
2337
      "Train  Loss: 0.00780\n",
2338
      "Train  Accuracy: 100.0%\n",
2339
      "Test   Loss: 2.07707\n",
2340
      "Test   Accuracy: 53.8%\n",
2341
      "Epoch 27\n",
2342
      "Train  Loss: 0.00639\n",
2343
      "Train  Accuracy: 100.0%\n",
2344
      "Test   Loss: 2.00143\n",
2345
      "Test   Accuracy: 53.8%\n",
2346
      "Epoch 28\n",
2347
      "Train  Loss: 0.00608\n",
2348
      "Train  Accuracy: 100.0%\n",
2349
      "Test   Loss: 1.96633\n",
2350
      "Test   Accuracy: 53.8%\n",
2351
      "Epoch 29\n",
2352
      "Train  Loss: 0.00571\n",
2353
      "Train  Accuracy: 100.0%\n",
2354
      "Test   Loss: 1.94421\n",
2355
      "Test   Accuracy: 53.8%\n",
2356
      "Epoch 30\n",
2357
      "Train  Loss: 0.00569\n",
2358
      "Train  Accuracy: 100.0%\n",
2359
      "Test   Loss: 1.94688\n",
2360
      "Test   Accuracy: 53.8%\n",
2361
      "Epoch 31\n",
2362
      "Train  Loss: 0.00567\n",
2363
      "Train  Accuracy: 100.0%\n",
2364
      "Test   Loss: 1.94852\n",
2365
      "Test   Accuracy: 53.8%\n",
2366
      "Epoch 32\n",
2367
      "Train  Loss: 0.00562\n",
2368
      "Train  Accuracy: 100.0%\n",
2369
      "Test   Loss: 1.95141\n",
2370
      "Test   Accuracy: 53.8%\n",
2371
      "Epoch 33\n",
2372
      "Train  Loss: 0.00558\n",
2373
      "Train  Accuracy: 100.0%\n",
2374
      "Test   Loss: 1.95666\n",
2375
      "Test   Accuracy: 53.8%\n",
2376
      "Epoch 34\n",
2377
      "Train  Loss: 0.00551\n",
2378
      "Train  Accuracy: 100.0%\n",
2379
      "Test   Loss: 1.96861\n",
2380
      "Test   Accuracy: 53.8%\n",
2381
      "Epoch 35\n",
2382
      "Train  Loss: 0.00546\n",
2383
      "Train  Accuracy: 100.0%\n",
2384
      "Test   Loss: 1.98547\n",
2385
      "Test   Accuracy: 53.8%\n",
2386
      "Epoch 36\n",
2387
      "Train  Loss: 0.00543\n",
2388
      "Train  Accuracy: 100.0%\n",
2389
      "Test   Loss: 2.00147\n",
2390
      "Test   Accuracy: 53.8%\n",
2391
      "Epoch 37\n",
2392
      "Train  Loss: 0.00538\n",
2393
      "Train  Accuracy: 100.0%\n",
2394
      "Test   Loss: 2.01262\n",
2395
      "Test   Accuracy: 53.8%\n",
2396
      "Epoch 38\n",
2397
      "Train  Loss: 0.00530\n",
2398
      "Train  Accuracy: 100.0%\n",
2399
      "Test   Loss: 2.01655\n",
2400
      "Test   Accuracy: 53.8%\n",
2401
      "Epoch 39\n",
2402
      "Train  Loss: 0.00525\n",
2403
      "Train  Accuracy: 100.0%\n",
2404
      "Test   Loss: 2.02344\n",
2405
      "Test   Accuracy: 53.8%\n",
2406
      "Epoch 40\n",
2407
      "Train  Loss: 0.00516\n",
2408
      "Train  Accuracy: 100.0%\n",
2409
      "Test   Loss: 2.02964\n",
2410
      "Test   Accuracy: 53.8%\n",
2411
      "Epoch 41\n",
2412
      "Train  Loss: 0.00504\n",
2413
      "Train  Accuracy: 100.0%\n",
2414
      "Test   Loss: 2.03204\n",
2415
      "Test   Accuracy: 53.8%\n",
2416
      "Epoch 42\n",
2417
      "Train  Loss: 0.00492\n",
2418
      "Train  Accuracy: 100.0%\n",
2419
      "Test   Loss: 2.03074\n",
2420
      "Test   Accuracy: 53.8%\n",
2421
      "Epoch 43\n",
2422
      "Train  Loss: 0.00481\n",
2423
      "Train  Accuracy: 100.0%\n",
2424
      "Test   Loss: 2.03596\n",
2425
      "Test   Accuracy: 53.8%\n",
2426
      "Epoch 44\n",
2427
      "Train  Loss: 0.00473\n",
2428
      "Train  Accuracy: 100.0%\n",
2429
      "Test   Loss: 2.04009\n",
2430
      "Test   Accuracy: 53.8%\n",
2431
      "Epoch 45\n",
2432
      "Train  Loss: 0.00463\n",
2433
      "Train  Accuracy: 100.0%\n",
2434
      "Test   Loss: 2.04249\n",
2435
      "Test   Accuracy: 53.8%\n",
2436
      "Epoch 46\n",
2437
      "Train  Loss: 0.00453\n",
2438
      "Train  Accuracy: 100.0%\n",
2439
      "Test   Loss: 2.04992\n",
2440
      "Test   Accuracy: 53.8%\n",
2441
      "Epoch 47\n",
2442
      "Train  Loss: 0.00446\n",
2443
      "Train  Accuracy: 100.0%\n",
2444
      "Test   Loss: 2.05741\n",
2445
      "Test   Accuracy: 53.8%\n",
2446
      "Epoch 48\n",
2447
      "Train  Loss: 0.00440\n",
2448
      "Train  Accuracy: 100.0%\n",
2449
      "Test   Loss: 2.06373\n",
2450
      "Test   Accuracy: 53.8%\n",
2451
      "Epoch 49\n",
2452
      "Train  Loss: 0.00436\n",
2453
      "Train  Accuracy: 100.0%\n",
2454
      "Test   Loss: 2.07039\n",
2455
      "Test   Accuracy: 53.8%\n",
2456
      "Epoch 50\n",
2457
      "Train  Loss: 0.00432\n",
2458
      "Train  Accuracy: 100.0%\n",
2459
      "Test   Loss: 2.07497\n",
2460
      "Test   Accuracy: 53.8%\n",
2461
      "Epoch 51\n",
2462
      "Train  Loss: 0.00429\n",
2463
      "Train  Accuracy: 100.0%\n",
2464
      "Test   Loss: 2.08456\n",
2465
      "Test   Accuracy: 53.8%\n",
2466
      "Epoch 52\n",
2467
      "Train  Loss: 0.00427\n",
2468
      "Train  Accuracy: 100.0%\n",
2469
      "Test   Loss: 2.09127\n",
2470
      "Test   Accuracy: 53.8%\n",
2471
      "Epoch 53\n",
2472
      "Train  Loss: 0.00426\n",
2473
      "Train  Accuracy: 100.0%\n",
2474
      "Test   Loss: 2.09950\n",
2475
      "Test   Accuracy: 53.8%\n",
2476
      "Epoch 54\n",
2477
      "Train  Loss: 0.00425\n",
2478
      "Train  Accuracy: 100.0%\n",
2479
      "Test   Loss: 2.10576\n",
2480
      "Test   Accuracy: 53.8%\n",
2481
      "Epoch 55\n",
2482
      "Train  Loss: 0.00423\n",
2483
      "Train  Accuracy: 100.0%\n",
2484
      "Test   Loss: 2.10707\n",
2485
      "Test   Accuracy: 53.8%\n",
2486
      "Epoch 56\n",
2487
      "Train  Loss: 0.00419\n",
2488
      "Train  Accuracy: 100.0%\n",
2489
      "Test   Loss: 2.11180\n",
2490
      "Test   Accuracy: 53.8%\n",
2491
      "Epoch 57\n",
2492
      "Train  Loss: 0.00414\n",
2493
      "Train  Accuracy: 100.0%\n",
2494
      "Test   Loss: 2.11794\n",
2495
      "Test   Accuracy: 53.8%\n",
2496
      "Epoch 58\n",
2497
      "Train  Loss: 0.00409\n",
2498
      "Train  Accuracy: 100.0%\n",
2499
      "Test   Loss: 2.12871\n",
2500
      "Test   Accuracy: 53.8%\n",
2501
      "Epoch 59\n",
2502
      "Train  Loss: 0.00405\n",
2503
      "Train  Accuracy: 100.0%\n",
2504
      "Test   Loss: 2.13115\n",
2505
      "Test   Accuracy: 53.8%\n",
2506
      "Epoch 60\n",
2507
      "Train  Loss: 0.00405\n",
2508
      "Train  Accuracy: 100.0%\n",
2509
      "Test   Loss: 2.13248\n",
2510
      "Test   Accuracy: 53.8%\n",
2511
      "Epoch 61\n",
2512
      "Train  Loss: 0.00405\n",
2513
      "Train  Accuracy: 100.0%\n",
2514
      "Test   Loss: 2.13286\n",
2515
      "Test   Accuracy: 53.8%\n",
2516
      "Epoch 62\n",
2517
      "Train  Loss: 0.00404\n",
2518
      "Train  Accuracy: 100.0%\n",
2519
      "Test   Loss: 2.13316\n",
2520
      "Test   Accuracy: 53.8%\n",
2521
      "Epoch 63\n",
2522
      "Train  Loss: 0.00404\n",
2523
      "Train  Accuracy: 100.0%\n",
2524
      "Test   Loss: 2.13328\n",
2525
      "Test   Accuracy: 53.8%\n",
2526
      "Epoch 64\n",
2527
      "Train  Loss: 0.00403\n",
2528
      "Train  Accuracy: 100.0%\n",
2529
      "Test   Loss: 2.13382\n",
2530
      "Test   Accuracy: 53.8%\n",
2531
      "Epoch 65\n",
2532
      "Train  Loss: 0.00402\n",
2533
      "Train  Accuracy: 100.0%\n",
2534
      "Test   Loss: 2.13440\n",
2535
      "Test   Accuracy: 53.8%\n",
2536
      "Epoch 66\n",
2537
      "Train  Loss: 0.00402\n",
2538
      "Train  Accuracy: 100.0%\n",
2539
      "Test   Loss: 2.13462\n",
2540
      "Test   Accuracy: 53.8%\n",
2541
      "Epoch 67\n",
2542
      "Train  Loss: 0.00401\n",
2543
      "Train  Accuracy: 100.0%\n",
2544
      "Test   Loss: 2.13428\n",
2545
      "Test   Accuracy: 53.8%\n",
2546
      "Epoch 68\n",
2547
      "Train  Loss: 0.00400\n",
2548
      "Train  Accuracy: 100.0%\n",
2549
      "Test   Loss: 2.13436\n",
2550
      "Test   Accuracy: 53.8%\n",
2551
      "Epoch 69\n",
2552
      "Train  Loss: 0.00400\n",
2553
      "Train  Accuracy: 100.0%\n",
2554
      "Test   Loss: 2.13464\n",
2555
      "Test   Accuracy: 53.8%\n",
2556
      "Epoch 70\n",
2557
      "Train  Loss: 0.00399\n",
2558
      "Train  Accuracy: 100.0%\n",
2559
      "Test   Loss: 2.13525\n",
2560
      "Test   Accuracy: 53.8%\n",
2561
      "Epoch 71\n",
2562
      "Train  Loss: 0.00399\n",
2563
      "Train  Accuracy: 100.0%\n",
2564
      "Test   Loss: 2.13552\n",
2565
      "Test   Accuracy: 53.8%\n",
2566
      "Epoch 72\n",
2567
      "Train  Loss: 0.00399\n",
2568
      "Train  Accuracy: 100.0%\n",
2569
      "Test   Loss: 2.13632\n",
2570
      "Test   Accuracy: 53.8%\n",
2571
      "Epoch 73\n",
2572
      "Train  Loss: 0.00398\n",
2573
      "Train  Accuracy: 100.0%\n",
2574
      "Test   Loss: 2.13719\n",
2575
      "Test   Accuracy: 53.8%\n",
2576
      "Epoch 74\n",
2577
      "Train  Loss: 0.00398\n",
2578
      "Train  Accuracy: 100.0%\n",
2579
      "Test   Loss: 2.13816\n",
2580
      "Test   Accuracy: 53.8%\n",
2581
      "Epoch 75\n",
2582
      "Train  Loss: 0.00398\n",
2583
      "Train  Accuracy: 100.0%\n",
2584
      "Test   Loss: 2.13821\n",
2585
      "Test   Accuracy: 53.8%\n",
2586
      "Epoch 76\n",
2587
      "Train  Loss: 0.00398\n",
2588
      "Train  Accuracy: 100.0%\n",
2589
      "Test   Loss: 2.13820\n",
2590
      "Test   Accuracy: 53.8%\n",
2591
      "Epoch 77\n",
2592
      "Train  Loss: 0.00397\n",
2593
      "Train  Accuracy: 100.0%\n",
2594
      "Test   Loss: 2.13875\n",
2595
      "Test   Accuracy: 53.8%\n",
2596
      "Epoch 78\n",
2597
      "Train  Loss: 0.00396\n",
2598
      "Train  Accuracy: 100.0%\n",
2599
      "Test   Loss: 2.13890\n",
2600
      "Test   Accuracy: 53.8%\n",
2601
      "Epoch 79\n",
2602
      "Train  Loss: 0.00396\n",
2603
      "Train  Accuracy: 100.0%\n",
2604
      "Test   Loss: 2.13842\n",
2605
      "Test   Accuracy: 53.8%\n",
2606
      "Epoch 80\n",
2607
      "Train  Loss: 0.00395\n",
2608
      "Train  Accuracy: 100.0%\n",
2609
      "Test   Loss: 2.13933\n",
2610
      "Test   Accuracy: 53.8%\n",
2611
      "Epoch 81\n",
2612
      "Train  Loss: 0.00394\n",
2613
      "Train  Accuracy: 100.0%\n",
2614
      "Test   Loss: 2.14047\n",
2615
      "Test   Accuracy: 53.8%\n",
2616
      "Epoch 82\n",
2617
      "Train  Loss: 0.00393\n",
2618
      "Train  Accuracy: 100.0%\n",
2619
      "Test   Loss: 2.14105\n",
2620
      "Test   Accuracy: 53.8%\n",
2621
      "Epoch 83\n",
2622
      "Train  Loss: 0.00393\n",
2623
      "Train  Accuracy: 100.0%\n",
2624
      "Test   Loss: 2.14127\n",
2625
      "Test   Accuracy: 53.8%\n",
2626
      "Epoch 84\n",
2627
      "Train  Loss: 0.00392\n",
2628
      "Train  Accuracy: 100.0%\n",
2629
      "Test   Loss: 2.14174\n",
2630
      "Test   Accuracy: 53.8%\n",
2631
      "Epoch 85\n",
2632
      "Train  Loss: 0.00391\n",
2633
      "Train  Accuracy: 100.0%\n",
2634
      "Test   Loss: 2.14166\n",
2635
      "Test   Accuracy: 53.8%\n",
2636
      "Epoch 86\n",
2637
      "Train  Loss: 0.00390\n",
2638
      "Train  Accuracy: 100.0%\n",
2639
      "Test   Loss: 2.14085\n",
2640
      "Test   Accuracy: 53.8%\n",
2641
      "Epoch 87\n",
2642
      "Train  Loss: 0.00390\n",
2643
      "Train  Accuracy: 100.0%\n",
2644
      "Test   Loss: 2.13996\n",
2645
      "Test   Accuracy: 53.8%\n",
2646
      "Epoch 88\n",
2647
      "Train  Loss: 0.00389\n",
2648
      "Train  Accuracy: 100.0%\n",
2649
      "Test   Loss: 2.13915\n",
2650
      "Test   Accuracy: 53.8%\n",
2651
      "Epoch 89\n",
2652
      "Train  Loss: 0.00388\n",
2653
      "Train  Accuracy: 100.0%\n",
2654
      "Test   Loss: 2.13885\n",
2655
      "Test   Accuracy: 53.8%\n",
2656
      "Epoch 90\n",
2657
      "Train  Loss: 0.00387\n",
2658
      "Train  Accuracy: 100.0%\n",
2659
      "Test   Loss: 2.13894\n",
2660
      "Test   Accuracy: 53.8%\n",
2661
      "Epoch 91\n",
2662
      "Train  Loss: 0.00387\n",
2663
      "Train  Accuracy: 100.0%\n",
2664
      "Test   Loss: 2.13896\n",
2665
      "Test   Accuracy: 53.8%\n",
2666
      "Epoch 92\n",
2667
      "Train  Loss: 0.00387\n",
2668
      "Train  Accuracy: 100.0%\n",
2669
      "Test   Loss: 2.13886\n",
2670
      "Test   Accuracy: 53.8%\n",
2671
      "Epoch 93\n",
2672
      "Train  Loss: 0.00387\n",
2673
      "Train  Accuracy: 100.0%\n",
2674
      "Test   Loss: 2.13902\n",
2675
      "Test   Accuracy: 53.8%\n",
2676
      "Epoch 94\n",
2677
      "Train  Loss: 0.00387\n",
2678
      "Train  Accuracy: 100.0%\n",
2679
      "Test   Loss: 2.13901\n",
2680
      "Test   Accuracy: 53.8%\n",
2681
      "Epoch 95\n",
2682
      "Train  Loss: 0.00387\n",
2683
      "Train  Accuracy: 100.0%\n",
2684
      "Test   Loss: 2.13912\n",
2685
      "Test   Accuracy: 53.8%\n",
2686
      "Epoch 96\n",
2687
      "Train  Loss: 0.00387\n",
2688
      "Train  Accuracy: 100.0%\n",
2689
      "Test   Loss: 2.13882\n",
2690
      "Test   Accuracy: 53.8%\n",
2691
      "Epoch 97\n",
2692
      "Train  Loss: 0.00387\n",
2693
      "Train  Accuracy: 100.0%\n",
2694
      "Test   Loss: 2.13943\n",
2695
      "Test   Accuracy: 53.8%\n",
2696
      "Epoch 98\n",
2697
      "Train  Loss: 0.00387\n",
2698
      "Train  Accuracy: 100.0%\n",
2699
      "Test   Loss: 2.13955\n",
2700
      "Test   Accuracy: 53.8%\n",
2701
      "Epoch 99\n",
2702
      "Train  Loss: 0.00387\n",
2703
      "Train  Accuracy: 100.0%\n",
2704
      "Test   Loss: 2.13953\n",
2705
      "Test   Accuracy: 53.8%\n",
2706
      "Epoch 100\n",
2707
      "Train  Loss: 0.00387\n",
2708
      "Train  Accuracy: 100.0%\n",
2709
      "Test   Loss: 2.13966\n",
2710
      "Test   Accuracy: 53.8%\n",
2711
      "Epoch 101\n",
2712
      "Train  Loss: 0.00387\n",
2713
      "Train  Accuracy: 100.0%\n",
2714
      "Test   Loss: 2.14003\n",
2715
      "Test   Accuracy: 53.8%\n",
2716
      "Epoch 102\n",
2717
      "Train  Loss: 0.00387\n",
2718
      "Train  Accuracy: 100.0%\n",
2719
      "Test   Loss: 2.14016\n",
2720
      "Test   Accuracy: 53.8%\n",
2721
      "Epoch 103\n",
2722
      "Train  Loss: 0.00387\n",
2723
      "Train  Accuracy: 100.0%\n",
2724
      "Test   Loss: 2.14000\n",
2725
      "Test   Accuracy: 53.8%\n",
2726
      "Epoch 104\n",
2727
      "Train  Loss: 0.00387\n",
2728
      "Train  Accuracy: 100.0%\n",
2729
      "Test   Loss: 2.13978\n",
2730
      "Test   Accuracy: 53.8%\n",
2731
      "Epoch 105\n",
2732
      "Train  Loss: 0.00387\n",
2733
      "Train  Accuracy: 100.0%\n",
2734
      "Test   Loss: 2.13973\n",
2735
      "Test   Accuracy: 53.8%\n",
2736
      "Epoch 106\n",
2737
      "Train  Loss: 0.00387\n",
2738
      "Train  Accuracy: 100.0%\n",
2739
      "Test   Loss: 2.13930\n",
2740
      "Test   Accuracy: 53.8%\n",
2741
      "Epoch 107\n",
2742
      "Train  Loss: 0.00387\n",
2743
      "Train  Accuracy: 100.0%\n",
2744
      "Test   Loss: 2.13915\n",
2745
      "Test   Accuracy: 53.8%\n",
2746
      "Epoch 108\n",
2747
      "Train  Loss: 0.00387\n",
2748
      "Train  Accuracy: 100.0%\n",
2749
      "Test   Loss: 2.13888\n",
2750
      "Test   Accuracy: 53.8%\n",
2751
      "Epoch 109\n",
2752
      "Train  Loss: 0.00387\n",
2753
      "Train  Accuracy: 100.0%\n",
2754
      "Test   Loss: 2.13888\n",
2755
      "Test   Accuracy: 53.8%\n",
2756
      "Epoch 110\n",
2757
      "Train  Loss: 0.00387\n",
2758
      "Train  Accuracy: 100.0%\n",
2759
      "Test   Loss: 2.13877\n",
2760
      "Test   Accuracy: 53.8%\n",
2761
      "Epoch 111\n",
2762
      "Train  Loss: 0.00387\n",
2763
      "Train  Accuracy: 100.0%\n",
2764
      "Test   Loss: 2.13868\n",
2765
      "Test   Accuracy: 53.8%\n",
2766
      "Epoch 112\n",
2767
      "Train  Loss: 0.00386\n",
2768
      "Train  Accuracy: 100.0%\n",
2769
      "Test   Loss: 2.13817\n",
2770
      "Test   Accuracy: 53.8%\n",
2771
      "Epoch 113\n",
2772
      "Train  Loss: 0.00386\n",
2773
      "Train  Accuracy: 100.0%\n",
2774
      "Test   Loss: 2.13880\n",
2775
      "Test   Accuracy: 53.8%\n",
2776
      "Epoch 114\n",
2777
      "Train  Loss: 0.00386\n",
2778
      "Train  Accuracy: 100.0%\n",
2779
      "Test   Loss: 2.13896\n",
2780
      "Test   Accuracy: 53.8%\n",
2781
      "Epoch 115\n",
2782
      "Train  Loss: 0.00386\n",
2783
      "Train  Accuracy: 100.0%\n",
2784
      "Test   Loss: 2.13874\n",
2785
      "Test   Accuracy: 53.8%\n",
2786
      "Epoch 116\n",
2787
      "Train  Loss: 0.00386\n",
2788
      "Train  Accuracy: 100.0%\n",
2789
      "Test   Loss: 2.13832\n",
2790
      "Test   Accuracy: 53.8%\n",
2791
      "Epoch 117\n",
2792
      "Train  Loss: 0.00386\n",
2793
      "Train  Accuracy: 100.0%\n",
2794
      "Test   Loss: 2.13847\n",
2795
      "Test   Accuracy: 53.8%\n",
2796
      "Epoch 118\n",
2797
      "Train  Loss: 0.00386\n",
2798
      "Train  Accuracy: 100.0%\n",
2799
      "Test   Loss: 2.13856\n",
2800
      "Test   Accuracy: 53.8%\n",
2801
      "Epoch 119\n",
2802
      "Train  Loss: 0.00386\n",
2803
      "Train  Accuracy: 100.0%\n",
2804
      "Test   Loss: 2.13898\n",
2805
      "Test   Accuracy: 53.8%\n",
2806
      "Epoch 120\n",
2807
      "Train  Loss: 0.00386\n",
2808
      "Train  Accuracy: 100.0%\n",
2809
      "Test   Loss: 2.13897\n",
2810
      "Test   Accuracy: 53.8%\n",
2811
      "Epoch 121\n",
2812
      "Train  Loss: 0.00386\n",
2813
      "Train  Accuracy: 100.0%\n",
2814
      "Test   Loss: 2.13901\n",
2815
      "Test   Accuracy: 53.8%\n",
2816
      "Epoch 122\n",
2817
      "Train  Loss: 0.00386\n",
2818
      "Train  Accuracy: 100.0%\n",
2819
      "Test   Loss: 2.13867\n",
2820
      "Test   Accuracy: 53.8%\n",
2821
      "Epoch 123\n",
2822
      "Train  Loss: 0.00386\n",
2823
      "Train  Accuracy: 100.0%\n",
2824
      "Test   Loss: 2.13857\n",
2825
      "Test   Accuracy: 53.8%\n",
2826
      "Epoch 124\n",
2827
      "Train  Loss: 0.00386\n",
2828
      "Train  Accuracy: 100.0%\n",
2829
      "Test   Loss: 2.13831\n",
2830
      "Test   Accuracy: 53.8%\n",
2831
      "Epoch 125\n",
2832
      "Train  Loss: 0.00386\n",
2833
      "Train  Accuracy: 100.0%\n",
2834
      "Test   Loss: 2.13839\n",
2835
      "Test   Accuracy: 53.8%\n",
2836
      "Epoch 126\n",
2837
      "Train  Loss: 0.00386\n",
2838
      "Train  Accuracy: 100.0%\n",
2839
      "Test   Loss: 2.13884\n",
2840
      "Test   Accuracy: 53.8%\n",
2841
      "Epoch 127\n",
2842
      "Train  Loss: 0.00386\n",
2843
      "Train  Accuracy: 100.0%\n",
2844
      "Test   Loss: 2.13885\n",
2845
      "Test   Accuracy: 53.8%\n",
2846
      "Epoch 128\n",
2847
      "Train  Loss: 0.00386\n",
2848
      "Train  Accuracy: 100.0%\n",
2849
      "Test   Loss: 2.13878\n",
2850
      "Test   Accuracy: 53.8%\n",
2851
      "Epoch 129\n",
2852
      "Train  Loss: 0.00386\n",
2853
      "Train  Accuracy: 100.0%\n",
2854
      "Test   Loss: 2.13850\n",
2855
      "Test   Accuracy: 53.8%\n",
2856
      "Epoch 130\n",
2857
      "Train  Loss: 0.00386\n",
2858
      "Train  Accuracy: 100.0%\n",
2859
      "Test   Loss: 2.13828\n",
2860
      "Test   Accuracy: 53.8%\n",
2861
      "Epoch 131\n",
2862
      "Train  Loss: 0.00386\n",
2863
      "Train  Accuracy: 100.0%\n",
2864
      "Test   Loss: 2.13847\n",
2865
      "Test   Accuracy: 53.8%\n",
2866
      "Epoch 132\n",
2867
      "Train  Loss: 0.00386\n",
2868
      "Train  Accuracy: 100.0%\n",
2869
      "Test   Loss: 2.13831\n",
2870
      "Test   Accuracy: 53.8%\n",
2871
      "Epoch 133\n",
2872
      "Train  Loss: 0.00386\n",
2873
      "Train  Accuracy: 100.0%\n",
2874
      "Test   Loss: 2.13801\n",
2875
      "Test   Accuracy: 53.8%\n",
2876
      "Epoch 134\n",
2877
      "Train  Loss: 0.00386\n",
2878
      "Train  Accuracy: 100.0%\n",
2879
      "Test   Loss: 2.13848\n",
2880
      "Test   Accuracy: 53.8%\n",
2881
      "Epoch 135\n",
2882
      "Train  Loss: 0.00386\n",
2883
      "Train  Accuracy: 100.0%\n",
2884
      "Test   Loss: 2.13844\n",
2885
      "Test   Accuracy: 53.8%\n",
2886
      "Epoch 136\n",
2887
      "Train  Loss: 0.00386\n",
2888
      "Train  Accuracy: 100.0%\n",
2889
      "Test   Loss: 2.13881\n",
2890
      "Test   Accuracy: 53.8%\n",
2891
      "Epoch 137\n",
2892
      "Train  Loss: 0.00386\n",
2893
      "Train  Accuracy: 100.0%\n",
2894
      "Test   Loss: 2.13926\n",
2895
      "Test   Accuracy: 53.8%\n",
2896
      "Epoch 138\n",
2897
      "Train  Loss: 0.00386\n",
2898
      "Train  Accuracy: 100.0%\n",
2899
      "Test   Loss: 2.13873\n",
2900
      "Test   Accuracy: 53.8%\n",
2901
      "Epoch 139\n",
2902
      "Train  Loss: 0.00386\n",
2903
      "Train  Accuracy: 100.0%\n",
2904
      "Test   Loss: 2.13843\n",
2905
      "Test   Accuracy: 53.8%\n",
2906
      "Epoch 140\n",
2907
      "Train  Loss: 0.00386\n",
2908
      "Train  Accuracy: 100.0%\n",
2909
      "Test   Loss: 2.13863\n",
2910
      "Test   Accuracy: 53.8%\n",
2911
      "Epoch 141\n",
2912
      "Train  Loss: 0.00386\n",
2913
      "Train  Accuracy: 100.0%\n",
2914
      "Test   Loss: 2.13880\n",
2915
      "Test   Accuracy: 53.8%\n",
2916
      "Epoch 142\n",
2917
      "Train  Loss: 0.00386\n",
2918
      "Train  Accuracy: 100.0%\n",
2919
      "Test   Loss: 2.13882\n",
2920
      "Test   Accuracy: 53.8%\n",
2921
      "Epoch 143\n",
2922
      "Train  Loss: 0.00386\n",
2923
      "Train  Accuracy: 100.0%\n",
2924
      "Test   Loss: 2.13900\n",
2925
      "Test   Accuracy: 53.8%\n",
2926
      "Epoch 144\n",
2927
      "Train  Loss: 0.00386\n",
2928
      "Train  Accuracy: 100.0%\n",
2929
      "Test   Loss: 2.13884\n",
2930
      "Test   Accuracy: 53.8%\n",
2931
      "Epoch 145\n",
2932
      "Train  Loss: 0.00386\n",
2933
      "Train  Accuracy: 100.0%\n",
2934
      "Test   Loss: 2.13905\n",
2935
      "Test   Accuracy: 53.8%\n",
2936
      "Epoch 146\n",
2937
      "Train  Loss: 0.00386\n",
2938
      "Train  Accuracy: 100.0%\n",
2939
      "Test   Loss: 2.13930\n",
2940
      "Test   Accuracy: 53.8%\n",
2941
      "Epoch 147\n",
2942
      "Train  Loss: 0.00386\n",
2943
      "Train  Accuracy: 100.0%\n",
2944
      "Test   Loss: 2.13904\n",
2945
      "Test   Accuracy: 53.8%\n",
2946
      "Epoch 148\n",
2947
      "Train  Loss: 0.00386\n",
2948
      "Train  Accuracy: 100.0%\n",
2949
      "Test   Loss: 2.13910\n",
2950
      "Test   Accuracy: 53.8%\n",
2951
      "Epoch 149\n",
2952
      "Train  Loss: 0.00386\n",
2953
      "Train  Accuracy: 100.0%\n",
2954
      "Test   Loss: 2.13929\n",
2955
      "Test   Accuracy: 53.8%\n",
2956
      "Epoch 150\n",
2957
      "Train  Loss: 0.00386\n",
2958
      "Train  Accuracy: 100.0%\n",
2959
      "Test   Loss: 2.13936\n",
2960
      "Test   Accuracy: 53.8%\n",
2961
      "Epoch 151\n",
2962
      "Train  Loss: 0.00386\n",
2963
      "Train  Accuracy: 100.0%\n",
2964
      "Test   Loss: 2.13922\n",
2965
      "Test   Accuracy: 53.8%\n",
2966
      "Epoch 152\n",
2967
      "Train  Loss: 0.00386\n",
2968
      "Train  Accuracy: 100.0%\n",
2969
      "Test   Loss: 2.13914\n",
2970
      "Test   Accuracy: 53.8%\n",
2971
      "Epoch 153\n",
2972
      "Train  Loss: 0.00386\n",
2973
      "Train  Accuracy: 100.0%\n",
2974
      "Test   Loss: 2.13920\n",
2975
      "Test   Accuracy: 53.8%\n",
2976
      "Epoch 154\n",
2977
      "Train  Loss: 0.00386\n",
2978
      "Train  Accuracy: 100.0%\n",
2979
      "Test   Loss: 2.13917\n",
2980
      "Test   Accuracy: 53.8%\n",
2981
      "Epoch 155\n",
2982
      "Train  Loss: 0.00386\n",
2983
      "Train  Accuracy: 100.0%\n",
2984
      "Test   Loss: 2.13886\n",
2985
      "Test   Accuracy: 53.8%\n",
2986
      "Epoch 156\n",
2987
      "Train  Loss: 0.00386\n",
2988
      "Train  Accuracy: 100.0%\n",
2989
      "Test   Loss: 2.13876\n",
2990
      "Test   Accuracy: 53.8%\n",
2991
      "Epoch 157\n",
2992
      "Train  Loss: 0.00386\n",
2993
      "Train  Accuracy: 100.0%\n",
2994
      "Test   Loss: 2.13872\n",
2995
      "Test   Accuracy: 53.8%\n",
2996
      "Epoch 158\n",
2997
      "Train  Loss: 0.00386\n",
2998
      "Train  Accuracy: 100.0%\n",
2999
      "Test   Loss: 2.13894\n",
3000
      "Test   Accuracy: 53.8%\n",
3001
      "Epoch 159\n",
3002
      "Train  Loss: 0.00386\n",
3003
      "Train  Accuracy: 100.0%\n",
3004
      "Test   Loss: 2.13930\n",
3005
      "Test   Accuracy: 53.8%\n"
3006
     ]
3007
    },
3008
    {
3009
     "data": {
3010
      "text/plain": [
3011
       "ShallowFBCSPNet_SpecializedTrainer(filename=None, network=None)"
3012
      ]
3013
     },
3014
     "execution_count": 36,
3015
     "metadata": {
3016
      "tags": []
3017
     },
3018
     "output_type": "execute_result"
3019
    }
3020
   ],
3021
   "source": [
3022
    "\n",
3023
    "\n",
3024
    "\n",
3025
    "specializedClassifier = ShallowFBCSPNet_SpecializedTrainer(network=classifier.model)\n",
3026
    "specializedClassifier.lr = 0.01\n",
3027
    "#specializedClassifier.configure(initial_lr=0.01)\n",
3028
    "specializedClassifier.fit(X,y)\n"
3029
   ]
3030
  },
3031
  {
3032
   "cell_type": "code",
3033
   "execution_count": 0,
3034
   "metadata": {
3035
    "colab": {},
3036
    "colab_type": "code",
3037
    "id": "Jm1HclDBt9LB"
3038
   },
3039
   "outputs": [],
3040
   "source": [
3041
    "\n",
3042
    "\n",
3043
    "Subject 1:\n",
3044
    "Train  Loss: 0.01462\n",
3045
    "Train  Accuracy: 100.0%\n",
3046
    "Test   Loss: 0.46110\n",
3047
    "Test   Accuracy: 87.5%\n",
3048
    "\n",
3049
    "  \n",
3050
    "Subject 2:\n",
3051
    "Train  Loss: 0.02354\n",
3052
    "Train  Accuracy: 100.0%\n",
3053
    "Test   Loss: 0.22113\n",
3054
    "Test   Accuracy: 100.0%  \n"
3055
   ]
3056
  },
3057
  {
3058
   "cell_type": "markdown",
3059
   "metadata": {
3060
    "colab_type": "text",
3061
    "id": "B7W6H24AJhKl"
3062
   },
3063
   "source": [
3064
    "Best scores so far:\n",
3065
    "\n",
3066
    "Subject 0: 76.9%\n",
3067
    "Subject 1 50.0%\n",
3068
    "\n",
3069
    "\n"
3070
   ]
3071
  }
3072
 ],
3073
 "metadata": {
3074
  "accelerator": "GPU",
3075
  "colab": {
3076
   "collapsed_sections": [],
3077
   "name": "bnci-002-2014-ShallowFBCSPNet-colab.ipynb",
3078
   "provenance": [],
3079
   "version": "0.3.2"
3080
  },
3081
  "kernelspec": {
3082
   "display_name": "Python 3",
3083
   "language": "python",
3084
   "name": "python3"
3085
  },
3086
  "language_info": {
3087
   "codemirror_mode": {
3088
    "name": "ipython",
3089
    "version": 3
3090
   },
3091
   "file_extension": ".py",
3092
   "mimetype": "text/x-python",
3093
   "name": "python",
3094
   "nbconvert_exporter": "python",
3095
   "pygments_lexer": "ipython3",
3096
   "version": "3.6.4"
3097
  }
3098
 },
3099
 "nbformat": 4,
3100
 "nbformat_minor": 1
3101
}