0 00:00:00,000 --> 00:00:30,000 Dear viewer, these subtitles were generated by a machine via the service Trint and therefore are (very) buggy. If you are capable, please help us to create good quality subtitles: https://c3subtitles.de/talk/761 Thanks! 1 00:00:13,320 --> 00:00:15,869 I'm inviting you to a little 2 00:00:15,870 --> 00:00:17,520 imagination activity. 3 00:00:19,070 --> 00:00:21,439 Imagine that you can take 4 00:00:21,440 --> 00:00:23,629 all of your experiences that you 5 00:00:23,630 --> 00:00:25,819 have made at this Congress, take 6 00:00:25,820 --> 00:00:28,129 them home with you and share them with 7 00:00:28,130 --> 00:00:30,620 your friends and your family, everything. 8 00:00:31,740 --> 00:00:33,999 The first time that you tried, 9 00:00:34,000 --> 00:00:35,000 Marta? 10 00:00:37,210 --> 00:00:39,519 The moment, endless moments 11 00:00:39,520 --> 00:00:41,559 of going through the labyrinth of this 12 00:00:41,560 --> 00:00:43,839 Congress hall and getting lost 13 00:00:43,840 --> 00:00:44,950 for the hundredth time, 14 00:00:46,330 --> 00:00:48,429 trying to enter the 15 00:00:48,430 --> 00:00:50,499 club downstairs and 16 00:00:50,500 --> 00:00:52,599 feeling like you can cut the smoke 17 00:00:52,600 --> 00:00:53,600 with a knife. 18 00:00:55,430 --> 00:00:57,649 Or actually being very 19 00:00:57,650 --> 00:01:00,139 surprised and seeing Snowden appear 20 00:01:00,140 --> 00:01:02,389 on stage, so all 21 00:01:02,390 --> 00:01:04,219 of these wonderful memories, I imagine 22 00:01:04,220 --> 00:01:06,049 you can record them and you can take them 23 00:01:06,050 --> 00:01:08,109 home with you today. 24 00:01:09,110 --> 00:01:11,179 This kind of recording activity 25 00:01:11,180 --> 00:01:13,549 possibilities actually possible 26 00:01:13,550 --> 00:01:16,279 to make this technology 27 00:01:16,280 --> 00:01:18,439 that could theoretically 28 00:01:18,440 --> 00:01:20,510 record everything 24/7, 29 00:01:22,160 --> 00:01:24,259 Chi Conesa will 30 00:01:24,260 --> 00:01:26,779 give us an overview of sensual 31 00:01:26,780 --> 00:01:30,259 and actual actuation technology, 32 00:01:30,260 --> 00:01:32,359 and he will tell us what the future holds 33 00:01:32,360 --> 00:01:34,180 for a AR and VR. 34 00:01:35,540 --> 00:01:38,539 He has brought with him some 35 00:01:38,540 --> 00:01:40,819 experience. Some projects are actually 36 00:01:40,820 --> 00:01:42,919 happening right now and will give us 37 00:01:42,920 --> 00:01:45,439 an overview of how we are already 38 00:01:45,440 --> 00:01:47,539 pushing the boundaries today 39 00:01:47,540 --> 00:01:50,659 of humans sharing experience. 40 00:01:50,660 --> 00:01:53,149 Kai is a researcher in variable 41 00:01:53,150 --> 00:01:55,459 computing in a R 42 00:01:55,460 --> 00:01:57,679 and VR and really 43 00:01:57,680 --> 00:01:59,899 cool. He's also a founding member 44 00:01:59,900 --> 00:02:01,999 of the Japanese Super Human 45 00:02:02,000 --> 00:02:03,409 Sports Society. 46 00:02:07,070 --> 00:02:08,070 Thanks. 47 00:02:09,690 --> 00:02:11,859 The zone and without 48 00:02:11,860 --> 00:02:14,409 further ado, Concer Ingi 49 00:02:14,410 --> 00:02:15,819 is the mic on, yeah. 50 00:02:15,820 --> 00:02:17,139 OK, thanks. 51 00:02:17,140 --> 00:02:19,509 Thanks a lot for the great introduction 52 00:02:19,510 --> 00:02:21,909 and thanks a lot also for 53 00:02:21,910 --> 00:02:24,039 waking up so early in the morning 54 00:02:24,040 --> 00:02:25,389 to come and join to talk. 55 00:02:25,390 --> 00:02:27,489 It's always a special occasion 56 00:02:27,490 --> 00:02:29,319 for me to talk about the chaos 57 00:02:29,320 --> 00:02:30,729 communication Congress. 58 00:02:30,730 --> 00:02:32,949 And I hope then for the next 59 00:02:32,950 --> 00:02:35,319 30 minutes or so on, I won't be wasting 60 00:02:35,320 --> 00:02:36,309 your time. 61 00:02:36,310 --> 00:02:38,469 So the talk will be about, you know, kind 62 00:02:38,470 --> 00:02:41,199 of from superhuman sports to amplifying 63 00:02:41,200 --> 00:02:42,729 human senses. 64 00:02:42,730 --> 00:02:45,009 And as the introduction 65 00:02:45,010 --> 00:02:47,259 said already kind of we are 66 00:02:47,260 --> 00:02:50,019 in the year zero of 67 00:02:50,020 --> 00:02:52,509 consumer available VR devices. 68 00:02:52,510 --> 00:02:54,669 So Oculus, the 69 00:02:54,670 --> 00:02:56,859 wife and also 70 00:02:56,860 --> 00:02:59,859 the Sony VR system and a cheaper 71 00:02:59,860 --> 00:03:01,929 cardboard variants like Google Cardboard 72 00:03:01,930 --> 00:03:02,559 and so on. 73 00:03:02,560 --> 00:03:04,809 And we are on the brink of getting 74 00:03:04,810 --> 00:03:06,909 consumer level 8R 75 00:03:06,910 --> 00:03:09,189 and, you know, kind of already my 76 00:03:09,190 --> 00:03:11,379 grandparents have holo lens. 77 00:03:11,380 --> 00:03:13,479 So yeah, 78 00:03:13,480 --> 00:03:16,089 in this case I always like to include 79 00:03:16,090 --> 00:03:18,249 pictures of my grandparents because 80 00:03:18,250 --> 00:03:19,149 they are awesome. 81 00:03:19,150 --> 00:03:20,859 They always try out any type of 82 00:03:20,860 --> 00:03:23,019 technology I give them and 83 00:03:23,020 --> 00:03:25,299 they provide valuable feedback. 84 00:03:25,300 --> 00:03:27,099 However, I have to start with a big 85 00:03:27,100 --> 00:03:29,229 disclaimer and I will disappoint 86 00:03:29,230 --> 00:03:31,719 you, especially regarding the 87 00:03:31,720 --> 00:03:34,209 great introduction I got for the talk. 88 00:03:34,210 --> 00:03:36,369 Please don't trust me, 89 00:03:36,370 --> 00:03:38,809 especially about predictions. 90 00:03:38,810 --> 00:03:40,629 I was working 15 years now and the 91 00:03:40,630 --> 00:03:42,939 variable computing field and around 92 00:03:42,940 --> 00:03:45,099 2004 I thought, you 93 00:03:45,100 --> 00:03:46,719 know, today we would run around like 94 00:03:46,720 --> 00:03:47,739 this. 95 00:03:47,740 --> 00:03:49,929 And I see a lot of you kind of wearing 96 00:03:49,930 --> 00:03:51,429 your head mounted displays and having 97 00:03:51,430 --> 00:03:53,679 your one handed keyboard. 98 00:03:53,680 --> 00:03:54,579 Nobody. 99 00:03:54,580 --> 00:03:55,759 Oh, damn it. 100 00:03:55,760 --> 00:03:57,369 So I'm really, really bad with 101 00:03:57,370 --> 00:03:59,259 predictions. And kind of that was me at 102 00:03:59,260 --> 00:04:00,260 the time. 103 00:04:00,880 --> 00:04:02,169 One handed keyboard. 104 00:04:02,170 --> 00:04:04,329 KUBIC This is a belt integrated computer 105 00:04:04,330 --> 00:04:06,399 from from stage at 106 00:04:06,400 --> 00:04:08,079 a time. You have to remember we didn't 107 00:04:08,080 --> 00:04:10,149 have smartphones, so we had to carry 108 00:04:10,150 --> 00:04:11,679 our computing somewhere else. 109 00:04:11,680 --> 00:04:13,329 And then, you know, kind of seriously, a 110 00:04:13,330 --> 00:04:15,159 couple of years back, I also thought this 111 00:04:15,160 --> 00:04:16,088 would be a thing. 112 00:04:16,089 --> 00:04:17,949 So so Google Glass and this type of 113 00:04:17,950 --> 00:04:20,018 stuff. So don't trust me 114 00:04:20,019 --> 00:04:22,329 about predictions and 115 00:04:22,330 --> 00:04:24,729 don't trust me on what's coming next. 116 00:04:24,730 --> 00:04:26,619 However, for this talk, you might wonder, 117 00:04:26,620 --> 00:04:27,969 why did you get up so early in the 118 00:04:27,970 --> 00:04:28,899 morning then? 119 00:04:28,900 --> 00:04:31,179 What I will do today is I will talk 120 00:04:31,180 --> 00:04:33,399 a little bit about a hot topic in 121 00:04:33,400 --> 00:04:35,619 Japan right now, and that's 122 00:04:35,620 --> 00:04:37,749 super human sports. 123 00:04:37,750 --> 00:04:40,599 The idea for superhuman sports is to use 124 00:04:40,600 --> 00:04:43,569 technology to enhance human 125 00:04:43,570 --> 00:04:46,149 abilities over, 126 00:04:46,150 --> 00:04:48,429 you know, kind of what we usually can 127 00:04:48,430 --> 00:04:50,649 do. And because, you know, we are 128 00:04:50,650 --> 00:04:52,989 in Japan, we, of course, 129 00:04:52,990 --> 00:04:54,249 founded the society. 130 00:04:54,250 --> 00:04:55,869 So since one and a half years, we have 131 00:04:55,870 --> 00:04:58,579 the Superhuman Sports Society disclaimer. 132 00:04:58,580 --> 00:05:00,699 As I said in the introduction, I'm 133 00:05:00,700 --> 00:05:03,339 one of the society members 134 00:05:03,340 --> 00:05:04,389 and also one of the. 135 00:05:04,390 --> 00:05:06,759 So originally the idea came from 136 00:05:06,760 --> 00:05:08,989 Inamine Sensei and 137 00:05:08,990 --> 00:05:11,229 Kimoto Sensei and 138 00:05:11,230 --> 00:05:13,119 Nakamura. I usually don't like 139 00:05:13,120 --> 00:05:15,069 namedropping, but especially if you're 140 00:05:15,070 --> 00:05:17,919 interested in human augmentation 141 00:05:17,920 --> 00:05:20,319 and human computer interaction, check 142 00:05:20,320 --> 00:05:22,479 out all the works from Inamine 143 00:05:22,480 --> 00:05:24,669 Kimoto and also follow them closely 144 00:05:24,670 --> 00:05:26,589 because they're two of my personal 145 00:05:26,590 --> 00:05:27,819 heroes. 146 00:05:27,820 --> 00:05:30,159 And then we have the society now 147 00:05:30,160 --> 00:05:31,719 we're trying to expand it 148 00:05:31,720 --> 00:05:33,009 internationally. 149 00:05:33,010 --> 00:05:35,469 So since a couple of months we're working 150 00:05:35,470 --> 00:05:37,539 with T.U. Delft, the Sports 151 00:05:37,540 --> 00:05:39,729 Engineering Institute, and I don't 152 00:05:39,730 --> 00:05:40,929 want to bore you longer. 153 00:05:40,930 --> 00:05:43,119 However, I just want to highlight 154 00:05:43,120 --> 00:05:45,579 one person in the advisory board 155 00:05:45,580 --> 00:05:48,099 and that's whole Petrina, because warbird 156 00:05:48,100 --> 00:05:50,259 kind of saved twenty sixteen 157 00:05:50,260 --> 00:05:52,479 for me because, you know, it started all 158 00:05:52,480 --> 00:05:54,699 with Boycie and 159 00:05:54,700 --> 00:05:57,459 so on and then Brexit and Trump. 160 00:05:57,460 --> 00:06:00,219 But Robert organized the Cybertron 161 00:06:00,220 --> 00:06:01,960 in Italy. 162 00:06:03,050 --> 00:06:05,439 I just wondered how many of you 163 00:06:05,440 --> 00:06:07,299 heard about the Cybertron. 164 00:06:07,300 --> 00:06:08,289 Oh OK. Couple. 165 00:06:08,290 --> 00:06:09,789 Well nice it. 166 00:06:09,790 --> 00:06:11,589 Has anybody been there. 167 00:06:11,590 --> 00:06:13,899 Oh yeah. Even great. 168 00:06:13,900 --> 00:06:15,669 Cool. My kind of audience. 169 00:06:15,670 --> 00:06:17,230 Awesome. So in this case 170 00:06:18,880 --> 00:06:20,649 this was an international competition for 171 00:06:20,650 --> 00:06:23,889 disabled competitors 172 00:06:23,890 --> 00:06:26,469 using bionic assistive technology, 173 00:06:26,470 --> 00:06:28,959 so exoskeletons and so on. 174 00:06:28,960 --> 00:06:31,299 And kind of that was just 175 00:06:31,300 --> 00:06:33,399 great. And it's in the 176 00:06:33,400 --> 00:06:35,529 uh in the terms of what I want to talk 177 00:06:35,530 --> 00:06:37,479 to you about today, but what I want to 178 00:06:37,480 --> 00:06:39,639 talk to you about today is then 179 00:06:39,640 --> 00:06:40,599 superhuman sports. 180 00:06:40,600 --> 00:06:41,769 And I kind of 181 00:06:42,940 --> 00:06:44,829 selected these type of topics. 182 00:06:44,830 --> 00:06:47,169 So augmenting our body armor 183 00:06:47,170 --> 00:06:48,759 and mounting the playing field, 184 00:06:48,760 --> 00:06:50,679 augmenting, training and cheering. 185 00:06:50,680 --> 00:06:53,049 And I will show you a couple of examples 186 00:06:53,050 --> 00:06:55,269 from researchers in 187 00:06:55,270 --> 00:06:56,439 the society. 188 00:06:56,440 --> 00:06:58,809 So first, going over to augmenting 189 00:06:58,810 --> 00:06:59,829 our body. 190 00:06:59,830 --> 00:07:02,169 There's a lot of work also 191 00:07:02,170 --> 00:07:03,999 mechanically that's not so interesting 192 00:07:04,000 --> 00:07:05,619 for us computer scientists. 193 00:07:05,620 --> 00:07:08,659 However, it looks cool, so I included it. 194 00:07:08,660 --> 00:07:10,729 One is a company called 195 00:07:10,730 --> 00:07:12,049 Skeleton X. 196 00:07:12,050 --> 00:07:13,789 They manufacture these 197 00:07:14,900 --> 00:07:15,919 exoskeletons. 198 00:07:15,920 --> 00:07:17,689 They are completely moved by muscle 199 00:07:17,690 --> 00:07:20,059 movement. So nothing it 200 00:07:20,060 --> 00:07:22,369 here, but still cool. 201 00:07:22,370 --> 00:07:24,789 And then another thing is 202 00:07:24,790 --> 00:07:25,709 the bubble jumper. 203 00:07:25,710 --> 00:07:27,619 That's an idea that came out of a 204 00:07:27,620 --> 00:07:29,959 hackathon we organized 205 00:07:29,960 --> 00:07:32,179 at scale and we started kind 206 00:07:32,180 --> 00:07:34,549 of with first sketches 207 00:07:34,550 --> 00:07:36,499 and so on. But the important part for 208 00:07:36,500 --> 00:07:38,839 also for our hackathon is you have 209 00:07:38,840 --> 00:07:40,819 to demo. You have to implement. 210 00:07:45,620 --> 00:07:47,140 It should be playing oh, yeah, 211 00:07:50,390 --> 00:07:52,609 so you see the combination 212 00:07:52,610 --> 00:07:54,679 of bubble ball and 213 00:07:54,680 --> 00:07:56,899 sky runner and to 214 00:07:56,900 --> 00:07:58,610 make a very safe and 215 00:08:00,410 --> 00:08:01,939 nice sport for. 216 00:08:08,040 --> 00:08:10,319 The coexistence of safety and force, 217 00:08:10,320 --> 00:08:11,870 I'm not so sure about the safety 218 00:08:13,300 --> 00:08:14,300 of. 219 00:08:17,060 --> 00:08:19,399 You know, getting 220 00:08:19,400 --> 00:08:21,139 over this to something a little bit more 221 00:08:21,140 --> 00:08:23,749 serious, spider vision, 222 00:08:23,750 --> 00:08:25,939 this is now work from Minami sensei. 223 00:08:25,940 --> 00:08:28,039 And in this case, this is really about 224 00:08:28,040 --> 00:08:30,169 extending the human 225 00:08:30,170 --> 00:08:31,759 field of view. 226 00:08:31,760 --> 00:08:33,168 And it's very, very simple. 227 00:08:33,169 --> 00:08:35,298 They use the DKA one and they have 228 00:08:35,299 --> 00:08:37,369 two cameras, one in front, one in the 229 00:08:37,370 --> 00:08:39,829 back, and they overlay 230 00:08:39,830 --> 00:08:42,408 the two video feeds 231 00:08:42,409 --> 00:08:44,599 on top of each other, like 232 00:08:44,600 --> 00:08:46,999 you will see right here. 233 00:08:47,000 --> 00:08:48,499 And the interesting part is at the 234 00:08:48,500 --> 00:08:50,419 beginning, it looks really terrible. 235 00:08:50,420 --> 00:08:52,369 But after two or three minutes using 236 00:08:52,370 --> 00:08:54,199 this, you can really separate the two 237 00:08:54,200 --> 00:08:56,269 images and you can even read or 238 00:08:56,270 --> 00:08:58,579 do other things. So you kind of then 239 00:08:58,580 --> 00:09:00,949 you can be environmentally 240 00:09:00,950 --> 00:09:01,950 aware. 241 00:09:04,310 --> 00:09:06,319 The only trouble is and that's something 242 00:09:06,320 --> 00:09:08,480 you see here, because you're wearing 243 00:09:10,070 --> 00:09:11,389 a hat mounted display. 244 00:09:11,390 --> 00:09:13,639 Still, we are said, 245 00:09:13,640 --> 00:09:15,109 you know, there's an offset from the 246 00:09:15,110 --> 00:09:16,939 camera to your actual eyes. 247 00:09:16,940 --> 00:09:18,769 So it's very hard to interact with your 248 00:09:18,770 --> 00:09:19,819 environment. 249 00:09:19,820 --> 00:09:21,619 But that's kind of initial work where you 250 00:09:21,620 --> 00:09:22,620 want to get at. 251 00:09:23,570 --> 00:09:25,789 The next work I want to show you 252 00:09:25,790 --> 00:09:27,949 is the synesthesia suit. 253 00:09:27,950 --> 00:09:30,439 That's a full body haptic feedback suit 254 00:09:30,440 --> 00:09:32,840 made by Mizuguchi and 255 00:09:33,860 --> 00:09:35,659 Saba sensei, two of my colleagues at 256 00:09:35,660 --> 00:09:36,889 Comedia Design. 257 00:09:36,890 --> 00:09:39,179 And this was first done to promote dress. 258 00:09:39,180 --> 00:09:42,079 That's a video game for 259 00:09:42,080 --> 00:09:43,339 the PlayStation. 260 00:09:43,340 --> 00:09:45,289 And what it gives you, you see it here on 261 00:09:45,290 --> 00:09:47,449 the right side is it has 262 00:09:47,450 --> 00:09:50,479 a haptic feedback, vibrators, 263 00:09:50,480 --> 00:09:52,609 uh, 24 on the whole body. 264 00:09:54,010 --> 00:09:56,109 So you can get a touch feeling on 265 00:09:56,110 --> 00:09:58,419 your whole body and the idea 266 00:09:58,420 --> 00:10:00,579 of Mizuguchi sensei wants to do with this 267 00:10:00,580 --> 00:10:03,549 is he wants to give you simultaneously 268 00:10:03,550 --> 00:10:05,769 visual as well as auditory 269 00:10:05,770 --> 00:10:07,929 and haptic and touch feedback to 270 00:10:07,930 --> 00:10:10,179 put you in some kind of trance state. 271 00:10:10,180 --> 00:10:12,339 And if you try to rest with 272 00:10:12,340 --> 00:10:14,649 this suit, it's quite an experience, 273 00:10:14,650 --> 00:10:16,929 actually. So you get, you know, visual, 274 00:10:16,930 --> 00:10:19,539 auditory and touch feedback 275 00:10:19,540 --> 00:10:20,619 at the same time. 276 00:10:25,650 --> 00:10:28,409 Then moving over to 277 00:10:28,410 --> 00:10:30,779 augmenting the sports 278 00:10:30,780 --> 00:10:32,879 field here, I want to 279 00:10:32,880 --> 00:10:34,949 highlight a work 280 00:10:34,950 --> 00:10:37,349 from Akimoto sensei 281 00:10:37,350 --> 00:10:38,579 Aqua Kafe. 282 00:10:38,580 --> 00:10:40,649 You see a water tank you can swim 283 00:10:40,650 --> 00:10:42,809 in that swim are actually 284 00:10:42,810 --> 00:10:44,909 worth 3-D shattered glasses 285 00:10:44,910 --> 00:10:47,129 and you have a 3-D display around 286 00:10:47,130 --> 00:10:48,119 the water tank. 287 00:10:48,120 --> 00:10:50,729 So you can then really dove 288 00:10:50,730 --> 00:10:53,159 in the Great Barrier 289 00:10:53,160 --> 00:10:55,139 near the Great Barrier Reef, or you can 290 00:10:55,140 --> 00:10:57,929 do competitions with sharks 291 00:10:57,930 --> 00:10:58,980 and similar things. 292 00:11:00,900 --> 00:11:03,089 Then augmented 293 00:11:03,090 --> 00:11:04,799 training. 294 00:11:04,800 --> 00:11:06,989 Here I will show a little bit 295 00:11:06,990 --> 00:11:08,249 of old work. 296 00:11:08,250 --> 00:11:10,289 Maybe some of you will know, but I just 297 00:11:10,290 --> 00:11:12,509 find it cool enough to still 298 00:11:12,510 --> 00:11:14,039 include it. And that's galvanic 299 00:11:14,040 --> 00:11:16,409 vestibular stimulation by MIDA 300 00:11:16,410 --> 00:11:18,329 and also Inamine sensor. 301 00:11:18,330 --> 00:11:21,689 And what they were doing in 2004 302 00:11:21,690 --> 00:11:24,059 is they apply a tiny 303 00:11:24,060 --> 00:11:25,829 current behind your ear. 304 00:11:25,830 --> 00:11:27,689 You have a.. And catalyst behind your 305 00:11:27,690 --> 00:11:29,879 ear. And what happens if you apply this 306 00:11:29,880 --> 00:11:32,069 tiny current is you messing 307 00:11:32,070 --> 00:11:34,289 with your equilibrium, with your sense 308 00:11:34,290 --> 00:11:35,339 of equilibrium. 309 00:11:35,340 --> 00:11:38,279 So you will tend towards the nanotubes 310 00:11:38,280 --> 00:11:40,619 if you do that and responds by. 311 00:11:40,620 --> 00:11:41,729 And then. 312 00:11:41,730 --> 00:11:44,039 Now, the reason why I show 313 00:11:44,040 --> 00:11:45,899 this video is because, you know, this 314 00:11:45,900 --> 00:11:47,339 would be impossible to do for a 315 00:11:47,340 --> 00:11:49,169 researcher in Europe or us. 316 00:11:49,170 --> 00:11:51,269 You see a student wearing this 317 00:11:51,270 --> 00:11:53,579 device. You see the professor 318 00:11:53,580 --> 00:11:55,889 with the control unit 319 00:11:55,890 --> 00:11:56,890 and. 320 00:12:03,000 --> 00:12:05,489 Can steer the person just left and right, 321 00:12:05,490 --> 00:12:07,589 and I have to say I 322 00:12:07,590 --> 00:12:08,759 tried it. 323 00:12:08,760 --> 00:12:11,039 It's kind of it's not safe 324 00:12:11,040 --> 00:12:11,549 to try out. 325 00:12:11,550 --> 00:12:13,379 We don't know about long term effects, 326 00:12:20,430 --> 00:12:22,529 but it's an interesting and it's 327 00:12:22,530 --> 00:12:23,609 also user dependent. 328 00:12:23,610 --> 00:12:25,319 So it kind of depending on the user and 329 00:12:25,320 --> 00:12:27,689 depending on your skin, you might 330 00:12:27,690 --> 00:12:29,999 need more or less of this 331 00:12:30,000 --> 00:12:32,639 to the electricity. 332 00:12:32,640 --> 00:12:34,199 But it's an interesting thing to think 333 00:12:34,200 --> 00:12:36,479 about, especially for sports that require 334 00:12:36,480 --> 00:12:38,789 equilibrium or two things 335 00:12:38,790 --> 00:12:40,499 and then not work. 336 00:12:40,500 --> 00:12:42,209 This is work from one of my students, 337 00:12:42,210 --> 00:12:44,189 Takura. He was working on peripheral 338 00:12:44,190 --> 00:12:46,289 vision glasses and his first idea 339 00:12:46,290 --> 00:12:48,629 was to just give you notifications 340 00:12:48,630 --> 00:12:50,879 in a way that other people don't realize. 341 00:12:50,880 --> 00:12:52,769 So, you know, I could look still into 342 00:12:52,770 --> 00:12:54,689 your eyes and you don't realize that I 343 00:12:54,690 --> 00:12:56,729 might get some notification on my 344 00:12:56,730 --> 00:12:57,749 peripheral vision. 345 00:12:57,750 --> 00:12:59,969 I can still keep eye contact because so 346 00:12:59,970 --> 00:13:01,709 far, you know, if you look at your hendee 347 00:13:01,710 --> 00:13:03,929 or if you look at your watch, the other 348 00:13:03,930 --> 00:13:06,209 person will realize that you're 349 00:13:06,210 --> 00:13:08,039 you're looking there. So you started with 350 00:13:08,040 --> 00:13:09,059 this idea. 351 00:13:09,060 --> 00:13:11,219 And kind of the boring thing is, yes, 352 00:13:11,220 --> 00:13:13,379 it works for notifications, 353 00:13:13,380 --> 00:13:15,779 so you can have up to eight 354 00:13:15,780 --> 00:13:17,999 different types of notifications. 355 00:13:18,000 --> 00:13:19,529 I don't know why the video stopped, but 356 00:13:19,530 --> 00:13:20,880 that's actually not so important. 357 00:13:22,080 --> 00:13:23,819 You can have eight different types of 358 00:13:23,820 --> 00:13:25,589 notifications. The other person cannot 359 00:13:25,590 --> 00:13:27,479 see that you you're getting them. 360 00:13:27,480 --> 00:13:29,549 However, what he really wants to do and 361 00:13:29,550 --> 00:13:31,919 here we get to the interesting part is 362 00:13:31,920 --> 00:13:34,439 he wants to try to influence 363 00:13:34,440 --> 00:13:37,019 movement over your peripheral 364 00:13:37,020 --> 00:13:37,859 vision. 365 00:13:37,860 --> 00:13:40,199 And there's some other research, 366 00:13:40,200 --> 00:13:42,509 some interesting research from 367 00:13:42,510 --> 00:13:44,759 Furukawa at all. 368 00:13:44,760 --> 00:13:47,099 Also, that human conference did 369 00:13:47,100 --> 00:13:49,439 use some patterns on the floor 370 00:13:49,440 --> 00:13:51,629 to guide pedestrians to 371 00:13:51,630 --> 00:13:55,109 influence the movements of pedestrians. 372 00:13:55,110 --> 00:13:57,359 And then Tukaram 373 00:13:57,360 --> 00:14:00,569 wondered if it's possible using 374 00:14:00,570 --> 00:14:02,999 then also peripheral vision glasses. 375 00:14:03,000 --> 00:14:04,419 And this is the first test. 376 00:14:04,420 --> 00:14:06,369 This is partly unpublished, but I 377 00:14:06,370 --> 00:14:08,099 thought, I want to share it with you. 378 00:14:08,100 --> 00:14:10,199 So in this case, what he's using is he 379 00:14:10,200 --> 00:14:12,299 is using some lines that move along 380 00:14:12,300 --> 00:14:14,519 this way and he lets people 381 00:14:14,520 --> 00:14:16,589 walk. And guess what happens if 382 00:14:16,590 --> 00:14:18,169 you let the lines move faster? 383 00:14:20,410 --> 00:14:22,479 Yeah, I heard so people will move 384 00:14:22,480 --> 00:14:24,090 slower, so walk slower, 385 00:14:25,330 --> 00:14:27,940 so it's already possible to maybe 386 00:14:29,290 --> 00:14:31,539 use it to influence speed and the next 387 00:14:31,540 --> 00:14:33,939 thing he wants to try is also try 388 00:14:33,940 --> 00:14:35,289 to influence direction. 389 00:14:37,610 --> 00:14:40,399 So the next thing then is augmenting 390 00:14:40,400 --> 00:14:41,400 watch and cheer. 391 00:14:42,710 --> 00:14:44,029 So in this case, 392 00:14:45,380 --> 00:14:47,540 I want to show effective wear 393 00:14:48,650 --> 00:14:51,319 that glasses that 394 00:14:51,320 --> 00:14:53,929 can detect your facial expressions 395 00:14:53,930 --> 00:14:56,029 and in a very cheap or simple 396 00:14:56,030 --> 00:14:58,489 way, that's my saying. 397 00:14:58,490 --> 00:15:00,289 You see kind of the faces he makes. 398 00:15:00,290 --> 00:15:02,599 He wears his own self-made 399 00:15:02,600 --> 00:15:04,729 glasses. And how this works 400 00:15:04,730 --> 00:15:07,369 is he uses just photo reflective sensors 401 00:15:07,370 --> 00:15:09,529 in the glasses frame and 402 00:15:09,530 --> 00:15:11,659 he detects the distance to the 403 00:15:11,660 --> 00:15:13,909 skin. And with this, you can 404 00:15:13,910 --> 00:15:16,519 get used to dependent very well 405 00:15:16,520 --> 00:15:18,709 what type of expressions a person 406 00:15:18,710 --> 00:15:19,710 is doing. 407 00:15:22,510 --> 00:15:24,699 So you see it, and I like 408 00:15:24,700 --> 00:15:26,049 the training for it, so you hear you see 409 00:15:26,050 --> 00:15:27,879 the photo reflective sensors and the 410 00:15:27,880 --> 00:15:30,039 distance measures between the sensors 411 00:15:30,040 --> 00:15:32,169 and then kind of for a start, 412 00:15:32,170 --> 00:15:34,539 he has to then 413 00:15:34,540 --> 00:15:36,609 calibrate the sensors once 414 00:15:36,610 --> 00:15:37,969 and you see the principle. 415 00:15:37,970 --> 00:15:40,209 So, for example, for smiling, 416 00:15:40,210 --> 00:15:42,849 you know, kind of your cheeks move up. 417 00:15:42,850 --> 00:15:45,039 So it's easy to recognize that 418 00:15:45,040 --> 00:15:46,599 you're smiling and even laughter. 419 00:15:46,600 --> 00:15:48,189 So aid, facial expressions are 420 00:15:48,190 --> 00:15:49,449 recognizable. 421 00:15:49,450 --> 00:15:51,100 And yeah. And I like just 422 00:15:52,540 --> 00:15:53,619 and making faces. That's the 423 00:15:53,620 --> 00:15:55,899 normalization phase, then the training 424 00:15:55,900 --> 00:15:57,949 phase and then the recognition phase. 425 00:15:57,950 --> 00:15:59,589 That's user dependent, but it's very 426 00:15:59,590 --> 00:16:01,419 cheap. And if you want to build this 427 00:16:01,420 --> 00:16:02,799 especially smiling, it's easy. 428 00:16:02,800 --> 00:16:05,199 You just need one for the reflector here 429 00:16:05,200 --> 00:16:07,569 above the cheekbone and then 430 00:16:07,570 --> 00:16:09,369 one maybe for reference and then it's 431 00:16:09,370 --> 00:16:10,899 easy to implement. 432 00:16:10,900 --> 00:16:12,969 So, of course, you know, kind 433 00:16:12,970 --> 00:16:15,039 of what we can do with this is we can put 434 00:16:15,040 --> 00:16:17,649 it into a VR headset 435 00:16:17,650 --> 00:16:20,349 and then your character in VR 436 00:16:20,350 --> 00:16:22,989 can have the same facial expressions. 437 00:16:22,990 --> 00:16:25,299 You can think about remote participants 438 00:16:25,300 --> 00:16:26,860 in a in a 439 00:16:28,320 --> 00:16:30,789 in an event also on and then also showing 440 00:16:30,790 --> 00:16:33,369 the mood or so on of the remote 441 00:16:33,370 --> 00:16:34,449 participants. 442 00:16:34,450 --> 00:16:35,450 It's not playing. 443 00:16:38,190 --> 00:16:40,299 Yeah, but I think you get the idea 444 00:16:40,300 --> 00:16:41,909 I don't know why the video stopped 445 00:16:44,280 --> 00:16:46,649 and kind of also more interesting 446 00:16:46,650 --> 00:16:48,989 then is you can also 447 00:16:50,280 --> 00:16:52,349 kind of maybe use this for the science or 448 00:16:52,350 --> 00:16:54,539 if you want to design a very, very scary 449 00:16:54,540 --> 00:16:57,239 dungeon, you can kind of detect 450 00:16:57,240 --> 00:16:59,549 how people know it's, 451 00:16:59,550 --> 00:17:01,769 uh, how people are reacting 452 00:17:01,770 --> 00:17:03,899 to some elements in your VR 453 00:17:03,900 --> 00:17:06,149 environment and then, uh, do 454 00:17:06,150 --> 00:17:08,219 the correct adjustments. 455 00:17:08,220 --> 00:17:09,868 And also, you know, you could wear it 456 00:17:09,869 --> 00:17:11,789 throughout the day and just get an 457 00:17:11,790 --> 00:17:13,769 overview over your daily activities. 458 00:17:13,770 --> 00:17:15,539 So, you know, kind of how much smiling 459 00:17:15,540 --> 00:17:17,789 versus frowning are you doing also 460 00:17:17,790 --> 00:17:19,919 related to some of the activities you 461 00:17:19,920 --> 00:17:21,269 have? 462 00:17:21,270 --> 00:17:22,270 Um. 463 00:17:24,109 --> 00:17:26,449 That's that's interesting 464 00:17:26,450 --> 00:17:28,249 and that's in line with some work also 465 00:17:28,250 --> 00:17:30,499 from Rick Emoto sensei, who did 466 00:17:30,500 --> 00:17:31,789 the happiness counter. 467 00:17:31,790 --> 00:17:33,949 So he had the idea he's he used a smile 468 00:17:33,950 --> 00:17:35,659 as an interaction modality. 469 00:17:35,660 --> 00:17:37,189 So, you know, in the morning when you 470 00:17:37,190 --> 00:17:39,200 wake up and your alarm clock rings, 471 00:17:40,400 --> 00:17:42,529 you don't have to push a button, but you 472 00:17:42,530 --> 00:17:44,239 have to smile to your alarm clock. 473 00:17:45,290 --> 00:17:48,079 That's a little bit scary or creepy. 474 00:17:48,080 --> 00:17:50,209 And because we are with this this 475 00:17:50,210 --> 00:17:51,799 next one is a little bit of a joke, you 476 00:17:51,800 --> 00:17:53,479 know, kind of if you if you recognize 477 00:17:53,480 --> 00:17:54,769 that you don't smile enough, 478 00:17:56,600 --> 00:17:58,010 we can also make you smile. 479 00:18:00,530 --> 00:18:02,749 So this is now 480 00:18:02,750 --> 00:18:04,879 22 smilers now activated over 481 00:18:04,880 --> 00:18:05,880 the electrodes. 482 00:18:09,000 --> 00:18:10,589 As I said, this is a little bit of joke, 483 00:18:10,590 --> 00:18:12,179 I don't recommend anybody. 484 00:18:12,180 --> 00:18:14,309 I hope nobody will make these type of 485 00:18:14,310 --> 00:18:15,869 technologies in future. 486 00:18:15,870 --> 00:18:18,269 But here the interesting part is people 487 00:18:18,270 --> 00:18:20,369 students were playing with 488 00:18:20,370 --> 00:18:23,129 MS and we recognized 489 00:18:23,130 --> 00:18:25,199 one of the main most of 490 00:18:25,200 --> 00:18:27,359 the nerves to control 491 00:18:27,360 --> 00:18:29,579 our face actually come over 492 00:18:29,580 --> 00:18:31,199 from this side of the face. 493 00:18:31,200 --> 00:18:32,729 So what you can do is if you put 494 00:18:32,730 --> 00:18:34,829 electrodes on different parts 495 00:18:34,830 --> 00:18:37,169 here, you can actually activate different 496 00:18:37,170 --> 00:18:38,189 muscles. 497 00:18:38,190 --> 00:18:39,809 The students wanted to get smiling, 498 00:18:39,810 --> 00:18:41,699 working, but first when they tried it on 499 00:18:41,700 --> 00:18:43,679 me was my eye was blinking and other 500 00:18:43,680 --> 00:18:45,599 things you can also do. 501 00:18:45,600 --> 00:18:46,600 I blink. 502 00:18:47,890 --> 00:18:49,199 Um, yeah. 503 00:18:49,200 --> 00:18:51,269 And then, I mean, this is a little bit 504 00:18:51,270 --> 00:18:52,079 on the joke side. 505 00:18:52,080 --> 00:18:54,269 As I said before, however, if you want 506 00:18:54,270 --> 00:18:56,459 to have references for more serious, 507 00:18:56,460 --> 00:18:58,589 uh, electric muscle stimulation work, 508 00:18:58,590 --> 00:19:00,809 I refer you to Max Fifer and 509 00:19:00,810 --> 00:19:02,939 also Peter Lopez. 510 00:19:02,940 --> 00:19:05,219 They also have a kid 511 00:19:05,220 --> 00:19:07,499 out. So two references 512 00:19:07,500 --> 00:19:08,429 to your health. 513 00:19:08,430 --> 00:19:10,589 If you want to build your own or if 514 00:19:10,590 --> 00:19:12,629 you want to build your own EMS and also 515 00:19:12,630 --> 00:19:14,789 their source code for all of their papers 516 00:19:14,790 --> 00:19:16,949 is, I think, out there on BitBucket 517 00:19:16,950 --> 00:19:17,950 and GetUp! 518 00:19:19,140 --> 00:19:21,089 And this is also just cool, you know, 519 00:19:21,090 --> 00:19:24,509 cruise control for pedestrians and also 520 00:19:24,510 --> 00:19:26,609 muscle plotter. So, um, 521 00:19:26,610 --> 00:19:28,859 using your body as output 522 00:19:28,860 --> 00:19:30,629 for a computer. 523 00:19:30,630 --> 00:19:33,899 Um, however, now getting back to 524 00:19:33,900 --> 00:19:36,089 the, um, 525 00:19:36,090 --> 00:19:37,229 superhuman sports. 526 00:19:37,230 --> 00:19:38,939 So the idea also for the Superhuman 527 00:19:38,940 --> 00:19:41,369 Sports Society is to walk to 528 00:19:41,370 --> 00:19:43,439 work towards Olympic 529 00:19:43,440 --> 00:19:44,639 2020. 530 00:19:44,640 --> 00:19:46,799 And we want to create 531 00:19:46,800 --> 00:19:49,979 actually an augmented game culture 532 00:19:49,980 --> 00:19:50,999 in Japan. 533 00:19:51,000 --> 00:19:53,129 So not only inventing new sports 534 00:19:53,130 --> 00:19:56,069 and using new sports to 535 00:19:56,070 --> 00:19:58,529 pursue amplifying human senses, 536 00:19:58,530 --> 00:20:00,689 but also creating this culture to 537 00:20:00,690 --> 00:20:03,029 make these sports. So we are organizing 538 00:20:03,030 --> 00:20:05,219 workshops. This is an example from 539 00:20:05,220 --> 00:20:07,379 from Wykeham beginning 540 00:20:07,380 --> 00:20:08,409 of this year. 541 00:20:08,410 --> 00:20:10,079 Uh, so, you know, kind of you have a lot 542 00:20:10,080 --> 00:20:11,429 of devices. 543 00:20:11,430 --> 00:20:13,589 You get together researchers, 544 00:20:13,590 --> 00:20:16,229 artists, designers, but also, 545 00:20:16,230 --> 00:20:18,809 uh, local people that are just interested 546 00:20:18,810 --> 00:20:20,009 in participating. 547 00:20:20,010 --> 00:20:22,199 We do one day of ideation 548 00:20:22,200 --> 00:20:24,869 and trying out different 549 00:20:24,870 --> 00:20:27,359 types of technologies and 550 00:20:28,380 --> 00:20:29,969 and research outputs. 551 00:20:29,970 --> 00:20:32,249 So this is, for example, to check in 552 00:20:32,250 --> 00:20:34,559 one of the researchers. 553 00:20:35,950 --> 00:20:38,459 Yeah. You see all of the four people. 554 00:20:38,460 --> 00:20:39,989 You know, you have a view of all four 555 00:20:39,990 --> 00:20:42,299 people, I think, 556 00:20:42,300 --> 00:20:44,369 anyways, and then, you know, at the end 557 00:20:44,370 --> 00:20:46,589 trying to design these games together. 558 00:20:47,670 --> 00:20:49,729 And so these are 559 00:20:49,730 --> 00:20:50,730 some more. 560 00:20:54,000 --> 00:20:56,729 Pictures from some of the workshops 561 00:20:56,730 --> 00:20:59,669 and here the idea is, 562 00:20:59,670 --> 00:21:02,039 first of all, as I said before, 563 00:21:02,040 --> 00:21:05,039 we want to create a proof of concept 564 00:21:05,040 --> 00:21:07,379 by making and playing 565 00:21:07,380 --> 00:21:08,979 sports and that sport. 566 00:21:08,980 --> 00:21:11,069 So not just the ideation 567 00:21:11,070 --> 00:21:13,049 sketches or so on, but really 568 00:21:13,050 --> 00:21:15,749 demonstrations demo more die 569 00:21:15,750 --> 00:21:18,179 and then also getting fit ourselves. 570 00:21:18,180 --> 00:21:20,819 So far I didn't really work for me, but 571 00:21:20,820 --> 00:21:23,249 maybe in future and then also creating 572 00:21:23,250 --> 00:21:25,439 these augmented 573 00:21:25,440 --> 00:21:27,719 game creators for 574 00:21:27,720 --> 00:21:29,159 the time being. 575 00:21:29,160 --> 00:21:31,079 And now you might wonder after these 576 00:21:31,080 --> 00:21:33,509 slides. Um hmm. 577 00:21:33,510 --> 00:21:35,549 What's the scientific impact? 578 00:21:35,550 --> 00:21:37,679 I mean, it's a lot of fun to do this, 579 00:21:37,680 --> 00:21:39,869 but, you know, why am I focusing 580 00:21:39,870 --> 00:21:40,870 on this? 581 00:21:42,200 --> 00:21:44,299 And if you heard 582 00:21:44,300 --> 00:21:46,669 my previous talk two years ago, you might 583 00:21:46,670 --> 00:21:48,829 know that I'm interested in recognizing 584 00:21:48,830 --> 00:21:50,499 and improving cognitive activities. 585 00:21:50,500 --> 00:21:52,189 So concentration, attention, 586 00:21:52,190 --> 00:21:54,979 comprehension and 587 00:21:54,980 --> 00:21:57,259 I focus a lot on either computing. 588 00:21:57,260 --> 00:21:58,459 That's my old talk, 589 00:21:59,570 --> 00:22:01,699 a little bit of background about myself. 590 00:22:01,700 --> 00:22:03,589 I was working with genes, Japanese 591 00:22:03,590 --> 00:22:05,899 classes, company on sensing 592 00:22:05,900 --> 00:22:07,879 glasses that have accelerometer and also 593 00:22:07,880 --> 00:22:10,189 some low level eye tracking 594 00:22:10,190 --> 00:22:11,449 in them. 595 00:22:11,450 --> 00:22:14,179 And now, since December, 596 00:22:14,180 --> 00:22:15,259 I have some good news. 597 00:22:15,260 --> 00:22:17,659 I have support from the Japanese 598 00:22:17,660 --> 00:22:20,179 government, especially as or GST, 599 00:22:20,180 --> 00:22:22,729 to sponsor collective open eyewear 600 00:22:22,730 --> 00:22:23,869 platform. 601 00:22:23,870 --> 00:22:26,149 And I'm also looking for collaborators. 602 00:22:26,150 --> 00:22:28,249 So to work 603 00:22:28,250 --> 00:22:30,649 on this, because I think this is crucial 604 00:22:30,650 --> 00:22:31,819 to start now 605 00:22:33,140 --> 00:22:35,329 because, you know, I don't want to 606 00:22:35,330 --> 00:22:37,549 end up in a situation that we have 607 00:22:37,550 --> 00:22:40,069 today with our mobile phones that we have 608 00:22:40,070 --> 00:22:42,049 just more or less or that most people 609 00:22:42,050 --> 00:22:44,299 just have two providers, two big 610 00:22:44,300 --> 00:22:46,459 companies that tell you 611 00:22:46,460 --> 00:22:48,529 what you are able to run on your mobile 612 00:22:48,530 --> 00:22:50,599 phones. And I think eyewear for me, you 613 00:22:50,600 --> 00:22:52,669 know, believe it or not, because my track 614 00:22:52,670 --> 00:22:54,319 record is not so good predicting the 615 00:22:54,320 --> 00:22:55,669 future. 616 00:22:55,670 --> 00:22:57,679 However, I think eyewear is the next 617 00:22:57,680 --> 00:22:59,180 stepping stone is the next 618 00:23:00,380 --> 00:23:02,629 thing. And I really want to have an 619 00:23:02,630 --> 00:23:04,549 open eyewear platform out there. 620 00:23:04,550 --> 00:23:07,249 So that's the background for myself. 621 00:23:07,250 --> 00:23:09,859 And I think for me, the superhuman sports 622 00:23:09,860 --> 00:23:12,049 is a great testing ground 623 00:23:12,050 --> 00:23:13,909 for these type of technologies. 624 00:23:13,910 --> 00:23:16,039 And then really not only doing sensing, 625 00:23:16,040 --> 00:23:18,529 but also really trying to amplify 626 00:23:18,530 --> 00:23:19,669 human senses. 627 00:23:19,670 --> 00:23:21,439 In this case, I have to hurry a bit 628 00:23:21,440 --> 00:23:23,449 because I'm behind time and I want to 629 00:23:23,450 --> 00:23:25,369 still show a demo. 630 00:23:25,370 --> 00:23:27,919 However, here, the idea is that sensors, 631 00:23:27,920 --> 00:23:29,989 digital sensors are in some parts 632 00:23:29,990 --> 00:23:32,359 already better than human sensors. 633 00:23:32,360 --> 00:23:34,459 So, you know, you can have a higher 634 00:23:34,460 --> 00:23:36,859 frame rates, you can have 635 00:23:36,860 --> 00:23:38,149 a broader spectrum. 636 00:23:38,150 --> 00:23:40,399 So you could see infrared and so on. 637 00:23:40,400 --> 00:23:42,499 However, what is lacking from our 638 00:23:42,500 --> 00:23:44,719 side is the interface to it. 639 00:23:44,720 --> 00:23:46,789 So I wonder really, can 640 00:23:46,790 --> 00:23:48,979 we create new 641 00:23:48,980 --> 00:23:51,379 and amplified sensors 642 00:23:51,380 --> 00:23:54,889 based on digital technologies 643 00:23:54,890 --> 00:23:56,490 and just going with the 644 00:23:58,130 --> 00:24:00,349 digital camera system analogy, I 645 00:24:00,350 --> 00:24:02,209 just want to give you a small example at 646 00:24:02,210 --> 00:24:04,489 the end of the talk now, and 647 00:24:04,490 --> 00:24:07,009 that is going to assume so 648 00:24:07,010 --> 00:24:08,989 if I would be standing here and there's a 649 00:24:08,990 --> 00:24:10,939 sign in the back and I want to read the 650 00:24:10,940 --> 00:24:13,279 sign and I cannot do it with my normal 651 00:24:13,280 --> 00:24:15,199 eyesight, I will squint. 652 00:24:15,200 --> 00:24:17,089 And, you know, wouldn't it be nice if I 653 00:24:17,090 --> 00:24:19,249 could wear some kind of glasses that 654 00:24:19,250 --> 00:24:21,289 automatically if they recognize that I 655 00:24:21,290 --> 00:24:23,479 try to read this and squint, which 656 00:24:23,480 --> 00:24:25,789 is to me then, and I don't even realize 657 00:24:25,790 --> 00:24:28,199 that I'm using technology. 658 00:24:28,200 --> 00:24:30,449 And unfortunately, I 659 00:24:30,450 --> 00:24:32,669 wanted to show you a demo on 660 00:24:32,670 --> 00:24:34,470 the whole, so I have one here. 661 00:24:35,760 --> 00:24:37,979 However, I didn't manage to get 662 00:24:37,980 --> 00:24:40,439 this working on the whole balance, 663 00:24:40,440 --> 00:24:43,389 and I'm happy that I have 664 00:24:43,390 --> 00:24:45,479 a student, George, who could 665 00:24:45,480 --> 00:24:47,820 set up a demo on. 666 00:24:49,520 --> 00:24:51,619 On a laptop that gives you 667 00:24:51,620 --> 00:24:53,049 a feeling how this works. 668 00:24:54,430 --> 00:24:55,540 So can you switch? 669 00:24:56,910 --> 00:24:59,369 Yeah, so in this case, 670 00:24:59,370 --> 00:25:01,139 this is unfortunately just on the laptop, 671 00:25:01,140 --> 00:25:03,479 but you can get an idea 672 00:25:03,480 --> 00:25:05,639 in this case I'm using a Tobii tracker 673 00:25:05,640 --> 00:25:08,009 to track my I guess I have 674 00:25:08,010 --> 00:25:10,380 a camera and just a simple open kvi 675 00:25:12,150 --> 00:25:14,219 to track my 676 00:25:14,220 --> 00:25:15,269 face. 677 00:25:15,270 --> 00:25:17,519 And then if I now go 678 00:25:17,520 --> 00:25:19,739 ahead and squint, it zooms 679 00:25:19,740 --> 00:25:21,899 in. I can show you also this 680 00:25:21,900 --> 00:25:23,639 on a on a document. 681 00:25:23,640 --> 00:25:25,919 So if I squint, it zooms 682 00:25:25,920 --> 00:25:26,999 in. 683 00:25:27,000 --> 00:25:28,469 If I don't, it stops. 684 00:25:30,340 --> 00:25:32,469 And that's actually a very, very simple 685 00:25:32,470 --> 00:25:34,359 type of interaction you could do. 686 00:25:34,360 --> 00:25:36,669 I hope that could show it to you on an 687 00:25:36,670 --> 00:25:39,069 on in our system, but that's maybe 688 00:25:39,070 --> 00:25:41,349 something for for next year. 689 00:25:41,350 --> 00:25:43,239 Here again, as I said, you know, kind of 690 00:25:43,240 --> 00:25:45,999 the desktop eye tracker and 691 00:25:46,000 --> 00:25:47,949 I can show you a little bit how it works. 692 00:25:47,950 --> 00:25:50,359 So this is just an open KVI system. 693 00:25:50,360 --> 00:25:53,079 I think George uses the 694 00:25:53,080 --> 00:25:55,539 eyebrows and the relation to the nose 695 00:25:55,540 --> 00:25:57,069 and the size of my eyes. 696 00:25:57,070 --> 00:25:59,289 So if I squint down, this 697 00:25:59,290 --> 00:26:01,389 relation changes and it's 698 00:26:01,390 --> 00:26:03,459 zooms in and if I stop, it 699 00:26:03,460 --> 00:26:04,460 zooms out. 700 00:26:13,840 --> 00:26:15,939 And so this just 701 00:26:15,940 --> 00:26:18,429 should give you a small 702 00:26:18,430 --> 00:26:20,619 idea of what I'm trying to 703 00:26:20,620 --> 00:26:22,719 create or what I want to create 704 00:26:22,720 --> 00:26:25,029 things, technology that's easy 705 00:26:25,030 --> 00:26:27,099 to use, that 706 00:26:27,100 --> 00:26:28,809 that you don't even realize that you're 707 00:26:28,810 --> 00:26:31,149 using similar to the analog 708 00:26:31,150 --> 00:26:32,229 glasses. 709 00:26:32,230 --> 00:26:34,419 So on and also not 710 00:26:34,420 --> 00:26:36,519 only for sensing, but hearing in other 711 00:26:36,520 --> 00:26:37,719 senses as well. 712 00:26:37,720 --> 00:26:40,239 So this brings me to the end of 713 00:26:40,240 --> 00:26:42,939 my talk. I just have some obligatory 714 00:26:42,940 --> 00:26:45,269 thank you slide. So these are all people 715 00:26:45,270 --> 00:26:47,349 I am working with and that that 716 00:26:47,350 --> 00:26:49,119 contributed to the research you've been 717 00:26:49,120 --> 00:26:50,019 seeing. 718 00:26:50,020 --> 00:26:52,419 And I have a special 719 00:26:52,420 --> 00:26:54,729 thank you slide for the 720 00:26:54,730 --> 00:26:56,709 students that actually did the work, and 721 00:26:56,710 --> 00:26:58,959 especially George, who 722 00:26:58,960 --> 00:27:01,419 made the demo you just saw, 723 00:27:01,420 --> 00:27:03,579 but also musci for the 724 00:27:03,580 --> 00:27:05,779 effective wear and the 725 00:27:05,780 --> 00:27:07,209 the rest of the crew. 726 00:27:07,210 --> 00:27:09,429 And now this 727 00:27:09,430 --> 00:27:10,659 is the end of my talk. 728 00:27:10,660 --> 00:27:12,849 And I think there's a time for 729 00:27:12,850 --> 00:27:14,979 a couple of questions, remarks or 730 00:27:14,980 --> 00:27:16,209 violent dissent. 731 00:27:16,210 --> 00:27:17,789 So thanks a lot for your attention. 732 00:27:24,340 --> 00:27:26,959 Wow, really cool stuff 733 00:27:26,960 --> 00:27:28,299 that was so cool. 734 00:27:28,300 --> 00:27:30,099 You have a chance to talk to Kai right 735 00:27:30,100 --> 00:27:32,049 now to ask him questions, there are four 736 00:27:32,050 --> 00:27:34,209 microphones in the room, 737 00:27:34,210 --> 00:27:36,579 so find yourself behind one of 738 00:27:36,580 --> 00:27:39,099 those microphones if you have a question. 739 00:27:41,140 --> 00:27:43,509 Also, the Internet is always able to 740 00:27:43,510 --> 00:27:45,849 ask questions if they are awake 741 00:27:45,850 --> 00:27:47,979 by now. Does the Internet have 742 00:27:47,980 --> 00:27:48,980 anything? 743 00:27:50,960 --> 00:27:54,229 Yes, one question from the Internet, 744 00:27:54,230 --> 00:27:55,230 yes, 745 00:27:57,560 --> 00:27:59,869 is that code for eye tracking available, 746 00:28:00,950 --> 00:28:03,109 which was the which 747 00:28:03,110 --> 00:28:03,589 one? 748 00:28:03,590 --> 00:28:05,959 So for eye tracking, I can recommend 749 00:28:05,960 --> 00:28:08,599 you, uh, pupil apps. 750 00:28:08,600 --> 00:28:09,600 So. 751 00:28:12,650 --> 00:28:14,519 The eye tracking code right now, I'm just 752 00:28:14,520 --> 00:28:17,219 using Toback's, so that's 753 00:28:17,220 --> 00:28:20,009 kind of Taulbee proprietary, 754 00:28:20,010 --> 00:28:21,389 they have an API. 755 00:28:21,390 --> 00:28:23,819 Uh, that's, um, it's 756 00:28:23,820 --> 00:28:25,469 just a desktop tracker. 757 00:28:25,470 --> 00:28:27,539 However, if you want to have a mobile eye 758 00:28:27,540 --> 00:28:29,969 tracker, I would recommend you pupal 759 00:28:29,970 --> 00:28:31,919 apps. That's an open source eye tracker. 760 00:28:31,920 --> 00:28:34,229 They just keep the latest revision 761 00:28:34,230 --> 00:28:36,779 of their hardware close source 762 00:28:36,780 --> 00:28:39,029 and they have all of their code up 763 00:28:39,030 --> 00:28:41,849 on GitHub. So it's very, very easy to 764 00:28:41,850 --> 00:28:44,099 to adjust. And they also have 765 00:28:44,100 --> 00:28:45,659 settings for VR headsets. 766 00:28:45,660 --> 00:28:47,189 So you can easily use it. 767 00:28:47,190 --> 00:28:49,409 You can just kind of use build 768 00:28:49,410 --> 00:28:50,499 your own cameras. 769 00:28:50,500 --> 00:28:52,409 That's easy. Use their code. 770 00:28:52,410 --> 00:28:54,179 If you kind of you have budget 771 00:28:54,180 --> 00:28:56,429 constraints that Tobii X is 772 00:28:56,430 --> 00:28:56,999 OK. 773 00:28:57,000 --> 00:28:59,409 But I don't like Tobii, 774 00:28:59,410 --> 00:29:01,529 as am I so much because 775 00:29:01,530 --> 00:29:04,109 they use clotheshorse APIs 776 00:29:04,110 --> 00:29:06,629 and it's hard to get to the actual images 777 00:29:06,630 --> 00:29:08,249 because, you know, you want to have, for 778 00:29:08,250 --> 00:29:10,589 example, pupil dilation 779 00:29:10,590 --> 00:29:12,209 because that gives you information about 780 00:29:12,210 --> 00:29:13,349 stress and other things. 781 00:29:13,350 --> 00:29:15,119 And that's not so easy. 782 00:29:15,120 --> 00:29:17,339 Right. Um, actually, let's go 783 00:29:17,340 --> 00:29:19,599 to microphone number six, 784 00:29:19,600 --> 00:29:20,600 please. 785 00:29:21,480 --> 00:29:23,759 So I have just 786 00:29:23,760 --> 00:29:26,219 a quick question about 787 00:29:26,220 --> 00:29:28,319 how open you are to be 788 00:29:28,320 --> 00:29:30,389 able to collaborate with 789 00:29:30,390 --> 00:29:31,979 different universities from around the 790 00:29:31,980 --> 00:29:34,049 world to use your technology and 791 00:29:34,050 --> 00:29:35,050 research 792 00:29:36,120 --> 00:29:38,249 I work in and 793 00:29:38,250 --> 00:29:40,079 the effect of sciences department and the 794 00:29:40,080 --> 00:29:41,609 University of Geneva. 795 00:29:41,610 --> 00:29:44,729 And we actually use a lot of motion 796 00:29:44,730 --> 00:29:46,259 tracking this. 797 00:29:46,260 --> 00:29:48,359 I am tracking Bee super interesting 798 00:29:48,360 --> 00:29:50,429 for a fact of science research, 799 00:29:50,430 --> 00:29:51,749 especially as well our facial 800 00:29:51,750 --> 00:29:53,759 expressions. We use that a lot. 801 00:29:53,760 --> 00:29:56,069 So I would also be interesting. 802 00:29:56,070 --> 00:29:58,169 So you've discussed how 803 00:29:58,170 --> 00:29:59,759 to use it for like opening up 804 00:29:59,760 --> 00:30:01,679 possibilities in the real world and 805 00:30:01,680 --> 00:30:03,359 actually enhancing everyone as a general 806 00:30:03,360 --> 00:30:05,609 population. But how open 807 00:30:05,610 --> 00:30:08,369 are you to using it for research as well? 808 00:30:08,370 --> 00:30:09,449 Yeah, we're very open. 809 00:30:09,450 --> 00:30:10,979 I mean, that's also the reason why I give 810 00:30:10,980 --> 00:30:13,109 the talk. I mean, now finally, I get also 811 00:30:13,110 --> 00:30:15,389 a little bit of money to funders, uh, 812 00:30:15,390 --> 00:30:16,889 from from the Japan side. 813 00:30:16,890 --> 00:30:18,749 And I really want to find people that 814 00:30:18,750 --> 00:30:20,909 want to collaborate on on this side. 815 00:30:20,910 --> 00:30:23,039 And I think, you know, kind of especially 816 00:30:23,040 --> 00:30:25,109 seeing how 817 00:30:25,110 --> 00:30:26,999 Silicon Valley now also invests in 818 00:30:27,000 --> 00:30:28,559 eyewear. And I think the next thing we 819 00:30:28,560 --> 00:30:30,869 will see is eye trackers in VR 820 00:30:30,870 --> 00:30:33,089 and so on and how close those 821 00:30:33,090 --> 00:30:34,019 systems are. 822 00:30:34,020 --> 00:30:36,149 I would really like to have this 823 00:30:36,150 --> 00:30:38,039 collaboration. So just try to catch me 824 00:30:38,040 --> 00:30:40,229 afterwards or just send me also email 825 00:30:40,230 --> 00:30:43,199 would would love to to to keep in touch 826 00:30:43,200 --> 00:30:44,249 things. 827 00:30:44,250 --> 00:30:46,319 And microphone number two, please. 828 00:30:46,320 --> 00:30:47,579 Well thank you. Amazing talk. 829 00:30:47,580 --> 00:30:49,919 And how important do you think will 830 00:30:49,920 --> 00:30:52,169 be the combination of external signals 831 00:30:52,170 --> 00:30:54,449 like squinting or looking at something 832 00:30:54,450 --> 00:30:56,609 and internal signals or like 833 00:30:56,610 --> 00:30:58,829 directly measuring the brainwaves or 834 00:30:58,830 --> 00:31:00,479 with an EKG? Do you think that is 835 00:31:00,480 --> 00:31:02,819 important to combine those or 836 00:31:02,820 --> 00:31:04,349 it's important to combine those? 837 00:31:04,350 --> 00:31:06,479 I actually I started looking into a lot 838 00:31:06,480 --> 00:31:08,549 of the EEG signals and so 839 00:31:08,550 --> 00:31:10,889 on when I started this work, but 840 00:31:10,890 --> 00:31:13,079 it's very hard to get into your skull. 841 00:31:13,080 --> 00:31:15,299 So EEG, uh, 842 00:31:15,300 --> 00:31:17,849 also brain computer interfaces, I think 843 00:31:17,850 --> 00:31:20,099 will take a while, uh, to to 844 00:31:20,100 --> 00:31:22,229 work. And you also have this trouble of 845 00:31:22,230 --> 00:31:24,089 the signal processing is relatively hard. 846 00:31:24,090 --> 00:31:26,219 And because I'm lazy, I started with the 847 00:31:26,220 --> 00:31:28,769 eyes and the eyes give you actually 848 00:31:28,770 --> 00:31:30,779 already a lot of information you want to 849 00:31:30,780 --> 00:31:32,099 get from the brain. 850 00:31:32,100 --> 00:31:34,289 I like to think about combinations. 851 00:31:34,290 --> 00:31:35,699 So for some things, we are already 852 00:31:35,700 --> 00:31:38,039 working with, uh, also EEG. 853 00:31:38,040 --> 00:31:40,019 And I think it's it's crucial to find the 854 00:31:40,020 --> 00:31:42,209 right type of sensing so that it works 855 00:31:42,210 --> 00:31:43,589 throughout the everyday life. 856 00:31:43,590 --> 00:31:45,569 I think one example was also jeans. 857 00:31:45,570 --> 00:31:48,069 And now with the with the the, uh, 858 00:31:48,070 --> 00:31:50,219 just project, what we really 859 00:31:50,220 --> 00:31:52,919 trying to do is find simple sensors 860 00:31:52,920 --> 00:31:55,019 to give you some information about your 861 00:31:55,020 --> 00:31:56,559 your your brain activities and so on. 862 00:31:56,560 --> 00:31:58,859 I think it's really a combination of 863 00:31:58,860 --> 00:32:00,329 multiple sensors. 864 00:32:00,330 --> 00:32:02,549 And I think, as I said, the AI is very, 865 00:32:02,550 --> 00:32:03,839 very interesting. 866 00:32:03,840 --> 00:32:06,059 Yeah, I think we have time for one more 867 00:32:06,060 --> 00:32:08,309 brief. Question number four, 868 00:32:08,310 --> 00:32:09,569 please. 869 00:32:09,570 --> 00:32:11,639 When I was wearing an 870 00:32:11,640 --> 00:32:14,039 eyeglasses, uh, my brain, 871 00:32:14,040 --> 00:32:16,229 the distance two objects so I 872 00:32:16,230 --> 00:32:17,589 couldn't grasp anything. 873 00:32:17,590 --> 00:32:19,979 It just wasn't there where I expect 874 00:32:19,980 --> 00:32:22,139 it. Yeah. Is there any chance this 875 00:32:22,140 --> 00:32:23,939 problem will go away? 876 00:32:23,940 --> 00:32:25,649 Uh, just depends heavily on the lens. 877 00:32:25,650 --> 00:32:26,939 So there's still this problem. 878 00:32:26,940 --> 00:32:29,159 It's also in the I mean, VR has this 879 00:32:29,160 --> 00:32:31,469 trouble with the with the 880 00:32:31,470 --> 00:32:33,359 the the the perception. 881 00:32:33,360 --> 00:32:35,849 Uh, you I think you will have 882 00:32:35,850 --> 00:32:38,459 always this issue. 883 00:32:38,460 --> 00:32:39,569 I found it. 884 00:32:39,570 --> 00:32:41,669 So the whole lens quite good for 885 00:32:41,670 --> 00:32:43,469 this. But here the problem is also you 886 00:32:43,470 --> 00:32:45,539 cannot grasp something because 887 00:32:45,540 --> 00:32:47,429 the the distance to the object is too 888 00:32:47,430 --> 00:32:49,649 far. So I'm still wondering I haven't 889 00:32:49,650 --> 00:32:51,729 seen something that's really, 890 00:32:51,730 --> 00:32:53,849 you know, kind of graspable, graspable in 891 00:32:53,850 --> 00:32:56,339 the way you have the right distances 892 00:32:56,340 --> 00:32:58,409 or so on. I think either your brain has 893 00:32:58,410 --> 00:33:00,599 to get used to it, which I think it does. 894 00:33:00,600 --> 00:33:03,239 After a while, it gets the distance 895 00:33:03,240 --> 00:33:05,099 measurements correct, or we have to 896 00:33:05,100 --> 00:33:07,169 employ some other tricks, uh, 897 00:33:07,170 --> 00:33:08,339 to to do that. 898 00:33:08,340 --> 00:33:10,019 What you can do for that, I'm not so 899 00:33:10,020 --> 00:33:11,020 sure. 900 00:33:12,340 --> 00:33:14,409 And with that, we're at the end of 901 00:33:14,410 --> 00:33:16,059 the talk. Thank you so much. 902 00:33:16,060 --> 00:33:17,759 Can you please help me think you, 903 00:33:17,760 --> 00:33:18,760 Vincent?