"Wanted to try using noninvasive recordings of brain activity. And the goal was to build an AI system that can decode brain
Those datasets contain the brain recordings of 169 healthy volunteers, taken as they were listening to audiobooks in Dutch and English, over 150 hours worth.
After chopping up those hours into three second bits, they fed both the audiobook and brain recordings to the AI, which analyzed them to spot patterns.
our system performs what’s known as zero-shot classification
From there, the algorithm infers the words the person has most likely heard
AI was capable of getting the right word in the top ten 72.5% of the time when using three seconds of MEG data — hitting it first guess 44% of the time — and 19.1% for EEG data. "