WO2018117439A1

WO2018117439A1 - Game type rehabilitation system using brain-computer interface (bci) and control method therefor

Info

Publication number: WO2018117439A1
Application number: PCT/KR2017/013302
Authority: WO
Inventors: 구정훈
Original assignee: 계명대학교 산학협력단
Priority date: 2016-12-23
Filing date: 2017-11-21
Publication date: 2018-06-28

Abstract

According to a game type rehabilitation system using a brain-computer interface (BCI) and a control method therefor, which are presented in the present invention, and in a manner different from that of the usage of flickering light by a conventional system using SSVEP, mirror neurons are activated by using a moving image capable of activating mirror neurons by means of a signal image including a particular frequency of SSVEP, or through a game image in which a flickering body part of an object is displayed by a particular frequency of SSVEP and the body part of the object observed by a user moves, thereby enabling image observation concentration to increase by arousing a user's interest and, simultaneously, enabling the user to actively rehabilitate.

Description

Game-type rehabilitation system using brain-computer interface (BCI) and its control method

The present invention relates to a rehabilitation system and a method of controlling the same, and more particularly, by recognizing a signal image including a movement by a user, rehabilitation training using activation of a mirror nerve cell of a user, the brain- A game rehabilitation system using a computer interface (BCI) and a control method thereof.

In addition, the present invention relates to a rehabilitation system and a control method thereof, and more particularly, to perform rehabilitation training using activation of a mirror nerve cell of a user according to movement of a body part of an object to be selectively monitored by a user. The present invention relates to a game-based rehabilitation system and a control method thereof, wherein a brain-computer interface (BCI) is directly applied to a game image.

In general, a brain disease patient having a deficiency of exercise ability is not able to control the paralyzed muscles with his or her will in many cases, and physical therapy, drug treatment, surgery, etc. as a method of helping the rehabilitation of the patient. In particular, in rehabilitation training using physical therapy, active treatment by the patient's will has been reported to have a high effect of rehabilitation training, but in patients who have limited movement due to muscle paralysis, such rehabilitation training There is a problem that can only be made manually by the physical therapist.

On the other hand, in order to increase the effect of rehabilitation training, there is a treatment method using the stimulation of the mirror nerve cells of the patient. This is meaningful because it is an active rehabilitation training that is performed by the patient's attention to a particular object, not by manual therapy by a physiotherapist. A mirror nerve cell is a cell that causes the same reaction in the observer's body as if the observer actually acted, not just experiencing it directly, but by seeing another person's behavior. As a rehabilitation training using this method, there is a method of showing a video including the movement of a specific subject in order to activate the patient's mirror nerve cells, this method, a patient who can not operate by his will due to brain injury For example, just watching someone else's actions affects the patient's physical system as if the patient himself was acting on his own.

In recent years, researches related to rehabilitation using brain waves of patients have been conducted. In particular, the BCI (Brain-Computer Interface) refers to a device for transmitting EEG to a computer. Development of rehabilitation system using communication is getting active.

SSVEP (Steady-State Visually Evoked Potentials), which is introduced as a BCI technique, is called the steady state visual oil potential level, which is generated by the user's brain waves when the user watches the blinking light. Points to EEG with the same frequency. That is, in the BCI technology using SSVEP, when the user sees the light flickering at a specific frequency, SSVEP is generated at the back of the user's brain, and the SSVEP measured by the EEG measuring device installed in the user's head is input to the computer. In other words, brain waves can be transmitted to a computer.

1 is a diagram illustrating an example of a system using a conventional SSVEP. As shown in FIG. 1, SSVEP is detected from an EEG of a user by using light blinking at a specific frequency on a screen, and the detected EEG is transmitted to a computer. In this case, there may be one or more blinking lights, and each specific frequency is different, and through the analysis of the frequency of the SSVEP detected by the brainwave of the user, it is possible to know what light the user is looking at. Each blinking light has a predetermined signal, and the system can remotely control the device corresponding to the light signal that the user watches. Since the system using the blinking light is only using the blinking light, it is difficult for the user to be interested in it, and there is a problem of low concentration. As prior arts related to such a system using SSVEP, Korean Patent Application Publication No. 10-2014-0075049 (name of the invention: a method for evaluating concentration and a device applying the same), and Patent No. 10-1431203 (name of the invention: EEG) Brain machine interface device and method for intention recognition).

As described above, the system using the conventional SSVEP is not interested in the user, the concentration must be low, there is a need for a solution that can increase the concentration of the user, in addition, through active rehabilitation training of the user The necessity of developing the method of activating a mirror nerve cell which can raise the effect of rehabilitation training is increasing.

The present invention has been proposed to solve the above problems of the conventionally proposed methods, unlike the conventional system using the SSVEP using a flashing light, the mirror nerve cell as a signal image containing a specific frequency of SSVEP By using a moving image that can activate or by displaying the body part of the object blinking at a specific frequency of SSVEP, and by activating the mirror nerve cell through the game image that the body part of the object to be watched by the user, Increasing the concentration of attention to the image by inducing interest, and at the same time, to provide a rehabilitation system of the game method using a brain-computer interface (BCI) and the control method thereof to enable active rehabilitation training of the user For that purpose.

In addition, the present invention, by using a method of displaying the game image proceeds by using the user's brain waves in accordance with the signal image in the vicinity of the signal image, or displays the image of the body part of the object flickering at a specific frequency and the user When looking at a specific body part of, the body part moves in a preset manner, and by using a method in which the game is progressed by the movement of an object, the user can enjoy the game, thereby inducing the active participation of the user. Another object is to provide a game-type rehabilitation system and a control method of the rehabilitation system using a brain-computer interface (BCI).

In addition, the present invention is a rehabilitation system that can simultaneously utilize the activation of the mirror nerve cells in the SSVEP introduced by the BCI technique and a signal image including a moving image, to further enhance the effect of rehabilitation training, brain Another object is to provide a game-type rehabilitation system and a control method of the rehabilitation system using a computer interface (BCI).

Game-type rehabilitation system using a brain-computer interface (BCI), according to a feature of the present invention for achieving the above object,

As a rehabilitation system,

A display device configured to display a game image and a signal image disposed around the game image and which the user can observe;

An EEG obtaining device for acquiring an EEG of a user corresponding to the signal image displayed on the display device;

An EEG analyzer for analyzing EEG of the user acquired by the EEG acquisition apparatus; And

And a control device for controlling a game image of the display device according to a result corresponding to the brain wave analyzed by the brain wave analysis device.

According to the movement for activating the mirror nerve cells displayed in the signal image, the rehabilitation training using the activation of the mirror nerve cells of the user is characterized by its configuration.

Preferably, the display device,

A signal image display unit displaying a signal image for activating a mirror nerve cell of a user; And

It may include a game image display unit for displaying a game image controlled by the control device.

More preferably, the signal image display unit,

The display device may include one or more display areas.

Even more preferably, the signal image display unit,

Each signal image displayed on the at least one display area may be displayed to blink at a different frequency.

Even more preferably, the signal image display unit,

For each signal image displayed on the at least one display area, different movements for activating the mirror nerve cell may be displayed.

Preferably, the EEG analysis device,

An EEG detecting unit for detecting EEG when the user looks at one of the signal images; And

It may include an EEG analyzer for analyzing the frequency of the EEG detected by the EEG detector.

More preferably, the EEG detection unit,

SSVEP may be detected from the EEG signal of the user corresponding to the one signal image that the user watches.

Even more preferably, the EEG analysis unit,

The frequency of the SSVEP detected by the EEG detector may be analyzed.

Even more preferably, the control device,

A control signal generator configured to generate a game image control signal corresponding to a signal image corresponding to the SSVEP having a specific frequency analyzed by the EEG analyzer; And

And a controller for controlling the game image by using the game image control signal generated by the control signal generator.

Preferably, the display device,

It may be at least one of a TV, a computer, a laptop, a smart TV, and a tablet PC.

In addition, a control method of a game-type rehabilitation system using a brain-computer interface (BCI) according to another feature of the present invention for achieving the above object,

As a control method of the rehabilitation system,

(1) displaying, by the display device, a game image and a signal image disposed around the game image and which the user can observe;

(2) acquiring an EEG of the user corresponding to the signal image displayed in step (1) by the EEG obtaining apparatus;

(3) the EEG analyzing apparatus, analyzing the EEG of the user obtained in the step (2); And

(4) controlling, by the control device, to control the game image of the display device according to the result corresponding to the brain wave analyzed in the step (3);

Preferably, the display device,

More preferably, the signal image display unit,

The display device may include one or more display areas.

Even more preferably, the signal image display unit,

Preferably, the EEG analysis device,

More preferably, the EEG detection unit,

Even more preferably, the EEG analysis unit,

The frequency of the SSVEP detected by the EEG detector may be analyzed.

Even more preferably, the control device,

Preferably, the display device,

According to a feature of the present invention for achieving the above object, a game-type rehabilitation system applying a brain-computer interface (BCI) directly to the game image,

As a rehabilitation system,

A display device for displaying a game image;

An EEG acquisition device for acquiring an EEG of a user corresponding to a game image displayed on the display device;

And a control device for controlling a game image displayed on the display device according to a result corresponding to the brain wave analyzed by the brain wave analysis device.

The control device,

One or more body parts of the object displayed on the game image may be controlled to blink at a specific frequency, and when the user observes the corresponding body parts, the brain waves obtained by the brain wave acquisition device and the brain wave analysis device correspond to the analyzed brain waves. Depending on the result, the body part can be controlled to move in a preset manner.

The configuration features the rehabilitation training using the activation of the user's mirror nerve cells according to the movement of the body part of the object that the user selectively watches.

Preferably, the display device,

It may further include a guide content for the progress of the game image.

More preferably, the display device,

It may include a voice output device for outputting the voice content corresponding to the guide content.

Preferably,

The specific frequency at which one or more body parts of the object blinks may be the same frequency regardless of the body parts, or may be different frequencies for each body part.

Preferably,

The game image in which the body part moves in a preset manner may include a movement to help the user's rehabilitation.

Preferably, the EEG analysis device,

An EEG detecting unit for detecting EEG when the user selectively looks at a specific body part of the object; And

More preferably, the EEG detection unit,

SSVEP may be detected from the EEG signal of the user corresponding to a specific body part of the object that the user selectively watches.

Even more preferably, the EEG analysis unit,

The frequency of the SSVEP detected by the EEG detector may be analyzed.

Even more preferably, the control device,

A control signal generator configured to generate a control signal for moving a body part of an object corresponding to a Steady-State Visually Evoked Potentials (SSVEP) having a specific frequency analyzed by the EEG analyzer in a preset manner; And

The controller may include a controller configured to control a display device displaying the movement of the object by using the control signal generated by the control signal generator.

Preferably, the display device,

In addition, a control method of a game-type rehabilitation system applying a brain-computer interface (BCI) directly to the game image according to another feature of the present invention for achieving the above object,

As a control method of the rehabilitation system,

(1) displaying, by the display device, a game image;

(2) acquiring an EEG of the user corresponding to the game image displayed in the step (1) by the EEG obtaining apparatus;

(4) controlling, by the control device, to control the game image displayed on the display device according to the result corresponding to the brain wave analyzed in the step (3),

In step (1),

Displaying the game image such that one or more body parts of an object displayed on the game image blink at a specific frequency,

In step (4),

When the user observes the corresponding body part, the body part is controlled to move in a preset manner according to the result corresponding to the brain wave acquired through the steps (2) and (3).

Preferably, the display device,

It may further include a guide content for the progress of the game image.

More preferably, the display device,

Preferably,

The specific frequency of one or more body parts of the object may be the same frequency regardless of the body parts, or may be different frequencies for each body part.

Preferably,

Preferably, the EEG analysis device,

More preferably, the EEG detection unit,

Even more preferably, the EEG analysis unit,

The frequency of the SSVEP detected by the EEG detector may be analyzed.

Even more preferably, the control device,

A control signal generator configured to generate a control signal for moving a body part of an object corresponding to the SSVEP having a specific frequency analyzed by the EEG analyzer in a preset manner; And

Preferably, the display device,

According to the game-based rehabilitation system and control method using the brain-computer interface (BCI) proposed in the present invention, the conventional system using the SSVEP includes a specific frequency of the SSVEP, unlike using a flashing light Using a moving image that can activate mirror nerve cells as a signal image, or displaying the body part of an object blinking at a specific frequency of SSVEP, and through the game image where the body part of the object that the user watches is moved, the mirror nerve By activating the cells, it is possible to increase the concentration of attention to the image by inducing the interest of the user, and at the same time, it is possible to enable active rehabilitation training of the user.

In addition, according to the present invention, by using a method of displaying the game image proceeds by using the user's brain waves according to the signal image in the vicinity of the signal image, or displays the image of the body part of the object flickering at a specific frequency When the user observes a specific body part of the object, the body part moves in a preset manner and the game is progressed by the movement of the object, so that the user can enjoy the game and induce active participation of the user. Can be.

In addition, according to the present invention, SSVEP which is introduced by the BCI technique and a signal image including a moving image as a rehabilitation system that can utilize the activation of the mirror nerve cells at the same time, it is possible to further enhance the effect of rehabilitation training.

1 is a diagram illustrating an example of a system using a conventional SSVEP.

2 is a diagram illustrating a frequency analysis result of brain waves output through a system using a conventional SSVEP.

Figure 3 is a photograph showing that a certain area of the brain of the observer observing the movement of others is activated.

4 is a view showing a user performing rehabilitation training in a game-type rehabilitation system using a brain-computer interface (BCI) according to an embodiment of the present invention.

5 is a diagram illustrating an EEG acquisition apparatus of a game-based rehabilitation system using a brain-computer interface (BCI) according to an embodiment of the present invention.

6 is a diagram illustrating a display device of a game-based rehabilitation system using a brain-computer interface (BCI) according to another embodiment of the present invention.

7 is a block diagram of a game-based rehabilitation system using a brain-computer interface (BCI) in accordance with one embodiment of the present invention.

8 is a diagram showing the overall configuration of a game-based rehabilitation system using a brain-computer interface (BCI) according to an embodiment of the present invention.

9 is a diagram showing the overall configuration of a game-based rehabilitation system using a brain-computer interface (BCI) according to another embodiment of the present invention.

10 is a flowchart illustrating a control method of a rehabilitation system in a game-based rehabilitation system using a brain-computer interface (BCI) according to an embodiment of the present invention.

11 is a view showing the configuration of a game-based rehabilitation system 10 applying a brain-computer interface (BCI) directly to the game image according to an embodiment of the present invention.

12 is a diagram illustrating a user performing rehabilitation training in a game-type rehabilitation system in which a brain-computer interface (BCI) is directly applied to a game image according to an embodiment of the present invention.

FIG. 13 is a diagram illustrating a game image in which a body part of an object to be watched by a user moves in a game-type rehabilitation system in which a brain-computer interface (BCI) is directly applied to a game image according to an embodiment of the present invention.

14 is a block diagram of a game type rehabilitation system in which a brain-computer interface (BCI) is directly applied to a game image according to an embodiment of the present invention.

FIG. 15 illustrates a part of a game image in a game type rehabilitation system in which a brain-computer interface (BCI) is directly applied to a game image according to an embodiment of the present invention.

16 is a view showing a user performing rehabilitation training in a game-type rehabilitation system in which a brain-computer interface (BCI) is directly applied to a game image according to another embodiment of the present invention.

FIG. 17 is a flowchart illustrating a control method in a game-type rehabilitation system in which a brain-computer interface (BCI) is directly applied to a game image according to an embodiment of the present invention.

10: game-based rehabilitation system using a brain-computer interface (BCI) according to an embodiment of the present invention

100: display device

110: signal image display unit

120: game video display unit

200: EEG acquisition device

300: EEG analysis device

310: brain wave detection unit

320: brain wave analysis unit

400: control unit

410: control signal generation unit

420: control unit

Hereinafter, exemplary embodiments will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. However, in describing the preferred embodiment of the present invention in detail, if it is determined that the detailed description of the related known function or configuration may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted. In addition, the same reference numerals are used throughout the drawings for parts having similar functions and functions.

In addition, throughout the specification, when a part is 'connected' to another part, it is not only 'directly connected' but also 'indirectly connected' with another element in between. Include. In addition, "including" a certain component means that it may further include other components, except to exclude other components unless specifically stated otherwise.

1 is a diagram illustrating an example of a system using a conventional SSVEP. As shown in FIG. 1, SSVEP is detected from an EEG of a user by using light blinking at a specific frequency on a screen, and the detected EEG is transmitted to a computer. In this case, there may be one or more blinking lights, and each specific frequency is different, and through the analysis of the frequency of the SSVEP detected by the brainwave of the user, it is possible to know what light the user is looking at. Each blinking light has a predetermined signal, and the system can remotely control the device corresponding to the light signal that the user watches.

FIG. 2 is a diagram illustrating a frequency analysis result of brain waves output through a conventional system using SSVEP. As shown in FIG. 2, in the brainwaves of a user gazing at one or more blinking lights, SSVEP of the same frequency as that of the blinking light gazed by the user may be detected, and peaks are displayed at respective frequencies. You can check it.

3 is a photograph showing that a certain region of the brain of an observer observing the motion of another person is activated. As shown in FIG. 3, the results of the study showed that when the observer observed the transitional movement and the mimicking movement, the observer showed different activities in specific regions of the brain, unlike when observing the same movement in a static picture. It is reported that this depends on the effector participating in the observed behavior. From this, motion observation can confirm that a certain region of the observer's brain is activated, and activated mirror neurons enhance the exercise circuits involved in the observer's actual execution of the observed movement, without the observer's actual movement. You can see that you can do rehabilitation training.

FIG. 4 is a diagram illustrating a user performing rehabilitation training in a game-based rehabilitation system 10 using a brain-computer interface (BCI) according to an embodiment of the present invention. As shown in FIG. 4, a game-based rehabilitation system 10 using a brain-computer interface (BCI) according to an embodiment of the present invention is a rehabilitation system, which is arranged around a game image and a game image and is user. Acquired by the display device 100 for displaying a signal image that can be observed by the user, the brain wave acquisition device 200, and the brain wave acquisition device 200 for acquiring an EEG of a user corresponding to the signal image displayed on the display device 100. EEG analysis device 300 for analyzing the brain waves of the user, and the control device 400 for controlling the game image of the display device 100 according to the result corresponding to the brain waves analyzed by the EEG analysis device 300 In addition, according to the movement for the activation of the mirror nerve cells displayed in the signal image, the rehabilitation training using the activation of the mirror nerve cells of the user is characterized by its configuration.

In the game-based rehabilitation system 10 using the brain-computer interface (BCI) according to an embodiment of the present invention, when the user looks at the signal image display unit 110, an EEG acquisition apparatus 200 attached to the user's head ) To obtain an SSVEP having the same frequency as that of the signal image of the signal image display unit 110. According to an embodiment, the EEG analyzing apparatus 300 analyzes a corresponding frequency of the SSVEP obtained by the EEG obtaining apparatus 200, and uses the thus analyzed frequency to control the signal generator 410 of the control apparatus 400. By controlling the game image display unit 120 of the display device 100 according to the control signal generated by the user, the user observes the signal image to activate the mirror nerve cells and at the same time active participation through the game progress Through rehabilitation training through.

FIG. 5 is a diagram illustrating an EEG acquisition apparatus 200 of a game type rehabilitation system 10 using a brain-computer interface (BCI) according to an embodiment of the present invention. As shown in FIG. 5, the EEG acquisition apparatus 200 of the game-based rehabilitation system 10 using a brain-computer interface (BCI) according to an embodiment of the present invention may include one or more electrodes for measuring EEG. It may include. According to an embodiment, one or more electrodes may be configured as a device surrounding the user's head, or by coupling the electrodes to the hat, the hat itself may be the EEG acquisition device 200. In addition, the electrode can also be used by applying an electrolyte gel, since the electrolyte gel plays a role in delivering the EEG detected from the scalp to the electrode well.

FIG. 6 is a diagram illustrating a display device 100 of a game-based rehabilitation system 10 using a brain-computer interface (BCI) according to another embodiment of the present invention. As shown in FIG. 6, the display device 100 of the game-based rehabilitation system 10 using the brain-computer interface (BCI) according to an embodiment of the present invention is for activating a mirror nerve cell of a user. It may include a signal image display unit 110 for displaying a signal image, and a game image display unit 120 for displaying a game image controlled by the control device 400. That is, the display device 100 of the game system rehabilitation system 10 using the brain-computer interface (BCI) according to an embodiment of the present invention, the signal image for displaying a signal image having a specific frequency including the movement The display unit 110 and the game image display unit 120 displaying a game in progress using the selected signal image according to the user's intention.

The signal image display unit 110 of the game-type rehabilitation system 10 using the brain-computer interface (BCI) according to an embodiment of the present invention may be configured with one or more display areas on the display device 100. According to an exemplary embodiment, the signal image display unit 110 may be disposed in front of the display device 100, and the signal image display unit 110 may be disposed on the same surface of the display device 100 so as to facilitate selective viewing of the user. It is common and can consist of four, eight or ten. Of course, in the game-type rehabilitation system 10 using the brain-computer interface (BCI) according to an embodiment of the present invention, the number of display regions of the signal image display unit 110 is limited to the above number only. no.

The signal image display unit 110 of the game-type rehabilitation system 10 using the brain-computer interface (BCI) according to an embodiment of the present invention blinks at different frequencies for each signal image displayed on one or more display areas. Can be displayed. According to an exemplary embodiment, the frequency of the signal image may use a frequency range of 7 Hz to 20 Hz. However, in the case of the frequency range of 7 Hz to 20 Hz, the user may recognize flickering, and thus the user may easily feel eye fatigue. Because the user feels, the user may reduce eye fatigue by using a frequency of 30 Hz or more, which is not recognized by the user.

Signal image display unit 110 of the game-type rehabilitation system 10 using the brain-computer interface (BCI) according to an embodiment of the present invention, the activation of the mirror nerve cells for each signal image displayed on one or more display areas It can display different movements for. According to an embodiment, the movement of the signal image may be displayed as a part of the body including a hand, a foot, a head, an arm, a leg, and the like, which is observed by the user by watching the movement of the body displayed on the signal image display unit 110. To activate the mirror nerve cells. That is, as can be seen in Figure 6, the signal image of the present invention includes a moving operation process, can increase the concentration by inducing the interest of the user, and by observing the movement, rehabilitation through activation of the user's mirror nerve cells The effect can also be obtained.

7 is a block diagram of a game-based rehabilitation system 10 using a brain-computer interface (BCI) according to an embodiment of the present invention. As shown in FIG. 7, in the game-based rehabilitation system 10 using the brain-computer interface (BCI) according to an embodiment of the present invention, the EEG obtained by the EEG acquisition apparatus 200 is an EEG detection unit. It may be connected to the EEG analysis device 300 including the 310 and the EEG analysis unit 320. In addition, the EEG analysis device 300 is connected to the control device 400 including the control signal generation unit 410 and the control unit 420, and controls the brain waves analyzed by the EEG analysis device 300 as a control device ( 400, the control device 400 may control a game of the game image display unit 120 of the display device 100 using the game image control signal.

8 is a diagram illustrating the overall configuration of a game-based rehabilitation system 10 using a brain-computer interface (BCI) according to an embodiment of the present invention. As shown in FIG. 8, in a game-based rehabilitation system 10 using a brain-computer interface (BCI) according to an embodiment of the present invention, a user may use one or more signal image display units of the display device 100 ( 110 may be selectively monitored, and the brain wave generated by watching the signal image may be transmitted to the brain wave analyzing apparatus 300. According to the embodiment, the EEG analysis device 300 is based on the EEG detection unit 310 for detecting EEG when the user looks at one signal image of the signal image, and the frequency of the EEG detected by the EEG detection unit 310 The EEG analyzer 320 may be analyzed. The EEG detector 310 may detect the SSVEP from the EEG signal of the user corresponding to one signal image that the user observes. When the user gazes at a signal image having a specific frequency, the brain wave having the same frequency as that of the signal image is physically induced in the visual cortex of the user's occipital lobe, and the oscillating brain wave having the same frequency as the stimulus induced by the signal image is SSVEP. It is called. Using this principle, it is possible to selectively change the frequency of the SSVEP to a specific frequency according to the user's intention to selectively look at the signal image having various frequencies. That is, when looking at the signal image having 15Hz, the brain wave is induced to 15Hz, when looking at 20Hz brain wave is induced to 20Hz, by using this principle to see the selective video signal according to the user's intention, The frequency of the SSVEP detected in the EEG signal may be adjusted, and finally, the EEG of the specific frequency selected by the user may be detected by the EEG detector 310.

The brain wave analysis unit 320 of the game-based rehabilitation system 10 using the brain-computer interface (BCI) according to an embodiment of the present invention, detected by the brain wave detection unit 310, a specific frequency selected by the user It can analyze the frequency of SSVEP having a.

The control device 400 of the game-based rehabilitation system 10 using the brain-computer interface (BCI) according to an embodiment of the present invention corresponds to the SSVEP having a specific frequency analyzed by the brain wave analyzer 320. A control signal generator 410 for generating a game image control signal corresponding to the signal image, and a controller 420 for controlling the game image using the game image control signal generated by the control signal generator 410. Can be. According to an embodiment, as a signal corresponding to the SSVEP having a specific frequency selected by the user, the control signal for controlling the game image may include a plurality of operation modes predetermined by the user. The plurality of operation modes are contents that the user manipulates to advance the game image, and include movement of the game object, holding technology, and the like, and the signal image and the operation mode correspond to one-to-one. For example, when gazing at the signal image disposed on the upper side of the game image, the object in the game image receives a forward control signal, when watching the signal image disposed on the right side of the game image, The object may receive a control signal moving to the right or the object of the game image may jump when the user watches the signal image disposed on the upper right side. Of course, in the game-based rehabilitation system 10 using the brain-computer interface (BCI), the control signal corresponding to the SSVEP having a specific frequency is not limited to only the control signal presented above. In addition, the control unit 420 of the game-based rehabilitation system 10 using the brain-computer interface (BCI) according to an embodiment of the present invention, the control signal generated by the control signal generation unit 410 as described above Accordingly, the game image may be controlled to proceed.

9 is a diagram illustrating the overall configuration of a game-based rehabilitation system 10 using a brain-computer interface (BCI) according to another embodiment of the present invention. As shown in FIG. 9, in the display device 100 of the present invention, the signal image display unit 110 may include 10 display regions, and the user may select 10 signal image display units 110 of the display apparatus 100. (Or at least ten signal regions of the signal image display unit 110) may selectively monitor the one or more signal image display units 110, and the brain waves generated by watching the signal image may cause the EEG acquisition apparatus 200 to Obtained through. In this case, the control signal generated by the control signal generator 410 is a signal corresponding to the SSVEP having a specific frequency corresponding to each of the 10 signal images, which is not only an essential operation mode required when the game is played, but a game. An additional control signal that may be utilized in the progress of the image may be further included, and the game of the game image display unit 120 is progressed through various operation modes consisting of selective attention of the user.

The display device 100 of the game-based rehabilitation system 10 using the brain-computer interface (BCI) according to an embodiment of the present invention may be at least one of a TV, a computer, a laptop, a smart TV, and a tablet PC. have. sure, In the game-based rehabilitation system 10 using the brain-computer interface (BCI), the display device 100 is not limited to the above devices.

FIG. 10 is a flowchart illustrating a control method of a rehabilitation system in a game-based rehabilitation system 10 using a brain-computer interface (BCI) according to an embodiment of the present invention. As shown in FIG. 10, in the control method of a game-based rehabilitation system 10 using a brain-computer interface (BCI) according to an embodiment of the present invention, the display device 100 may include a game image and a game image. Displaying a signal image that can be placed around the user to observe (S100), the brain wave acquisition device 200 to obtain the user's brain waves corresponding to the signal image displayed in step S100 (S200), EEG analysis The device 300 analyzes the brain waves of the user acquired in step S200 (S300), and the control device 400 controls the game image of the display device 100 according to the result corresponding to the brain waves analyzed in step S300. It may include the step (S400). Game-type rehabilitation system 10 using a brain-computer interface (BCI) according to an embodiment of the present invention, by controlling the steps including these steps, according to the movement for the activation of the mirror nerve cells displayed in the signal image, Activation of the user's mirror nerve cells can be used to assist the user in rehabilitation training.

According to an embodiment, step S300, the brain wave detector 310 detects the SSVEP from the user's brain wave signal corresponding to one signal image that the user gaze, and the brain wave analyzer 320 is the brain wave detector 310 The method may further include analyzing a frequency of the SSVEP having a specific frequency selected by the user, detected in step (a). In operation S400, the control signal generating unit 410 generates a game image control signal corresponding to a signal image corresponding to the SSVEP having a specific frequency, and the control unit 420 controls the control signal generating unit 410. The method may further include controlling the game image by using the generated game image control signal.

As described above, the game-based rehabilitation system and control method of the rehabilitation system using a brain-computer interface (BCI) according to an embodiment of the present invention, unlike the conventional system using the SSVEP using the blinking light In addition, by using moving images that can activate mirror nerve cells with a signal image containing a specific frequency of SSVEP, it is possible to increase the concentration of attention to the image by inducing the interest of the user, and at the same time, active rehabilitation training of the user. You can make this possible. In addition, by displaying the game image proceeds by using the user's brain waves according to the signal image in the vicinity of the signal image, the user can enjoy the game, thereby inducing the user's active participation. In addition, SSVEP which is introduced as a BCI technique and a signal image including a moving image as a rehabilitation system that can utilize the activation of the mirror nerve cells at the same time, it is possible to further enhance the effectiveness of rehabilitation training.

FIG. 11 is a diagram illustrating a configuration of a game-based rehabilitation system 10 in which a brain-computer interface (BCI) is directly applied to a game image according to an embodiment of the present invention. As shown in FIG. 11, a game-based rehabilitation system 10 in which a brain-computer interface (BCI) according to an embodiment of the present invention is directly applied to a game image is a rehabilitation system that displays a game image. 100, an EEG acquisition apparatus 200 for acquiring the EEG of the user corresponding to the game image displayed on the display device 100, an EEG analysis apparatus 300 for analyzing the EEG of the user acquired by the EEG acquisition apparatus 200 ) And a control device 400 for controlling a game image displayed on the display device 100 according to a result corresponding to the brain waves analyzed by the EEG analysis device 300. In particular, the control device 400 of the game-type rehabilitation system 10 to which the brain-computer interface (BCI) according to an embodiment of the present invention is directly applied to the game image, one or more body parts of the object displayed on the game image May be controlled to blink at a specific frequency, and when the user observes the corresponding body part, according to the result corresponding to the brain wave acquired and analyzed by the brain wave acquisition device 200 and the brain wave analysis device 300, the body The part can be controlled to move in a preset manner, and as a result, the rehabilitation training using the activation of the user's mirror nerve cells according to the movement of the body part of the object that the user selectively watches It is done.

In the game-type rehabilitation system 10 in which a brain-computer interface (BCI) is applied directly to a game image according to an embodiment of the present invention, when the user observes the display device 100 displaying a game image included in the user, Using the brain wave acquisition device 200 attached to the head of the SSVEP having the same frequency as the blinking frequency of the body part of the object, which is displayed on the game image, the brain wave analysis device 300 is EEG acquisition device 200 Analyze the corresponding frequency of the SSVEP obtained in the), and the control unit 420 moves the body part of the object according to the control signal generated by the control signal generator 410 of the control device 400 using the analyzed frequency By controlling the display device 100 to display the device, the user activates the mirror nerve cells by using the movement of a specific body part of the object and at the same time through the game that proceeds in response to the user. Thus, the user can be rehabilitation training in an active posture.

According to an embodiment, the display device 100 of the game-based rehabilitation system 10 that applies a brain-computer interface (BCI) directly to a game image according to an embodiment of the present invention is a content related to a game. It may display the guide content including the content, such as how to participate, and may include a voice output device 110 that can output the content corresponding to the guide content, and other various content as a voice. Hereinafter, the guide content and the audio output device 110 will be described.

12 is a diagram illustrating a user performing rehabilitation training in a game-type rehabilitation system 10 in which a brain-computer interface (BCI) is directly applied to a game image according to an embodiment of the present invention. As shown in FIG. 12, the display device 100 of the game-type rehabilitation system 10 in which a brain-computer interface (BCI) according to an embodiment of the present invention is directly applied to a game image is processed. The guide content for the display may be further included. The guide content may be composed of content corresponding to a predetermined movement mode, which will be described below with reference to FIG. 15. In order for the body part of the object to operate the movement suggested by the guide content, when the user looks at the specific body part of the object, the body part of the object moves in a predetermined movement mode corresponding to the guide content. For example, as shown in FIG. 12, the display device 100 displays the guide content 'If you want to swing the knife, look at the blinking left arm', the user needs to move the necessary movement to swing the knife. You will know what it is, and the user will watch the left arm of the blinking object to move the left arm of the object. In this case, the predetermined movement corresponding to the guide content may be 'movement of the left arm and the movement of the sword.' Of course, in the game type rehabilitation system 10 in which the brain-computer interface (BCI) is directly applied to the game image, the guide content corresponding to the predetermined movement mode is not limited to the guide content presented above. In FIG. 12, the game-type rehabilitation system 10 in which a brain-computer interface (BCI) according to an embodiment of the present invention is directly applied to a game image has been described by applying to a fencing operation, but is not limited thereto. For example, it may be described by applying each part of the face to a moving motion. That is, a face image is provided as an object in the game image, and when the user watches the blinking eye in the face image, a game image of a form in which a winking operation by moving the eyes is performed may be provided.

The display device 100 of the game type rehabilitation system 10 in which a brain-computer interface (BCI) is directly applied to a game image according to an embodiment of the present invention is a voice output device for outputting voice content corresponding to guide content. 110 may be included. According to an exemplary embodiment, the display device 100 may include a speaker as the voice output device 110 capable of outputting voice content, or may include a device capable of connecting a headset. Of course, in the game-type rehabilitation system 10 applying the brain-computer interface (BCI) directly to the game image, the voice output device 110 is not limited to the device that can connect the speaker, the headset presented above, According to another exemplary embodiment, the voice output device 110 may be configured separately from the display device 100. In addition, the voice content may be composed of not only the voice content corresponding to the guide content, but also various contents required for game progress.

The brain wave acquiring device 200 of the game-based rehabilitation system 10 in which a brain-computer interface (BCI) according to an embodiment of the present invention is directly applied to a game image, as shown in FIG. It may include an electrode. According to an embodiment, one or more electrodes may be configured as a device surrounding the user's head, or by coupling the electrodes to the hat, the hat itself may be the EEG acquisition device 200. In addition, the electrode can also be used by applying an electrolyte gel, since the electrolyte gel plays a role in delivering the EEG detected from the scalp to the electrode well.

FIG. 13 illustrates a game image in which a body part of an object to be watched by a user moves in a game type rehabilitation system 10 in which a brain-computer interface (BCI) is directly applied to a game image according to an embodiment of the present invention. 14 is a block diagram of a game type rehabilitation system 10 in which a brain-computer interface (BCI) is directly applied to a game image according to an embodiment of the present invention. As shown in FIGS. 13 and 14, in the game-type rehabilitation system 10 in which a brain-computer interface (BCI) according to an embodiment of the present invention is directly applied to a game image, the brain wave acquiring apparatus 200 may be used. The obtained EEG may be connected to an EEG analyzing apparatus 300 including an EEG detecting unit 310 and an EEG analyzing unit 320. In addition, the EEG analysis device 300 is connected to the control device 400 including the control signal generation unit 410 and the control unit 420, and controls the brain waves analyzed by the EEG analysis device 300 as a control device ( 400, the control device 400 may control the display device 100 displaying the movement of an object by using the control signal generated by the control signal generator 410.

As shown in FIGS. 13 and 14, the EEG analyzing apparatus 300 of the game type rehabilitation system 10 in which a brain-computer interface (BCI) according to an embodiment of the present invention is directly applied to a game image is a user. May selectively include an EEG detector 310 for detecting EEG when the user observes a specific body part of the object, and an EEG analyzer 320 for analyzing the frequency of the EEG detected by the EEG detector 310. .

The brain wave detection unit 310 of the game-based rehabilitation system 10 to which a brain-computer interface (BCI) according to an embodiment of the present invention is directly applied to a game image is provided to a specific body part of an object that the user selectively observes. In the EEG signal of the corresponding user, the SSVEP may be detected. When the user observes a body part blinking at a specific frequency with respect to an object displayed on the game image of the display device 100, an EEG having the same frequency as that of the body part is physically in the visual cortex of the user's occipital lobe. Induced, the EEG detection unit 310 is able to detect the SSVEP having the same frequency as the specific frequency of the blinking body part in the EEG of the user.

The brain wave analysis unit 320 of the game-type rehabilitation system 10 to which a brain-computer interface (BCI) according to an embodiment of the present invention is directly applied to a game image is detected by the user by the brain wave detection unit 310. The frequency of the SSVEP with the particular frequency selected can be analyzed. The frequency of the SSVEP is analyzed to determine whether the SSVEP having the same frequency as the frequency of the body part of the blinking object displayed on the display device 100 is detected in the EEG of the user. When the SSVEP having the corresponding frequency is detected in the EEG of the user, the control device 400 generates a control signal for moving the corresponding body part of the object in a preset manner.

In the game-type rehabilitation system 10 in which a brain-computer interface (BCI) is applied directly to a game image according to an embodiment of the present invention, the game image in which a body part moves in a predetermined manner is helpful for rehabilitation of a user. May include movement. According to an embodiment, the movement of the body part may be a component that moves a part of the body, including a hand, a foot, a head, an arm, a leg, and the like, in addition to a bend motion, a twisting motion, and a forward rolling motion. And the like. This operation is for activating the user's mirror nerve cell by moving the corresponding body part of the object by watching the blinking body part of the object displayed on the display device 100. Of course, in the game-type rehabilitation system 10 in which the brain-computer interface (BCI) is directly applied to the game image, the movement of the image moving in a preset manner is not limited to the above-described movement. For example, in FIG. 6, it can be seen that the leg portion of the object moves in a preset manner, and the user can watch the flickering of the leg portion of the object so that the leg of the object moves. By observing the movement of the site can be obtained the effect of rehabilitation of the leg through the activation of the mirror nerve cells.

In a game-based rehabilitation system 10 in which a brain-computer interface (BCI) is directly applied to a game image according to an embodiment of the present invention, a specific frequency at which one or more body parts of the object blinks is independent of the body parts. It may be the same frequency or different frequencies for each body part. In the case of a body part capable of moving in an object, for example, when the frequency of flickering of the hands, feet, neck, arms, legs, waist, etc. is the same, the hardware of the present invention is constructed as compared to the case where the body parts have different frequencies. There is an advantage in that it is convenient. On the other hand, it is preferable that each body part blinks at a different frequency. Since different frequencies are set for each different body part, the body part that the user watches is determined by judging only the SSVEP of a specific frequency detected by the user's brain waves. This is because it can be easily determined to which part. According to an embodiment, the body parts such as the arms and legs of the object may all blink at 30 Hz, the arm of the object may blink at different frequencies for each body part as 35 Hz and the legs are 40 Hz, or A may be related to the right arm of the object. The motion is 30Hz and the B motion related to the right arm of the object is 35Hz. Even the same body part may blink at different frequencies depending on the motion or situation involved. In the case of the same body part, there may be a case where the first scene displayed on the display device 100 and the second scene have different frequencies.

According to an exemplary embodiment, the specific frequency at which the body part blinks may use a frequency range of 7 Hz to 20 Hz. However, in the case of the frequency range of 7 Hz to 20 Hz, the user may recognize that the user blinks. Since fatigue is easily felt, the user may reduce eye fatigue by using a frequency of 30 Hz or more, which is not recognized by the user.

The control device 400 of the game type rehabilitation system 10 in which a brain-computer interface (BCI) according to an embodiment of the present invention is directly applied to a game image includes a control signal generator 410 and a controller 420. The control signal generator 410 and the controller 420 will be described in detail below with reference to FIG. 15.

FIG. 15 is a diagram illustrating a part of a game image in a game type rehabilitation system 10 in which a brain-computer interface (BCI) is directly applied to a game image according to an embodiment of the present invention. As shown in FIG. 15, the control device 400 of the game type rehabilitation system 10 in which a brain-computer interface (BCI) according to an embodiment of the present invention is directly applied to a game image is an EEG analyzer 320. The control signal generator 410 for generating a control signal for moving the body part of the object corresponding to the SSVEP having a specific frequency analyzed in a predetermined manner, and the control signal generated by the control signal generator 410. The controller 420 may be configured to control the display device 100 displaying the movement of an object by using the same. That is, the control device 400 transmits the control signal generated by the control signal generator 410 to the controller 420 so that the control unit 420 receiving the control signal displays the movement of the object. ) To control.

According to an exemplary embodiment, a signal corresponding to an SSVEP having the same frequency generated by a user watching a body part of an object blinking at a specific frequency, and a control signal for controlling a game image is an object previously designated by a user. It may include the movement mode of. The movement mode is content related to the movement of an object necessary for the user to play a game image and may include a configuration in which a specific body part of the object moves. That is, the movement mode refers to a control signal for moving the corresponding body part observed by the user in a preset manner when the user watches the blinking body part of the object.

For example, as shown in Figure 15, the movement of the object required to move to the next stage of the game image on the game screen is walking on the right road, the guide content presented on the game screen, 'to move the right arm to go to the right road Raise and lower ', so the user must raise and lower the right arm of the object. In order to proceed with the game, when the user looks at the right arm of the object flashing at 40 Hz on the game screen, the user's brain wave detects and analyzes an SSVEP of 40 Hz, which is the same frequency as the right arm of the object, and controls the signal generator 410. ) Generates a control signal. In this case, the predetermined movement mode may be a movement in which the right arm of the object moves up and down, a movement in which the object walks on the right road, and the like. Of course, in the game-type rehabilitation system 10 in which the brain-computer interface (BCI) is directly applied to the game image, the control signal corresponding to the SSVEP having a specific frequency is not limited to the control signal presented above. In addition, the control unit 420 of the game-type rehabilitation system 10 to which a brain-computer interface (BCI) according to an embodiment of the present invention is directly applied to a game image is generated by the control signal generator 410 as described above. According to the control signal, the display device 100 displaying the movement of the object may be controlled to control the progress of the game.

FIG. 16 is a diagram illustrating a user performing rehabilitation training in a game-based rehabilitation system 10 in which a brain-computer interface (BCI) is directly applied to a game image according to another embodiment of the present invention. As shown in FIG. 16, at least one object displayed on the display device 100 of the game-based rehabilitation system 10 to which a brain-computer interface (BCI) is directly applied to a game image according to an embodiment of the present invention may be used. In addition, more than one user may play a game together and perform rehabilitation training.

The display device 100 of the game-type rehabilitation system 10 in which the brain-computer interface (BCI) according to an embodiment of the present invention is directly applied to a game image is selected from among a TV, a computer, a laptop, a smart TV, and a tablet PC. There may be at least one. Of course, in the game type rehabilitation system 10 in which the brain-computer interface (BCI) is directly applied to the game image, the display device 100 is not limited to the above devices.

FIG. 17 is a flowchart illustrating a control method of a game-type rehabilitation system 10 in which a brain-computer interface (BCI) is directly applied to a game image according to an embodiment of the present invention. As shown in FIG. 17, a control method of a game-based rehabilitation system 10 in which a brain-computer interface (BCI) is directly applied to a game image according to an embodiment of the present invention may be described in detail. In step S100 ', the brain wave acquiring apparatus 200 acquires the brain waves of the user corresponding to the game image displayed in step S100' (S200 '), and the brain wave analyzing apparatus 300 in step S200'. Analyzing the acquired brain waves of the user (S300 ′), and controlling the game image displayed on the display device 100 according to a result corresponding to the brain waves analyzed in step S300 ′ ( S400 ') may be included. That is, in step S100 ', the game image is displayed such that one or more body parts of the object displayed on the game image blink at a specific frequency, and in step S400', when the user watches the body part, steps S200 'and S300' are displayed. According to the result corresponding to the brain waves acquired and analyzed through the control, the body parts are controlled to move in a predetermined manner, and the activation of the mirror nerve cells of the user according to the movement of the body parts of the object to be selectively monitored by the user Can help with rehabilitation training.

According to the embodiment, step S300 ′, the EEG detection unit 310 detects the SSVEP from the EEG signal of the user corresponding to the specific body part of the object that the user selectively monitors, and EEG analysis unit 320 The method may further include analyzing a frequency of the SSVEP having a specific frequency selected by the user, detected by the EEG detector 310. In operation S400 ′, the control signal generating unit 410 generates a control signal for moving the body part of the object corresponding to the SSVEP having a specific frequency in a preset manner, and the control unit 420 generates the control signal. The method may further include controlling 100 to display the movement of the object by using the control signal generated by the unit 410.

As described above, the control method of the game system rehabilitation system and rehabilitation system applying the brain-computer interface (BCI) directly to the game image according to an embodiment of the present invention, the conventional SSVEP system using the flashing light Unlike the one used, the body part of the blinking object can be displayed at the specific frequency of SSVEP, and the user's attention can be activated through the game image in which the body part of the object moves. It is possible to increase the concentration of watching the image, and at the same time, it is possible to enable active rehabilitation training of the user. In addition, when the body part of the object displays an image flickering at a specific frequency and the user looks at the specific body part of the object, the corresponding body part moves in a preset manner, and how the game proceeds with the movement of the object. By using it, a user can enjoy a game and can induce active participation of a user. In addition, SSVEP, which is introduced as a BCI technique, and a game image including moving images, can be used as a rehabilitation system that can simultaneously utilize the activation of mirror nerve cells, which can further enhance the effectiveness of rehabilitation training.

The present invention described above may be variously modified or applied by those skilled in the art, and the scope of the technical idea according to the present invention should be defined by the following claims.

Claims

As a rehabilitation system,

A display device configured to display a game image and a signal image disposed around the game image and which the user can observe;

An EEG obtaining device for acquiring an EEG of a user corresponding to the signal image displayed on the display device;

An EEG analyzer for analyzing EEG of the user acquired by the EEG acquisition apparatus; And

And a control device for controlling a game image of the display device according to a result corresponding to the brain wave analyzed by the brain wave analysis device.

A rehabilitation system of a game-type rehabilitation system using a brain-computer interface (BCI), characterized in that the rehabilitation training using the activation of the mirror nerve cells of the user according to the movement for the activation of the mirror nerve cells displayed in the signal image.
The display device of claim 1, wherein the display device comprises:

A signal image display unit displaying a signal image for activating a mirror nerve cell of a user; And

Replay system using a brain-computer interface (BCI), characterized in that it comprises a game image display unit for displaying a game image controlled by the control device.
The display apparatus of claim 2, wherein the signal image display unit comprises:

A game-type rehabilitation system using a brain-computer interface (BCI), characterized in that the display device is composed of one or more display areas.
The method of claim 3, wherein the signal image display unit,

Replaying system using a brain-computer interface (BCI), characterized in that for each signal image displayed on the at least one display area to display at a different frequency flickering.
The method of claim 3, wherein the signal image display unit,

Replay system using a brain-computer interface (BCI), characterized in that for each signal image displayed in the at least one display area to display different movements for the activation of the mirror nerve cells.
According to claim 1, The EEG analysis device,

An EEG detecting unit for detecting EEG when the user looks at one of the signal images; And

Rehabilitation system of the game method using a brain-computer interface (BCI), characterized in that it comprises an EEG analysis unit for analyzing the frequency of the EEG detected by the EEG detection unit.
The method of claim 6, wherein the EEG detection unit,

Receiving the SSVEP from the brainwave signal of the user corresponding to the one signal image that the user gaze, Game-type rehabilitation system using a brain-computer interface (BCI).
The method of claim 7, wherein the EEG analysis unit,

Game-based rehabilitation system using a brain-computer interface (BCI), characterized in that for analyzing the frequency of the SSVEP detected by the EEG detector.
The method of claim 8, wherein the control device,

A control signal generator configured to generate a game image control signal corresponding to a signal image corresponding to the SSVEP having a specific frequency analyzed by the EEG analyzer; And

And a control unit for controlling the game image by using the game image control signal generated by the control signal generation unit. The game system rehabilitation system using a brain-computer interface (BCI).
The display device of claim 1, wherein the display device comprises:

A game-based rehabilitation system using a brain-computer interface (BCI), characterized in that it is included in at least one of a TV, a computer, a notebook, a smart TV, and a tablet PC.
As a control method of the rehabilitation system,

(1) displaying, by the display device, a game image and a signal image disposed around the game image and which the user can observe;

(2) acquiring an EEG of the user corresponding to the signal image displayed in step (1) by the EEG obtaining apparatus;

(3) the EEG analyzing apparatus, analyzing the EEG of the user obtained in the step (2); And

(4) controlling, by the control device, to control the game image of the display device according to the result corresponding to the brain wave analyzed in the step (3);

The rehabilitation system of the game-type rehabilitation system using a brain-computer interface (BCI), characterized in that the rehabilitation training using the activation of the mirror nerve cells of the user according to the movement for the activation of the mirror nerve cells represented by the signal image Control method.
The display device of claim 11, wherein the display device comprises:

A signal image display unit displaying a signal image for activating a mirror nerve cell of a user; And

And a game image display unit for displaying a game image controlled according to the control device. The control method of a game type rehabilitation system using a brain-computer interface (BCI).
The method of claim 12, wherein the signal image display unit,

And a display area on the display device, wherein the rehabilitation system of a game system using a brain-computer interface (BCI).
The method of claim 13, wherein the signal image display unit,

And flashing at a different frequency for each signal image displayed on the at least one display area, the control method of a game-type rehabilitation system using a brain-computer interface (BCI).
The method of claim 13, wherein the signal image display unit,

And displaying different movements for mirror nerve cell activation for each signal image displayed on the at least one display area. 2. The control method of a game rehabilitation system using a brain-computer interface (BCI).
According to claim 11, The EEG analysis device,

An EEG detecting unit for detecting EEG when the user looks at one of the signal images; And

And a brain wave analysis unit for analyzing the frequency of the brain waves detected by the brain wave detection unit, the control method of a game-type rehabilitation system using a brain-computer interface (BCI).
The method of claim 16, wherein the EEG detection unit,

A method of controlling a game-based rehabilitation system using a brain-computer interface (BCI), characterized in that SSVEP is detected from a user's brain wave signal corresponding to the one signal image that the user watches.
The method of claim 17, wherein the EEG analysis unit,

And controlling the frequency of the SSVEP detected by the EEG detector. The control method of a game type rehabilitation system using a brain-computer interface (BCI).
The method of claim 18, wherein the control device,

A control signal generator configured to generate a game image control signal corresponding to a signal image corresponding to the SSVEP having a specific frequency analyzed by the EEG analyzer; And

And a control unit for controlling the game image by using the game image control signal generated by the control signal generation unit. The control method of a game rehabilitation system using a brain-computer interface (BCI).
The display device of claim 11, wherein the display device comprises:

A control method of a game-type rehabilitation system using a brain-computer interface (BCI), characterized in that it is included in at least one of a TV, a computer, a laptop, a smart TV, and a tablet PC.
As a rehabilitation system,

A display device for displaying a game image;

An EEG acquisition device for acquiring an EEG of a user corresponding to a game image displayed on the display device;

An EEG analyzer for analyzing EEG of the user acquired by the EEG acquisition apparatus; And

And a control device for controlling a game image displayed on the display device according to a result corresponding to the brain wave analyzed by the brain wave analysis device.

The control device,

One or more body parts of the object displayed on the game image may be controlled to blink at a specific frequency, and when the user observes the corresponding body parts, the brain waves obtained by the brain wave acquisition device and the brain wave analysis device correspond to the analyzed brain waves. Depending on the result, the body part can be controlled to move in a preset manner.

A game method in which a brain-computer interface (BCI) is directly applied to a game image, characterized in that rehabilitation training is performed using activation of a mirror nerve cell of a user according to movement of a body part of an object that the user selectively watches. Rehabilitation system.
The display device of claim 21, wherein the display device is

A game-type rehabilitation system applying brain-computer interface (BCI) directly to the game image, characterized in that the display further comprises a guide content for the progress of the game image.
The display device of claim 22, wherein the display device is

And a voice output device for outputting voice content corresponding to the guide content. The game-type rehabilitation system directly applying a brain-computer interface (BCI) to a game image.
The method of claim 21,

The specific frequency at which one or more body parts of the object blinks is the same frequency regardless of the body parts, or different frequencies for each body part. Rehabilitation system.
The method of claim 21,

A game image in which a body part moves in a predetermined manner includes a motion to help the user's rehabilitation. The game-type rehabilitation system applying a brain-computer interface (BCI) directly to the game image.
The method of claim 21, wherein the EEG analysis device,

An EEG detecting unit for detecting EEG when the user selectively looks at a specific body part of the object; And

And an EEG analyzer for analyzing the frequency of EEG detected by the EEG detector.
The method of claim 26, wherein the EEG detection unit,

A game-type rehabilitation system using a brain-computer interface (BCI) directly applied to a game image, characterized in that SSVEP is detected from a user's brain wave signal corresponding to a specific body part of an object that the user selectively watches.
The method of claim 27, wherein the EEG analysis unit,

A game-type rehabilitation system applying brain-computer interface (BCI) directly to a game image, characterized in that the frequency of the SSVEP detected by the EEG detector.
The method of claim 28, wherein the control device,

A control signal generator configured to generate a control signal for moving a body part of an object corresponding to the SSVEP having a specific frequency analyzed by the EEG analyzer in a preset manner; And

And a control unit for controlling a display device for displaying the movement of the object by using the control signal generated by the control signal generation unit. Rehabilitation system.
The display device of claim 21, wherein the display device is

A game-type rehabilitation system applying brain-computer interface (BCI) directly to a game image, characterized in that it is included in at least one of a TV, a computer, a notebook, a smart TV, and a tablet PC.
As a control method of the rehabilitation system,

(1) displaying, by the display device, a game image;

(2) acquiring an EEG of the user corresponding to the game image displayed in the step (1) by the EEG obtaining apparatus;

(3) the EEG analyzing apparatus, analyzing the EEG of the user obtained in the step (2); And

(4) controlling, by the control device, to control the game image displayed on the display device according to the result corresponding to the brain wave analyzed in the step (3),

In step (1),

Displaying the game image such that one or more body parts of an object displayed on the game image blink at a specific frequency,

In step (4),

When the user observes the corresponding body part, the body part is controlled to move in a preset manner according to the result corresponding to the brain wave acquired through the steps (2) and (3).

A game method in which a brain-computer interface (BCI) is directly applied to a game image, characterized in that rehabilitation training is performed using activation of a mirror nerve cell of a user according to movement of a body part of an object that the user selectively watches. Control method of rehabilitation system.
The display device of claim 31, wherein the display device comprises:

The control method of the game-type rehabilitation system applying a brain-computer interface (BCI) directly to the game image, characterized in that the display further comprises a guide content for the progress of the game image.
33. The display device of claim 32, wherein the display device is

And a voice output device for outputting voice content corresponding to the guide content, wherein the brain-computer interface (BCI) is directly applied to a game image.
The method of claim 31, wherein

The specific frequency of one or more body parts of an object is the same frequency irrespective of the body parts, or different frequencies for each body part. Game-type rehabilitation of the brain-computer interface (BCI) directly applied to the game image. Control method of the system.
The method of claim 31, wherein

The method of controlling a rehabilitation system of a game method in which a brain-computer interface (BCI) is directly applied to a game image, wherein the game image moves in a predetermined manner.
The method of claim 31, wherein the EEG analysis device,

An EEG detecting unit for detecting EEG when the user selectively looks at a specific body part of the object; And

And a brain wave analysis unit for analyzing the frequency of the brain waves detected by the brain wave detection unit. A control method of a rehabilitation system of a game system in which a brain-computer interface (BCI) is directly applied to a game image.
The method of claim 36, wherein the EEG detection unit,

Control of a game-type rehabilitation system applying brain-computer interface (BCI) directly to the game image, characterized by detecting the SSVEP from the brain wave signal of the user corresponding to a specific body part of the object that the user selectively monitors Way.
The method of claim 37, wherein the EEG analysis unit,

And controlling the frequency of the SSVEP detected by the EEG detector, wherein the brain-computer interface (BCI) is applied directly to a game image.
The method of claim 38, wherein the control device,

A control signal generator configured to generate a control signal for moving a body part of an object corresponding to the SSVEP having a specific frequency analyzed by the EEG analyzer in a preset manner; And

And a control unit for controlling a display device for displaying the movement of the object by using the control signal generated by the control signal generation unit. Control method of rehabilitation system.
The display device of claim 31, wherein the display device comprises:

A control method of a game-type rehabilitation system applying a brain-computer interface (BCI) directly to a game image, characterized in that it is included in at least one of a TV, a computer, a notebook, a smart TV, and a tablet PC.