Here is a current list of possible projects, in no particular order.

Note these are only suggestions and you are welcome to develop your own ideas and projects, or figure this out once you join the event :).

For the most recent project ideas, check out the topics channel in MS Teams!

Brain Pong

What?

Play Pong with your brain waves! During NemoHack #2, it worked for one player. Let’s make it work for two players!

Materials

  • Braaaiins (at least 2)
  • EEG system
  • Computer with Matlab and Psychtoolbox

Markerless motion capture

With Google MediaPipe, you can use real-time motion capture without any markers, with your own webcam. (There is no data transfer to Google; the inference model runs on your computer.)

Below is an example of hand tracking from NemoHack #2. Imagine what you can build!

Materials

Virtual Reality Pong

What?

Grab Vicon 3D coordinates of two “rackets” live and play PONG against each other with them. First of all, it could be relatively easy in a 2D environment, it could be more complicated to incorporate these coordinates into a 3D VR environment, for which Unity knowledge should be available. But before that you could play with the ball physics: In addition to the angle of incidence = angle of incidence, you could also “turn” the ball if the racket is moved in a defined direction at the time of ball contact, etc.

Materials

  • Vicon
  • Computer with Nexus
  • Computer with Matlab + Psychtoolbox
  • 3D Engine (e.g. Unity)
  • Controller / gloves

Location

  • Motoriklabor

Gait analysis

What?

The idea would be …..

Material

  • Treadmill
  • Video camera
  • Computer

Location

  • Diagnostiklabor

Force plate Jump’n Run

What?

Program a simple jump’n’run in the form of a 2D side scroller. As usual, a stick figure runs (on the spot) and obstacles approach from a side. But this time, the jump is real: The player has to jump up at the right moment in reality on the force measuring plate. In a next step, you could think about and incorporate whether you can also calculate the jump height from the data…

Material

  • Force measuring plate (possibly mobile)
  • 2D Engine (e.g. MATLAB + Psychtoolbox)
  • Computer

Location

  • Anywhere

Sensorilympics

What?

An olympiad in which several players compete against each other in a series of movement-associated mini-games. This may include, among other things:

  • trying to best follow a certain force curve with force sensors or an angle curve with the goniometer on the knee
  • to press a specific force as quickly as possible, or to set an angle in a joint as precisely as possible, or
  • on the force measuring plate to jump 10 jumps with a constant inter-jump interval as possible
  • …there are no limits to the imagination here :)

Materials

  • Force sensors
  • Data acquisition
  • Computer (measurement case computer)
  • Goniometer
  • …

Location

  • Anywhere

Input in old video games

What?

The idea is to learn how to use input devices (e.g. old controllers, etc.) and how the (USB) interface between them and the computer works exactly.

Material

  • Retropie / Simulationstation
  • Any input devices

Location

  • Anywhere

Imagery + EEG

What?

The idea would be to test to what extent motor imagery is visible in the EEG. For this, everything would basically have to be considered first: Which movement? Where on the head do I record the signal? What do the data look like? What does the task look like at all?

Material

  • EEG
  • Computer

Location

  • Anywhere