Techno > Mine Studio > Virtual Piano
|
|
|
This is my computer science design project made in my junior and senior year, instructed by professor Timothy Shih and the graduate students in Mine Lab in department of Computer Science, National Central University, Taiwan.
|
|
|
|
We used motion-censing device to develop instruments: Wii Remote combining with infrared LED to become a virtual piano, “Kinect” was used to make virtual guitar, virtual drum and “Virtual King” instrument. By using the devices and human body, we played them as a virtual band without any real instrument.
I was in charge with virtual piano. My senior developed the initial virtual piano, and then I modified it, installed a shelf and added some decorations to make it more suitable to be performed.
I was in charge with virtual piano. My senior developed the initial virtual piano, and then I modified it, installed a shelf and added some decorations to make it more suitable to be performed.
- How to make Virtual Piano:
Virtual piano can be considered as a modification of electric whiteboard. We used “Wiimote Whiteboard” to run our modified program written by C#.
|
First, use infrared signal to define a range on the whiteboard screen by locating left top, right top, left bottom and right bottom points. It defines the corresponding coordinate between physical space and the computer software. [pic 1]
|
pic 1
|
pic 2
|
pic 3
|
We used two infrared pens to play virtual piano. [pic 2]
The signal emits to CMOS camera on Wii Remote [pic 3] and shows on the screen with two different colors. [pic 4]
The modified program determines the location of each signal, and then broadcasts the corresponding sound.
The signal emits to CMOS camera on Wii Remote [pic 3] and shows on the screen with two different colors. [pic 4]
The modified program determines the location of each signal, and then broadcasts the corresponding sound.
pic 4
- Process on Virtual Piano