JOSEPHINE PU-SHENG WANG
  • Work
  • About
  • Contact

Techno > Mine Studio > Virtual Piano


Picture
Picture
    This is my computer science design project made in my junior and senior year, instructed by professor Timothy Shih and the graduate students in Mine Lab in department of Computer Science, National Central University, Taiwan.
Picture
Picture
Picture
    We used motion-censing device to develop instruments: Wii Remote combining with infrared LED to become a virtual piano, “Kinect” was used to make virtual guitar, virtual drum and “Virtual King” instrument. By using the devices and human body, we played them as a virtual band without any real instrument.
    I was in charge with virtual piano. My senior developed the initial virtual piano, and then I modified it, installed a shelf and added some decorations to make it more suitable to be performed.
  • How to make Virtual Piano:
Use infrared pen to emit infrared signal to Wii Remote; Wii Remote connects to the computer via Bluetooth; the program on the computer plays different sound based on different position where Wii Remote receiving the signal.
Virtual piano can be considered as a modification of electric whiteboard. We used “Wiimote Whiteboard” to run our modified program written by C#.
First, use infrared signal to define a range on the whiteboard screen by locating left top, right top, left bottom and right bottom points. It defines the corresponding coordinate between physical space and the computer software. [pic 1]

Picture
pic 1
Picture
pic 2
Picture
pic 3
We used two infrared pens to play virtual piano. [pic 2]
The signal emits to CMOS camera on Wii Remote [pic 3] and shows on the screen with two different colors. [pic 4]
The modified program determines the location of each signal, and then broadcasts the corresponding sound.
Picture
pic 4
  • Process on Virtual Piano​
    In order to perform on CSIE concert, I made a process on the piano’s appearance. I customized a transparent acrylic platform for piano and built a woody shelf for Wii Remote. Also, I added colorful LED lights on the platform; they can be controlled during the show.
Josephine Wang © 2021
  • Work
  • About
  • Contact