MusiNogi is a Software+Hardware system designed to empower anyone who likes playing MIDI musical instruments to do it while dancing a variety of dance forms.
The Software component is a smartphone app which can be downloaded at the Apple AppStore for iPhone and iPad devices. The app is a MIDI controller & synthesizer, which features 60 different MIDI instruments. The app developed by Brainventions, Inc. is a member of an entire family of similar apps (MusiGigZ) designed for Making Music in Motion. Check out Sk8SoniX (a.k.a. MusiSk8s) for ice and roller skating, MusiShuZ for dancing and MusiRide for riding a bicycle and MusiVINGZ for walking and skating.
The Hardware component consists of a pair of leggings outfitted with 4 small pockets (on the thighs and the shins of each leg) and a pair of dance shoes with suede soles. Four sensor boards (a.k.a. MusiSenses) are inserted in the leggings pockets and two more sensor boards are attached to the bottom creases of the dance shoes. The MusiSenses contain 3D accelerometers, 3D gyroscopes and IR proximity sensors. The sensors are connected via Bluetooth to the MusiNogi app. Sensor data is streamed form each board to the app at 10Hz sampling rate. The app contains Machine Learning models trained to recognize time series of human activity - in this case the motion of the legs in space. These motions include flexions, extensions and rotations of the hips, knees and feet joins. The motions are categorized in 12 dance move categories and mapped to the 12 notes in a musical octave. The categories include dance steps that are common to a variety of dances including: hops, jumps, shuffle, crisscross, kick, lock, grapevine, Charleston and more. These steps are common to many dances such as Bulgarian and Irish folk dances, Shuffle, HipHop, LindyHop, Rock-N-Roll, Charleston, East and West Coast Swing, Argentine Tango, etc.
The MusiShoes are modified Gogodance Men's Boys Professional Lace-up Black Leather Latin Salsa Tango Ballroom Modern Dance Shoes from Amazon. Each shoe has a MusiSense attached to the crease of the suede shoes sole. Each MusiSense has a power button and a mini USB charging connector. Please be VERY CAUTIOUS not to step directly on the sensors since this will certainly damage them. Avoid going up and down stairs with the MusiShoes. Don't walk or dance on un-even and dirty surfaces.
The MusiSneakers are modified SANYES USB Charging Light Up Shoes Sports LED Shoes Dancing Sneakers from Amazon. The sneakers come in all sizes and 5 distinct color designs. Each sneaker has a MusiSense embedded into the shoe sole. A power button located at the top-most shoe lace whole turns the MusiSense ON and OFF. A transparent dime-size circular window located on the bottom of each sole allows the built-in proximity sensors to detect when the sneakers are ON and OFF the floor. The musical notes played by the MusiNogi app are mapped to meaningfull color patterns of the LED strips. Don't walk or dance on un-even and dirty surfaces wince this may rupture the transparent cover of the sensors and damage them.
Simplicity and functionality under your hips
Test App Functionality
Open the MusiNogi app on your smart phone. Put on the MusiPants and MusiShoes. Switch on the MusiSenses. A list of all 6 wearables should appear on the MusiNogi app screen. Pair the 6 wearables with the iPhone/iPad by tapping on the [connect] button for each of the 6 wearables. Make sure the Multiple Connect Switch on the Top is ON. When you have all 6 wearables connected the [START] button will be enabled. Tap the Start button and you will enter the app's main screen. There are may control buttons and info icons here. Tap the info button to get information on the functionality of the controls.
Play Music as You Dance
Now you are ready to play music with the MusiNogi system. Start walking, jogging, running or making dance steps and you should hear various notes being played. Initially this will be all at random since you have not learned yet the mapping between your dance steps and the musical notes. Don't worry! This is coming up next. Like with any musical instrument it will take time and a lot of practice to figure it out, and even more time and more practice to perfect you skills.
The MusiNogi app supports 18 of the most popular world languages including: EN, AR, BG, BN, CS, DE, EL, ES, FR, HE, HI, HU, IT, JA, KO, PT, RU and ZH. To change the app's language to one of your choice follow the instructions in the Help section of the app.