Kinect interactive music visuals: boom boom = shake the room

Real-time music visualiser using the depth data from the Kinect sensor. Be sure to stay tuned till at least 1:24 when the interactive particles kick in. This is an oscilloscope-like 3D effect with Kinect data and some interactive particle physics reacting to sound input.
The particles can be kicked around, but it's hard to catch them, partly because....
Boom boom = shake the room! Peaks in sound will cause an earthquake-like effect, shaking everything within the scene.
Sorry about the sound quality - it was straight from the computer speakers to camera's mic, hence tinny (but you can at least see it was real-time).
Song: 10,000 Lines by Electric President

[@RichardEnglandUK]

It uses OpenFrameworks, with the following addons:
ofxKinect (gets the Kinect point cloud data)
MSAPhysics - controls the particle physics, and enables physics interaction with the kinect data (though most of my kicks miss the particles, they are interactive and will bounce off the scenery/me)
I take the sound feed from the mic sound object, get the sound spectrum and apply it to the kinect data to produce the lines.

[@pixlo8]

ive seen so many amazing things using kinect but this is up there, now i just need a download

[@nectar909]

@melroy89 the sensor reads depth in 3d, the rotation is done once the points are loaded into the computer. It's purely a virtual/software camera pan :P

[@RichardEnglandUK]

Yes, I've done this at a few gigs and club events already. Projecting's easy. You'd need a video mixing desk if you want to mix into other visuals though.
This video was also recorded live by the way with the audio being picked up through the mic.

[@overseastom]

This is one of the best things I've ever seen, ever :D

[@MaJacksonx2]

This is sweet, I am trying to learn about this kind of technology but I come from a art background - no experience in code or anything BUT stuff like this makes me want to keep on trying! Inspiring, to say the least.

[@onebadbug]

Hi Richard, this is awesome. Is there any chance you would have the library somewhere to share? ... I'm just trying to learn how the process works & so far I'm getting generally nowhere and would love to see how something that's working actually works to reference against & help learn.

[@csselement]

dude this is awesome.

[@kelpo_boi]

awesome, congrats

[@RichardEnglandUK]

I was using OpenFrameworks, which is a bunch of open source libraries for creative coding. There are addons available to make it work with the KinectSDK. Try a Google search for ofxKinectNui for example

[@5VDC]

Good work mate !

[@FrankyEnergy]

hi! :) this video is really amazing! Please can you give me some help for setting the program for doing that? I have already downloaded the kinect SDK for microsoft windows 7 :)

[@grantprice9923]

this is awesome.

[@zdsrtgnzetmyet]

shitting brilliant mate

[@TheCartographer89]

You should project two more planes of light so that each plane, x, y, and z have a different corresponding color and depending on your orientation you'd see different colors.

[@comfil]

good idea!)

[@trianglesandmusic]

would there be a way to project that live? SO lets say your doing a dj gig (which i am) and i got xbox kinect and a projector and i want to project that information onto me live( also reacting to the music live)... I LOVE THAT IDEA!

[@RichardEnglandUK]

Hi, this uses OpenFrameworks libraries and would run on both Windows and OSX.

[@LittleGirls]

love it, please share to us lesser computer literate, im a studying artist, and i want to start doing stuff with kinect, great ideas only cant make them happen.

[@petemk1966]

wish my bedroom looked like that!!

[@FrankyEnergy]

Thanks mate :)

[@andmaliang]

kooooool idea

[@scottomel]

Very nice! Any chance of seeing the code for this? :)

[@ProPlumbing]

Reminds me a a salvia trip

[@vincentnaples7772]

any more info on how to do this myself? I have a kinect, and am just getting into OpenFrameworks and QC...

[@DavidWallaceHaskins]

Ever figure this out?

[@simon12332]

Imagine if we could put this in glasses and wear them to clubs!!!!!!!

[@sc7597]

genius

[@troy.the.editor]

How do I do this?

[@pksrapture1]

oyes sabes como conectar el nuevo kinect al mac

[@spam_sampler]

Y hace more of this?

[@PerceePeeonya]

you fooking geek lol love it

[@OfficialRob3]

I couldnt figure out how to work the sdk on my mac any help?

[@artistinstinct]

LIVE CONCERT PROJECTION CAN MAKE THIS BECOME A SIT-SPECIFIC REALITY!
>!

[@Brom24]

How is the camera rotating?

[@enunna]

Can you share the source for fellow kinect hackers to play with?

[@sargecasey28]

where can i download this?

[@btproof]

@PoutProductions1

[@LittleGirls]

man, just messaging you hear to inform you i messaged you with the inbox system, hope to here from you soon, thanks.

[@DotMapFile]

How about u play some good music