4LeftFeet -- The DDR Bot Project
- Lead Hacker

Purpose
Why
How
The Future
Media
4LeftFeet Wiki

Purpose

4LeftFeet is a stand-alone "robot" that utilizes artificial intelligence to play Dance Dance Revolution (DDR).
4LeftFeet plays as one of two players in multiplayer DDR.



Why

Coming from a QA / hacker background, something that has always interested me is automation. I find it challenging and exciting to find ways to exploit technology and software to accomplish things they were not originally intended to do, particularly when it comes to saving time with repetitive tasks, or performing complex operations that would otherwise be impossible for a human behind a keyboard and mouse (or other human interface device).

When it comes to DDR, the bare essence of the game is performing a repetitive task on a human interface device. Of course, it involves other elements including coordination, rhythm, timing, practice, and sweat. When I considered the time, patience, and effort that it takes for an individual to become "good" at DDR, I conceived the challenge to build a device that could emulate the human element of the game, perform "well" at playing the game, and perhaps even perform in a manner that would be impossible for humans!



How

4LeftFeet is taking a live video signal from the Xbox via S-Video. This is fed to the laptop via Firewire video. This video is being processed in real-time using the EyesWeb development environment. The video is analyzed, and the upward-moving arrows are tracked. 4LeftFeet determines the correct timing to trigger a "button-press" and sends this information to a NetBurner programmable Ethernet device. The Netburner controls an array of N-channel enhancement logic-level MOSFET chips which are connected to the circuit board of an Xbox controller. The Xbox controller enters input into the Xbox just as any user-controlled gamepad would.

The end result is that 4LeftFeet is able to play DDR in real-time with 99.9% accuracy, and obtain scores much higher than a human player is able to.

For more information, please check out the
4LeftFeet Wiki Page.



The Future

4LeftFeet will incorporate a fully-mechanical pneumatic actuation system, playing on a conventional DDR step-pad, to create a greater physical presence. Currently, being completely electronic, it is difficult to envision the complex processes that are taking place and allowing 4LeftFeet to be successful at DDR. With a mechanical presence, I feel that I will be able to better-relate a sense of "man-versus-machine" and convey my obsession with reverse-engineering the human gaming experience.



Media


4LeftFeet, as it was installed at the UCSD Annex Art Gallery

4LeftFeet's Laptop screen, showing its simulated "performance"

An unsuspecting contestant attempting to compete against 4LeftFeet

Laptop Detail

The "circuit board" of 4LeftFeet

1000+ Combo!!!

A very silly score obtained on a very silly song.

Another shot of my sweet project board. Yes, that's genuine oak veneer.

The Netburner GPIO. Lots of wires, a DIP switch, and a wiring block.
And my main source of sustinance for the last 10 weeks.

Close-up of my awesome wiring job.

The DDR gamepad circuit board. This is what you get whether your gamepad cost $10 or $50. They're all the same! Trust me, I know.

N-channel enhancement logic level MOSFETs. Each has a resistor for extra goodness.