stack. is a working prototype for a device that can help people with visual disabilities to create simple 3D models using the tactility of Legoes. Utilizing OpenCV, Unity3D, and a Lego board, the user can prototype simple cube-based models that they create layer by layer. Here is a quick video:
We used OpenCV to do color detection on a grid-divided Lego board. If there was a Lego detected within one of the squares then a signal was sent to the Unity game engine via OSC that a Lego piece is now occupying that portion of the grid, and a 3D cube was then rendered in the relevant square on the field in Unity3D.
The lego board:
What the computer sees:
The simple 3D model:
We used simple controls, with a button to go up a layer, and another one to go down a layer, and then one that theoretically exports it as a 3D model so that it can be 3D printed.
Collaborators: Dylan J. Crow and Baaria Chaudhary