We wrote an article for the German technical magazine “Java Aktuell“.  The article is about gesture control, native interface devices and new developments in the field of 3D cameras. We are having a look back in history showing the evolution of gesture control starting from the year 1990 while analyzing advantages and disadvantages of the different 3D camera technologies. Furthermore we wrote about the state of the art with some C# and Java code examples and different fields of application as well. If you don’t have the current issue at hand you can read the publication here in PDF format. The whole article was published on the Intel Developer Zone too. Förtsch, M.; Endres, T. (2015). “Gestensteuerung und die nächste Welle der 3D-Kameras”. Java Aktuell 02-2015 (2015): 30-34. Print.
After integrating all the electronic parts like the Arduino Uno Rev. 3 into the LEGO robot we went back to the Deutsches Museum München to test the whole installation for a second time. During our first test with museum visitors we recognized some unwanted behaviours with our gesture controlled robot:
- People tried to control the robot using only one hand
- The other hand was holding a jacket since it was winter
- Maybe for them it was way more intuitive to use one hand only
- Solution: Implement one hand gesture control
- Connection problems with our XBee module
- We had several issues when using a TCP connection
- Solution: Send data about robot movements using UDP
- The robot drifted off to the right
- Electric motors can move at different speed when receiving the same voltage
- Solution: Send different voltages to the electric motors for getting the same motor speed (“trimming”)
We still have to work on a final design for the showcase. Here you can see a short video demonstrating the exhibiton project.
Watch our new video about our new gesture controlled game “Parrots On Target” which is submitted for the Intel Realsense App Challenge (ambassador track). Enjoy!
Thanks to LEGO, professional Rene Hoffmeister and his team from 1000 Steine finished the final robot design. Due to our new hardware design using Arduino microcontrollers and the MotoMama motor shield we just needed more space and a little redesign was necessary.
Our plan is to integrate all electronics within the next two weeks into the LEGO robot and make a new test in the “Deutsches Museum München”.
As soon as possible we want to start a blog series which will published on the INTEL Blog too. There we want to describe how to realize such an project and how everything works in detail.
We would like to thank LEGO for sponsoring the design for the robot. Additionally we want to thank INTEL for sponsoring the whole hardware costs of this project. Please see the final design of the LEGO robot in the following pictures.
Today we continued our work for the Intel Realsense challenge. Here is a screenshot of our game “Parrots On Target” which is completely gesture controlled. Everything (software, a.s.o.) was developed and made on our own. We are not quite sure what those flying “things” really are. Any ideas?
Yesterday, we held our talk about gesture control and the next wave of 3D cameras at the OOP in Munich. Since we had a time slot of about 90 minutes, we could show a lot more demos and showcases than we normally did. So we presented a live demo with a volunteer steering the AR.Drone using the LeapMotion controller. The all-new Intel RealSense visualizer was also demonstrated for the first time, and we controlled a hardware synthesizer using 3D cameras. It was a lot of fun, and in the end, the organizers told us that – according to the surveys – our talk was awesome.
Have a look at the first version of the robot prototype for our German Museum exhibition project. This Lego model was created by the professional Lego builder René Hoffmeister and his colleagues from 1000 Steine. This is not the final version, but it is an exciting draft for what is to come within the next few weeks.