http://jasperproject.github.io/ This is a powerful project that might be another good fit for the UDOO, but in keeping with a growing trend these days, they've only provided binaries for the Raspberry Pi. They do outline the steps for building from source- http://jasperproject.github.io/documentation/software/#manual-installation so it would be interesting to try this with UDOO Debian.
I've gotten Jasper up on UDOObuntu - didn't bother to change the USB microphone requirement (this is a first test), but it is recognizing speech and playing back audio appropriately. Just followed the instructions listed above, although there seem to be some issues with the crontab sticking - the boot cron job didn't work.