You can enable it in the system -> settings screen.
It defaults to only few simple clicks, but you can associate a different sounds with each key if you want. See the C:\Program Files\devnz\gbpvr\media\sounds\keymappings.xml file. The default file only defines sounds for up/down/left/right/enter, but you can add additional lines for each and every keystroke.