Kinect Voice (Gesture) Control

[topcat]

I have been using Next(GB)Pvr for years, with my trusty Hauppauge remote.
PS and loving it

however what I would like to be able to do is shout at the tv.

I have been messing with the Kinect libraries for a while am i'm quite impressed
I also played with voice control back in the day, and I like the idea of being able to use voice commands to control the system.

Yes I realise saying Pause may only be a second quicker than pressing the button on the remote,
but being able to say the program name of a recent recording would be a lot quicker than scrolling down


I guess what I'm asking is;
Is it possible to control core actions within the main NextPvr gui app with a plugin or does this need to be with the core source?


PS quite happy to share the code once I get it working

[sub]

You could certainly build remote-like functionality, which passes keystrokes to the app, allowing you to handle stuff like 'pause' and 'play' etc. You couldn't currently tell it the name of an item in a list and have it auto select, but if you get the basics going for remote-like operation, then I'm happy to look at adding some more interfaces for you to do stuff like selecting items in a list etc.

[Graham]

As I understand it ... the Hauppauge remote hardware connects to the irremote.exe that interprets the remote key presses and generates simulated keystrokes that irremote.exe passes to NextPVR (or any other software - see irremote.ini in Windows folder). NextPVR is operating exactly as it would if it was receiving real keystrokes from a real keyboard. I have no clue about Kinect libraries and all that ... but, I would expect that any software that could receive input and pass keystrokes to NextPVR could do the same job as irremote.exe.

I suspect that many voice recognition programs could be configured to drive NextPVR ... a quick search found http://www.tazti.com/help.html There may be free alternatives.

Edit: I have tried the voice recognition that is built into Windows 7 and it allows me to type by saying "press a" and "press control n". I expect that this would work if NextPVR had the focus while speaking.

Learn this lot ... http://www.nextpvr.com/nwiki/pmwiki.php?...dReference and shouting at the television will actually make a difference.

[sub]

the Hauppauge remote hardware connects to the irremote.exe that interprets the remote key presses and generates simulated keystrokes that irremote.exe passes to NextPVR (or any other software - see irremote.ini in Windows folder). NextPVR is operating exactly as it would if it was receiving real keystrokes from a real keyboard. I have no clue about Kinect libraries and all that ... but, I would expect that any software that could receive input and pass keystrokes to NextPVR could do the same job as irremote.exe.

That was my thinking too.

[topcat]

yup

that's the first plan

I can easily replicate the current keypress method and send to the nextpvr app.

i'm assuming the http://www.nextpvr.com/nwiki/pmwiki.php?...dReference
is up to date.

however I'm not sure If will be able to pickup which section the nextpvr is in, (at the beginning this should not be an issue, if just sending keypresses).

yes I've played with the standard windows voice rec and it does work quite well.

but by using the Kinect libs I should be able to get it to better detect commands, and give it custom commands.

My goal is eventually is to be able to say something like 'Watch BBC One', or 'Play newest Top Gear recording'
with the stand, play, pause, skip, etc voice commands

[topcat]

Ok folks

the initial version I had working in about 24 hrs.
Its then take a little bit more time to get it ready for a public alpha release

so

http://dev.the-owls.org/voice-control-wip/

This is still a Work In Progress, but is usable and I have been using for a few weeks now.

You will need to install the Kinect SDK or Kinect Runtime, depending on the Sensor you have.
If you have a Windows Kinect use the Runtime, if you have an Xbox 360 then you MUST use the Kinect SDK.
This is designed to work with Kinect SDK/Runtime V1.8
You may also need to download and install your local language pack, by default it installs the US version only, I have installed the UK version, but there is also a AUS version.


As said it works not too bad, but I have noticed as I am increasing its vocab, it does get more confused, as currently all commands are active at the same time.
It currently can't read the screen that it is sending commands too.
But yes its a work in progress

Your version should auto-update as I continue to fix etc.

If anyone wants to help please let me know.
Any feedback, also please let me know

Enjoy for now.

T