NextPVR Forums
  • ______
  • Home
  • New Posts
  • Wiki
  • Members
  • Help
  • Search
  • Register
  • Login
  • Home
  • Wiki
  • Members
  • Help
  • Search
NextPVR Forums Public Developers v
« Previous 1 … 4 5 6 7 8 … 93 Next »
Kinect Voice (Gesture) Control

 
  • 0 Vote(s) - 0 Average
Kinect Voice (Gesture) Control
topcat
Offline

Member

United Kingdom
Posts: 85
Threads: 15
Joined: Feb 2007
#1
2014-08-04, 10:18 PM
I have been using Next(GB)Pvr for years, with my trusty Hauppauge remote.
PS and loving it Smile

however what I would like to be able to do is shout at the tv.

I have been messing with the Kinect libraries for a while am i'm quite impressed
I also played with voice control back in the day, and I like the idea of being able to use voice commands to control the system.

Yes I realise saying Pause may only be a second quicker than pressing the button on the remote,
but being able to say the program name of a recent recording would be a lot quicker than scrolling down


I guess what I'm asking is;
Is it possible to control core actions within the main NextPvr gui app with a plugin or does this need to be with the core source?


PS quite happy to share the code once I get it working
sub
Offline

Administrator

NextPVR HQ, New Zealand
Posts: 106,671
Threads: 767
Joined: Nov 2003
#2
2014-08-04, 10:57 PM
You could certainly build remote-like functionality, which passes keystrokes to the app, allowing you to handle stuff like 'pause' and 'play' etc. You couldn't currently tell it the name of an item in a list and have it auto select, but if you get the basics going for remote-like operation, then I'm happy to look at adding some more interfaces for you to do stuff like selecting items in a list etc.
Graham
Offline

Posting Freak

UK
Posts: 4,058
Threads: 102
Joined: Dec 2005
#3
2014-08-05, 11:09 AM (This post was last modified: 2014-08-05, 11:20 AM by Graham.)
As I understand it ... the Hauppauge remote hardware connects to the irremote.exe that interprets the remote key presses and generates simulated keystrokes that irremote.exe passes to NextPVR (or any other software - see irremote.ini in Windows folder). NextPVR is operating exactly as it would if it was receiving real keystrokes from a real keyboard. I have no clue about Kinect libraries and all that ... but, I would expect that any software that could receive input and pass keystrokes to NextPVR could do the same job as irremote.exe.

I suspect that many voice recognition programs could be configured to drive NextPVR ... a quick search found http://www.tazti.com/help.html There may be free alternatives.

Edit: I have tried the voice recognition that is built into Windows 7 and it allows me to type by saying "press a" and "press control n". I expect that this would work if NextPVR had the focus while speaking.

Learn this lot ... http://www.nextpvr.com/nwiki/pmwiki.php?...dReference and shouting at the television will actually make a difference.
sub
Offline

Administrator

NextPVR HQ, New Zealand
Posts: 106,671
Threads: 767
Joined: Nov 2003
#4
2014-08-05, 06:17 PM
Graham Wrote:the Hauppauge remote hardware connects to the irremote.exe that interprets the remote key presses and generates simulated keystrokes that irremote.exe passes to NextPVR (or any other software - see irremote.ini in Windows folder). NextPVR is operating exactly as it would if it was receiving real keystrokes from a real keyboard. I have no clue about Kinect libraries and all that ... but, I would expect that any software that could receive input and pass keystrokes to NextPVR could do the same job as irremote.exe.
That was my thinking too.
topcat
Offline

Member

United Kingdom
Posts: 85
Threads: 15
Joined: Feb 2007
#5
2014-08-05, 08:35 PM
yup

that's the first plan

I can easily replicate the current keypress method and send to the nextpvr app.

i'm assuming the http://www.nextpvr.com/nwiki/pmwiki.php?...dReference
is up to date.

however I'm not sure If will be able to pickup which section the nextpvr is in, (at the beginning this should not be an issue, if just sending keypresses).

yes I've played with the standard windows voice rec and it does work quite well.

but by using the Kinect libs I should be able to get it to better detect commands, and give it custom commands.

My goal is eventually is to be able to say something like 'Watch BBC One', or 'Play newest Top Gear recording' Smile
with the stand, play, pause, skip, etc voice commands
topcat
Offline

Member

United Kingdom
Posts: 85
Threads: 15
Joined: Feb 2007
#6
2014-09-20, 12:03 PM
Ok folks

the initial version I had working in about 24 hrs.
Its then take a little bit more time to get it ready for a public alpha release

so

http://dev.the-owls.org/voice-control-wip/

This is still a Work In Progress, but is usable and I have been using for a few weeks now.

You will need to install the Kinect SDK or Kinect Runtime, depending on the Sensor you have.
If you have a Windows Kinect use the Runtime, if you have an Xbox 360 then you MUST use the Kinect SDK.
This is designed to work with Kinect SDK/Runtime V1.8
You may also need to download and install your local language pack, by default it installs the US version only, I have installed the UK version, but there is also a AUS version.


As said it works not too bad, but I have noticed as I am increasing its vocab, it does get more confused, as currently all commands are active at the same time.
It currently can't read the screen that it is sending commands too.
But yes its a work in progress

Your version should auto-update as I continue to fix etc.

If anyone wants to help please let me know.
Any feedback, also please let me know

Enjoy for now.

T
« Next Oldest | Next Newest »

Users browsing this thread: 1 Guest(s)



Possibly Related Threads…
Thread Author Replies Views Last Post
  Remote control example code? drmargarit 4 3,753 2018-04-21, 11:24 PM
Last Post: drmargarit
  API help - remote control greg in kansas 0 2,643 2016-07-04, 03:54 PM
Last Post: greg in kansas
  ios app to control npvr ui idea jnbooker15 4 3,573 2015-09-21, 10:19 PM
Last Post: sub
  ios app to control npvr ui idea jnbooker15 0 2,457 2015-09-21, 06:39 PM
Last Post: jnbooker15
  Version control / repository software for VS Express bgowland 2 2,387 2014-05-02, 09:57 PM
Last Post: bgowland
  Web control framework mvallevand 9 4,496 2011-07-06, 12:30 AM
Last Post: mvallevand
  Skin question - how to centre a list UiList control on screen? McBainUK 2 1,827 2011-02-17, 08:46 AM
Last Post: McBainUK
  List control skin elements McBainUK 1 1,723 2010-09-01, 06:17 AM
Last Post: sub
  Control-S mvallevand 2 1,648 2009-08-31, 01:57 AM
Last Post: mvallevand
  What SCM (Source Control Management) system do you use? JavaWiz 3 2,027 2008-08-19, 07:28 PM
Last Post: Manderson

  • View a Printable Version
  • Subscribe to this thread
Forum Jump:

© Designed by D&D, modified by NextPVR - Powered by MyBB

Linear Mode
Threaded Mode