Any wget guru's out there?

[jksmurf]

I'm trying to add a schedule to my list of channels using TVxB, which is based on wget.

URL is

http://www.starhub.com/dev/shows/print.html?no=36

and it works fine in IE, but just doesn't download.

I've been using and configuring TVxB for several years now and have gotten "reasonably" familiar with it but I am stumped at the first hurdle.

With wget I always get this message when I open the downloaded html file "C:\Utils\TVXB\TVXB04Test\cache\TVxb-deutschewelle.hk-20101004.html"

Technical Problem Encountered - Internal Server Error (HTTP 500)

Could not retrieve the HTML document because of server-configuration problems. Sorry for any inconvenience, you can try again later. Please use your browser back button to return to the StarHub site.

I did try adding a wgetrc file to the ini as per TVxB manual - no improvement.

Code:

cookies=on
load_cookies=cookies-input.txt
save_cookies=cookies-output.txt

Log file shows wget syntax TVxB uses

Code:

Status: processing deutschewelle.hk ("Deutsche Welle,365") 03/10/2010...
Status: processing deutschewelle.hk ("Deutsche Welle,365") 04/10/2010...
WGET>>: wget -E -t 5 [URL]http://www.starhub.com/dev/shows/print.html?no=36[/URL]
Status: processing C:\Utils\TVXB\TVXB04Test\cache\TVxb-deutschewelle.hk-20101004.html"

So.... how can I make sure it downloads?

k.

[martint123]

I'm no guru, but seem to recall a couple of oddities between the unix and Windows versions. Here is one that seems to move past your error, but encounters another one!
Replacing the ? with @

When “windows” is given, Wget escapes the characters ‘\’, ‘|’, ‘/’, ‘:’, ‘?’, ‘"’, ‘*’, ‘<’, ‘>’, and the control characters in the ranges 0–31 and 128–159. In addition to this, Wget in Windows mode uses ‘+’ instead of ‘:’ to separate host and port in local file names, and uses ‘@’ instead of ‘?’ to separate the query portion of the file name from the rest. Therefore, a URL that would be saved as ‘http://www.xemacs.org:4300/search.pl?input=blah’ in Unix mode would be saved as ‘http://www.xemacs.org+4300/search.pl@input=blah’ in Windows mode. This mode is the default on Windows.

Hmmm, having tried the above, I think I make be talking out of somewhere other than my mouth! Sorry!

[pBS]

can't you just specify the output filename yourself? would solve trying to save a file as it's url name..
-O 'file' only works for single file downloads..as all d/l's willl go into that file..
maybe try this --keep-session-cookies with --save-cookies 'file'

[jksmurf]

can't you just specify the output filename yourself? would solve trying to save a file as it's url name..
-O 'file' only works for single file downloads..as all d/l's willl go into that file..

TVxB actually outoputs to this format (from logs):

Code:

Status: processing C:\Utils\TVXB\TVXB04Test\cache\TVxb-deutschewelle.hk-20101004.html"

maybe try this --keep-session-cookies with --save-cookies 'file'

Will give it a whirl. I only tried the cookies thing (never needed or tried it before on all my other schedules) in desperation ... :o

k.

[mvallevand]

Try adding this to your command line --header="Accept-Language: en-us,en;q=0.5"

Martin

[pBS]

that did the trick... is that a standard header? what's the ";q-0.5" mean?

you can add the header = "Accept-Language: en-us,en;q=0.5" to your wgetrc file for permanent solution..

[mvallevand]

Yes "q" is a standard http://www.gethifi.com/blog/browser-rest...pt-headers, I just captured it from a tcpdump of firefox though after finding that adding a user-agent and referer didn't help.

Martin

[pBS]

ahhh, the 'q' rating isn't really needed..[only if you have more than one return data type in a list]
so this works equally well...
--header="Accept-Language: en-us,en"
the 'q' rating is just a priority for the types..if only one type in header, then not needed..

[jksmurf]

Thanks gents, will try to work out how to get TVxB to write wget --header="Accept-Language: en-us,en;q=0.5"
cmd line works fine!

k.

and the answer is add this to the top of your ini file!

Code:

wgetarguments=-E -t 5 --header="Accept-Language: en-us,en;q=0.5"

These are the original built in arguments.

Code:

wgetarguments=-E -t 5