Over-the-air channels with Yahoo/API

[drlava]

To clarify, I mean the flags and attributes as defined in the XMLTV standard here: http://xmltv.org/wiki/xmltvfileformat.html


the <previously-shown /> node should be added if the repeat flag is set.

this is their example of a desc:
<desc lang="de"> Blah Blah Blah. </desc>

yours does include a desc node, it was the <![CDATA[ html markup that was strange to me.


One more thing, if a
<display-name>3</display-name> node could be added that contains the channel number, that would make it more compatible with other readers that do not assume that the channel number is the same as the channel ID.
also, an affiliate tag:
<display-name>CBS Affiliate</display-name>

As you can see, I'm interested in this program for use beyond gbpvr, namely a replaytv, and want to confirm that the output conforms to XMLTV standards as closely as possible. thanks.

[jdonth]

Got it!

My <desc>'s use of CDATA is to enable inclusion of HTML data in the XML stream. Currently, this is invoked if you enable repeats. I am going to add logic to not include the CDATA syntax unless HTML ("<",">") syntax is detected in the repeat line. I'm open to using other logic if you could specify what you wanted.

Have you looked at the ".data" file to see what information Yahoo! is sending to us? If so, and you "see" the changes you want me to make to the XML file, let me know and I'll be glad to work with you on this.

[drlava]

Ok, thanks. if you like, you can have a look at the output of this scraper:
http://planetreplay.com/phpBB2/viewtopic.php?t=14314
to see how it handles affiliates, repeat (although it doesn't have last air date, it adds the <previously-shown /> tag if it's a repeat), etc.

It's a lot slower than this program because of the numerous downloads that have to take place to get detailed data from MSN, and the way it processes them.

[jdonth]

I took a look at the thread and have a better idea of what you are trying to accomplish. Two questions:

1) The XML file I create does have channel Id to channel description mapping. What is missing? Here is an example from my XML file

Code:

<?xml version="1.0" encoding="ISO-8859-1"?>
<tv generator-info-name="tv_grab_us_yahooapi_over_the_air">
<channel id="4">
<display-name>KDFW</display-name>
</channel>
<channel id="5">
<display-name>KXAS</display-name>
</channel>
<channel id="8">
<display-name>WFAA</display-name>
</channel>

2) If I detect a repeat show (which I hope you note is not entirely accurate that it is a repeat), do you just want me to add the following tag?

<previously-shown />

Please advise.

[drlava]

1) In some systems, the channel ID is not the channel number (for example it can be 991837, so the XMLTV reader (for example, sageTV) does not assume that the channel ID (which is a unique ID referenced in the programme section) is the channel tuner number. One standard is to include a <display-name> tag that contains the channel number. The reader scans for a display-name tag that contains only numeric information, and then picks that as the channel tuner number.
so,:

Code:

<?xml version="1.0" encoding="ISO-8859-1"?>
<tv generator-info-name="tv_grab_us_yahooapi_over_the_air">
<channel id="4">
[b]<display-name>4</display-name>[/b]
<display-name>KDFW</display-name>
[b]<display-name>CBS Affiliate</display-name>[/b]
</channel>
<channel id="5">
[b]<display-name>5</display-name>[/b]
<display-name>KXAS</display-name>
</channel>
<channel id="8">
[b]<display-name>8</display-name>[/b]
<display-name>WFAA</display-name>
</channel>

2) yes, that's how it works I think. if the earlier airdate is known, then the attribute goes like this:
<previously-shown start="20070725210000" />
with the start being the earlier air date.

see
http://xmltv.cvs.sourceforge.net/xmltv/x...iew=markup
for more attibutes auch as
<stereo>stereo</stereo>

I'l take a look at the yahoo output to see if there's anything else that can be gleaned.

[pBS]

here's a sample of my regular zap2it output after going thru i-xmltv..
[with previous tag and example of typical channel mapping]

Code:

[b]  <channel id="I12700.labs.zap2it.com">[/b]
    <display-name>51 KNWS</display-name>
    <display-name>51 KNWS PC:77036</display-name>
[b]    <display-name>51</display-name>[/b]
    <display-name>51 KNWS fcc</display-name>
    <display-name>KNWS</display-name>
    <display-name>KNWS-TV</display-name>
    <display-name>Independent</display-name>
  </channel>
  <programme start="20070702000000 +0000" stop="20070702010000 +0000" [b]channel="I10505.labs.zap2it.com"[/b]>
    <title lang="en">7th Heaven</title>
    <sub-title lang="en">227- Broken Hearts and Promises</sub-title>
    <desc lang="en">(2006-11-05) After paramedics are called to the house, Annie realizes Eric has been hiding the truth and she determines to find out what it is; Lucy pays Sandy a surprise visit.</desc>
    <credits>
      <director>Michael Preece</director>
      <actor>Stephen Collins</actor>
      <actor>Catherine Hicks</actor>
      <actor>David Gallagher</actor>
    </credits>
    <date>20061105</date>
    <category lang="en">Drama</category>
    <category lang="en">Series</category>
    <episode-num system="dd_progid">EP189053.0232</episode-num>
    <episode-num system="onscreen">227</episode-num>
    <audio>
      <stereo>stereo</stereo>
    </audio>
[b]    <previously-shown />[/b]
    <subtitles type="teletext" />
    <rating system="VCHIP">
      <value>TV-G</value>
    </rating>
  </programme>

but the original zap2it xml doesn't have any 'previous' tags at all, just <originalAirDate>2004-11-25</originalAirDate>

[whurlston]

Both Y! and MCE have "Repeat" flags. They are probably derived from the Original Air Date.

[jdonth]

I am inferring the Repeat status based on the presence (or lack of) data in field #187 (zero-based) in the Y! record.

If someone knows the field number that declares a repeat (with a Y/N?) please let me know and I'll update the logic.

[jdonth]

I have posted a new version of the software that addresses the features we have been discussing today:

-------------------------------------------
0.7.7.26
1) Changed the Repeat logic to not include "<![CDATA[" syntax unless "<" or ">" characters are found in the formatted Original Air Date string. (Thanks drlava).

2) Added the channel number as an additional DisplayName in the XML file.

3) If the episode has a Repeat date, added an XML field:
<previously-shown start="yyymmdd000000" />
Note: the start attribute is padded with zeros since the Yahoo! data only returns date not date & time.

4) Added the Station Affiliate as an additional DisplayName in the XML file.

[whurlston]

GB-PVR will only read the first "display-name" tag and ignore the rest.