EPG Update

[gehing]

I have a PVR 500 MCE, my machine is a DELL Dimension Desktop, Pentium 4 3.2 GHz (HT) with 3 GB of memory.
For the PVR 500 I have setup to recording sources, both with ZAP2IT. Both accounts of ZAP2IT contain the same channel setup, about 200 channels.
With the GBPVR version before 95.14, the update took a few minutes.
Now, with 95.16, the update takes about 3 hours, the CPU is at about 75% for 3 hours.
The configuration for EPG is:
<!-- EPG settings -->
<EPGProcessingMode>NORMAL</EPGProcessingMode>
<UpdateEPGHour>22</UpdateEPGHour>
<WakeMachineForEPGUpdate>false</WakeMachineForEPGUpdate>
<BlebUserAgent>GBPVR</BlebUserAgent>
<Zap2itListingDays>15</Zap2itListingDays>
<DvbEpgHarvestDuration>120</DvbEpgHarvestDuration>
<SaveZap2itXML>false</SaveZap2itXML>
<UseNewZap2itParser>true</UseNewZap2itParser>
<CompleteEPGReload>false</CompleteEPGReload>
<TvGuideSpecialTaskExecutable>
</TvGuideSpecialTaskExecutable>
<TvGuideSpecialTaskArguments>
</TvGuideSpecialTaskArguments>

What can I do to make this faster?

Regards,
Gert

[sub]

With the GBPVR version before 95.14, the update took a few minutes.
Now, with 95.16, the update takes about 3 hours, the CPU is at about 75% for 3 hours.

Most people have indicated that zap2it updates much faster in this most recent release, so I'm surprised it is slower for you. If you email your zap2it login details to me at support@devnz.com, I'm happy to try it out for you.

What can I do to make this faster?

First off, I wouldnt be retrieving 15 days. Set it to something like 4.

How many channels have you got listed in your zap2it lineup at http://labs.zap2it.com?

[sub]

Also, setting it to do the 'complete reload' will probably be quicker.

[sub]

What CPU is in your PC?

[gehing]

The processor is an Intel P4, 3.2 GHz with HT Ttechnology. The system information tools tells me: GenuineIntel Family 15 Model 3.3.2 .
I will send you my account info for ZAP2IT via email.
The download from ZAP2IT doesn't take long, maybe 2-3 minutes, but the processing of the entries for GBPVR takes this long.

[gehing]

BTW, because I had some truble with performance and recordings (some recording were incomplete or started too late) after installing 95.16 over my existing installation, I did a clean install last weekend.

[sub]

I just tried one of your accounts here. It took about 15 minutes from beginning to end. It was a huge volume of data given you have a large number of days configured, and a large number of channels. This equates to about 28MB worth of data being downloaded and processed.

It took about 5 minutes to download the data from zap2it. It could be faster for you if you have a faster network link.

It took about 5 *seconds* to process the data (ie, extracting all the channel and show information).

It took about 10 minutes to save the data into the database. There isnt really any further optomisations I can do at this step, since this really just executing thousands of pre-prepared MS Access "insert" statements. This step could be taking longer since you're not using the 'complete EPG reload' option, which means it'll be having to compare against shows already in the database.

If want to send you me your config.exe.log, I'm happy to look at the break down of time on your machine.

[gehing]

I will change the trace level to debug (it's on info right now) and send you a log tomorrow.

[gehing]

I was playing around with this update Yesterday, and I think I know the problem now.
When downloading the EPG information from ZAP2IT, the memory usage of the GBPVRRecordingServices.exe is going up. When reaching 1.1 GB, I get the following exception:
12/14/2005 4:11:05 PM.835 VERBOSE [11] getValue cached value: /settings/Zap2itListingDays : 15
12/14/2005 4:11:05 PM.835 VERBOSE [11] getValue cached value: /settings/CompleteEPGReload : true
12/14/2005 4:11:05 PM.835 VERBOSE [11] Requesting listings for the period: 2005-12-14T00:00:00Z to 2005-12-29T00:00:00Z
12/14/2005 4:13:16 PM.490 VERBOSE [11] Error updating EPG Source (Comcast2): System.Net.WebException: An exception occurred during a WebClient request. ---> System.OutOfMemoryException: Exception of type System.OutOfMemoryException was thrown.
--- End of inner exception stack trace ---
at System.Net.WebClient.UploadData(String address, String method, Byte[] data)
at GBPVR.Backend.Common.Zap2itEpgReader.x7174d5399cba81ee(IEpgUpdateProgressCallback x421ce789b9741187)
at GBPVR.Backend.Common.Zap2itEpgReader.LoadChannels(IEpgUpdateProgressCallback x421ce789b9741187)
at xebfe44fcfa45fcc7.xa9e17cce0eee6a7a.x52e8ddd0b9bc8c68()
12/14/2005 4:13:16 PM.490 VERBOSE [11] Skipping EmptyEPG, since not all EPG updates were successful...
12/14/2005 4:13:16 PM.506 VERBOSE [11] EPGUpdate storeChannels()
12/14/2005 4:13:16 PM.506 VERBOSE [11] getValue() loading new key/value into cache: /settings/EPGProcessingMode
12/14/2005 4:13:16 PM.506 VERBOSE [11] getValue: /settings/EPGProcessingMode : NORMAL
12/14/2005 4:13:16 PM.506 VERBOSE [11] getValue cached value: /settings/EPGProcessingMode : NORMAL
12/14/2005 4:13:19 PM.771 ERROR [11] Failure in ChannelFactory::getShowsInTimePeriod(): Exception of type System.OutOfMemoryException was thrown.
12/14/2005 4:13:48 PM.349 ERROR [53] Caught unexpected exception: Exception of type System.OutOfMemoryException was thrown.
12/14/2005 4:13:48 PM.349 ERROR [53]
12/14/2005 4:14:02 PM.974 ERROR [53] Caught unexpected exception: Exception of type System.OutOfMemoryException was thrown.
12/14/2005 4:14:02 PM.974 ERROR [53]
12/14/2005 4:14:17 PM.599 ERROR [53] Caught unexpected exception: Exception of type System.OutOfMemoryException was thrown.
12/14/2005 4:14:17 PM.599 ERROR [53]
12/14/2005 4:15:13 PM.458 ERROR [53] Caught unexpected exception: Exception of type System.OutOfMemoryException was thrown.
12/14/2005 4:15:13 PM.458 ERROR [53]

After that, it still updates the EPG, but it is running for 3 hours.

I reduced the channels in my profile of ZAP2IT (removed channels that I'm not watching anyway) to 150 and I changed it to 8 days. Then I'm not getting this exception and the update is done in less than 20 minutes.
I also saw that the performance setting for memory usage were set to system cache instead of programs. After I changed this to programs, my machine was faster overall and the memory usage of GBPVRRecordingServices.exe was not going this high anymore on the EPG update.

Thank you for your help.