MovieWiz thumbnail memory problems revisited

[JavaWiz]

Ok, I'll take a look at this as soon as I get some free time...

[JavaWiz]

In this version, I believe I've fixed:

• the memory problems both in plugin and MovieWizManager
  
• caching related to the db entries
  

Let me know how it goes... I've changed some of the code in the WizDlls, so if you run any other plugins or utilities that use them, please try a quick sanity check on them as well...

I'll wait for some feed back before I post this version (and the updated WizDLLs) on the Wiki.

[Dan Soussi]

In this version, I believe I've fixed:

• the memory problems both in plugin and MovieWizManager
  
• caching related to the db entries
  

Let me know how it goes... I've changed some of the code in the WizDlls, so if you run any other plugins or utilities that use them, please try a quick sanity check on them as well...

I'll wait for some feed back before I post this version (and the updated WizDLLs) on the Wiki.

Hi JW,

I tried the new version 1.0.24.5. The plugin and Manager both consume memory as before.

Included are my log files for your digestion.

Regards,
Dan Soussi

[iwan]

Hi JW,

just installed 1.0.24.5 over what I believe was 1.0.24.0.

Thumbnails now appear almost instantaneously instead of after a time-lag of approx. 2 secs. Well done !
There only remains a lag of around 1 sec when switching categories.

Haven't checked memory consumption so far - with everything working fine now there's no particular reason for me to do so...

Again, thanks for the update, JW !

In this version, I believe I've fixed:

• the memory problems both in plugin and MovieWizManager
  
• caching related to the db entries
  

Let me know how it goes... I've changed some of the code in the WizDlls, so if you run any other plugins or utilities that use them, please try a quick sanity check on them as well...

I'll wait for some feed back before I post this version (and the updated WizDLLs) on the Wiki.

[JavaWiz]

Hi JW,

I tried the new version 1.0.24.5. The plugin and Manager both consume memory as before.

Included are my log files for your digestion.

Regards,
Dan Soussi

Ok, I think I see what is going on. I am basically caching the images as you are within a particular category, then disposing them as you switch categories. Since you have so many movies, it looks like you stay on a particular category and walk that list until you run out of memory.

I'll look at enhanching the caching logic, to only save X number of thumbnails while you are in a list, that should keep memory relatively stable once you've reached the cache limit. Or perhaps, I'll ONLY cache the images that are pulled dynamically off the web, any images stored in db or file system will always be retrieved real-time rather than cached.

[Dan Soussi]

Ok, I think I see what is going on. I am basically caching the images as you are within a particular category, then disposing them as you switch categories. Since you have so many movies, it looks like you stay on a particular category and walk that list until you run out of memory.

I'll look at enhanching the caching logic, to only save X number of thumbnails while you are in a list, that should keep memory relatively stable once you've reached the cache limit. Or perhaps, I'll ONLY cache the images that are pulled dynamically off the web, any images stored in db or file system will always be retrieved real-time rather than cached.

Hi JW,

Can I suggest that the thumbnail cache be user adjustable, based on a memory size, perhaps set in Manager?

Cheers,
Dan

[Dan Soussi]

Hi JW,

I also saw another thumbnail issue with 1.0.24.5 in Manager. I tried to update a thumbnail, but Manager would not show the new thumbnail. Reverting back to 1.0.24.0 revealed that the thumbnail did get updated, but Manager (in V1.0.24.0) was not immediately showing the revised thumbnail.

Cheers,
Dan

[JavaWiz]

Hi JW,

I also saw another thumbnail issue with 1.0.24.5 in Manager. I tried to update a thumbnail, but Manager would not show the new thumbnail. Reverting back to 1.0.24.0 revealed that the thumbnail did get updated, but Manager (in V1.0.24.0) was not immediately showing the revised thumbnail.

Cheers,
Dan

Give this one a try. I've fixed the problem described above, and implemented a cache for the thumbnails. Once you've run the program (at least once), if you're still experiencing out of memory, edit the following entry in the MovieWiz section in config.xml

<ThumbnailCacheSize>50</ThumbnailCacheSize>

and set the value down to 20 or 30. Try again.

[Dan Soussi]

Give this one a try. I've fixed the problem described above, and implemented a cache for the thumbnails. Once you've run the program (at least once), if you're still experiencing out of memory, edit the following entry in the MovieWiz section in config.xml

<ThumbnailCacheSize>50</ThumbnailCacheSize>

and set the value down to 20 or 30. Try again.

Hi JW,

BTW, I appreciate the hard work you must be putting into this problem.

I've tried version 1.0.24.6. I noticed that in this version the number of thumbnails the manager and plugin view before failing has increased from around 500 to 700. Both the plugin and the manager will consume memory until they fail (around 1.7GB, which has not changed!).

I've tried tweaking the ThumbnailCacheSize variable down to 10, but doesn't seem to make any difference. What units does this variable represent?

On a brighter side, updating thumbnails in the Manager appears to be working again.

Cheers,
Dan

[JavaWiz]

I've tried tweaking the ThumbnailCacheSize variable down to 10, but doesn't seem to make any difference. What units does this variable represent?

This value represents the number of thumbnail images the program holds in memory (so it does not have to retrieve from source db, file or web).

I've changed the logic so that it only caches images retrieved from web (since that is the slowest). I've added alot of logging to this version as well as tweaked the WizWebHelper and WizUiHelper DLLs.

Give it a try, if you still see a problem, set the caching variable down to 2, rerun and post your logs.