<solved> [NPVR 2.3.6] resource-exhaustion / memory leak

[ShiningDragon]

Hi sub,

it looks like as if NPVR had a new introduced memory leakage. Let me tell, what i did:

I started watching tv shows at around 01:20 h cet.
I opened the videofolder, moved through the subfolders until i finally found the show of my choice.
Here i selected the upper entry ".." and pressed play on the remote control.
The playback of the qeued shows begun.
The shows are mkv container with x264 videocodec and aac audiocodec.
The playback happens via LAV Filter (Splitter) and ffdshow (videodecoder)/AAC MONOGRAM (audiodecoder).
I could watch until 05:39h cet and then the error messages within the windows eventviewer started:

Event ID 2004

Code:

+ System

  - Provider

   [ Name]  Microsoft-Windows-Resource-Exhaustion-Detector
   [ Guid]  {9988748E-C2E8-4054-85F6-0C3E1CAD2470}

   EventID 2004

   Version 0

   Level 3

   Task 3

   Opcode 33

   Keywords 0x8000000020000000

  - TimeCreated

   [ SystemTime]  2012-01-19T04:39:06.864589000Z

   EventRecordID 30583

  - Correlation

   [ ActivityID]  {2C0EDD3B-DE9F-41FF-8B46-9F55DD4BB291}

  - Execution

   [ ProcessID]  1260
   [ ThreadID]  1372

   Channel System

   Computer MC01

  - Security

   [ UserID]  S-1-5-18


- UserData

  - MemoryExhaustionInfo

  - SystemInfo

   SystemCommitLimit 3661307904

   SystemCommitCharge 3393720320

   ProcessCommitCharge 1555513344

   PagedPoolUsage 128516096

   PhysicalMemorySize 3663106048

   PhysicalMemoryUsage 3182727168

   NonPagedPoolUsage 1346260992

   Processes 48


  - ProcessInfo

  - Process_1

   Name NextPVR.exe

   ID 3692

   CreationTime 2012-01-19T00:12:43.361384900Z

   CommitCharge 1011073024

   HandleCount 3437419

   Version 1.0.0.0

   TypeInfo 201


  - Process_2

   Name dwm.exe

   ID 1960

   CreationTime 2012-01-17T01:29:18.891216500Z

   CommitCharge 127492096

   HandleCount 118

   Version 6.1.7600.16385

   TypeInfo 210


  - Process_3

   Name MsMpEng.exe

   ID 1132

   CreationTime 2012-01-17T01:29:17.846014600Z

   CommitCharge 60502016

   HandleCount 463

   Version 3.0.8402.0

   TypeInfo 1091


  - Process_4

   Name iMON.exe

   ID 2448

   CreationTime 2012-01-17T01:29:20.373219100Z

   CommitCharge 37924864

   HandleCount 452

   Version 8.1.2.1202

   TypeInfo 152


  - Process_5

   Name

   ID 0

   CreationTime 1601-01-01T00:00:00.000000000Z

   CommitCharge 0

   HandleCount 0

   Version 0.0.0.0

   TypeInfo 0


  - Process_6

   Name

   ID 0

   CreationTime 1601-01-01T00:00:00.000000000Z

   CommitCharge 0

   HandleCount 0

   Version 0.0.0.0

   TypeInfo 0



  - PagedPoolInfo

  - Tag_1

   Name Obtb

   PoolUsed 40173776


  - Tag_2

   Name CM31

   PoolUsed 35758080


  - Tag_3

   Name CM25

   PoolUsed 15020032



  - NonPagedPoolInfo

  - Tag_1

   Name Thre

   PoolUsed 1136945944


  - Tag_2

   Name Even

   PoolUsed 122492336


  - Tag_3

   Name SpDN

   PoolUsed 31206712



  - ExhaustionEventInfo

   Time 2012-01-19T04:38:57.993070500Z

This repeated itself until 08:29h cet, where the pc finally froze and i had to restart it.

The memory consumption of NPVR was at this time 966 MiB. This is a new record.

Any idea what could be the root for this? The system itself is Windows 7 32-Bit HP and the machine has 4 GiB RAM.

[ShiningDragon]

*bump*

It happened again this night and day before. Is a bit annoying to close npvr.exe after watching 2 or 3 shows and restart it for watching more shows to prevent totally systemfreezes.

The system is Windows 7 HP x86 running without swapfile with 4 GiB of ram.

[johnsonx42]

you shouldn't be running with no swapfile. that disables windows' virtual memory system.

[ShiningDragon]

I know this. There's just no need for the swap on this system. It's a pure mediacenter and nothing more. Until npvr 2.2.6 that wasn't a problem.

4 GiB RAM system memory. NPVR as a 32-bit app can eat up max. 2 GiB ram, so there are 2 GiB left for system ressources, os, drivers and other stuff resident in memory.

And a disabled swap file doesn't produce resource-exhaustion messages. ^^ This happens only on apps with an memory leakage, so there must be inside npvr a new introduced leak between npvr 2.2.6 mit latest hotfixes and 2.3.6.

[imilne]

Have you tried running with all plugins disabled to see if it still does it? It might not necessarily be NPVR itself that has a leak.

Iain

[ShiningDragon]

Yep, on every new version of npvr i'll uninstall the old one, remove all depending folders and registry keys.
I try to minimize external interruption while testing the reliabilty of any new version.

Even your nice plugins lile AudioAdjust, AutoRefresh and ReClockOrNot will only added, if a npvr-release itself proves rockstability. A freezing system is the worst thing, that could happen so i do understand this potential "leakage" as critical bug.

Of course, i can run npvr on my workstations with 16 GiB ram and 24 GiB swapfiles. I am sure, that a freeze would take a long, long, very long time. But this is no solution for the problem. And it's not the first time, that a npvr release did this. But sub fixes those things under normal circumstances soon enough.

[sub]

I dont seem to able to reproduce this here. I cant see it leaking. Is the memory increasing slow but continually during playback, on in big jumps at the end of video, or something else?

[mvallevand]

Yep, on every new version of npvr i'll uninstall the old one, remove all depending folders and registry keys. I try to minimize external interruption while testing the reliabilty of any new version.

You are using TVListing and TVRecordings though, I'd consider disabling it by renaming the folder to _TVListings.

Martin

[ShiningDragon]

Is the memory increasing slow but continually during playback, on in big jumps at the end of video, or something else?

I'll keep an eye on it, after i have repaired the filesystem of the ntfs. The last freeze of npvr has damaged the filesystem (EventID 55, Ntfs) on the ssd.

You are using TVListing and TVRecordings though, I'd consider disabling it by renaming the folder to _TVListings.

You have a good eye, but i removed aliberts plugin after posting this thread already.

EDIT:
chkdsk /f was successful , switching to ressourcemonitoring while watching simpsons.

1st "the simpsons" show (x264/aac) at 06:15 pm current used physical memory
NextPVR.exe: 269.000 KiB
NRecord.exe: 19.372 KiB
NTray.exe: 24.036 KiB

2nd "the simpsons" show (x264/aac) at 06:36 pm current used physical memory
NextPVR.exe: 320.040 KiB
NRecord.exe: 19.488 KiB
NTray.exe: 24.064 KiB

3rd "the simpsons" show (x264/aac) at 06:57 pm current used physical memory
NextPVR.exe: 367.264 KiB
NRecord.exe: 19.500 KiB
NTray.exe: 24.084 KiB

... running ...

So there seems to be a "leakage" of 2,28 MiB per minute until now. If i compare and calculate this number, then i'll reach the consumption of my initial post of around 975,6 MiB + ~250 MiB initial consumption within ~427 minutes.
This is a big leakage, but i can't imagine that this consumption alone could initiate a freeze, especially if we can use up to 2 gigs for a process.

Do you have any idea what i could check additionally of npvr? Some secret switch, or debugging?

[sub]

You meantioned these were .mkv files. Does the same thing happen playing .ts files?