DVB subtitles missing

Sebu7 · (This post was last modified: 2021-03-16, 11:10 PM by Sebu7.)

Hello,

I have a problem of missing DVB(-C) subtitles when using Linux version (Version: 5.1.0.201216) of NextPVR. Windows version (Version: 5.1.0.201216) seems to work fine in this case. I noticed this when I was using Kodi as client, so I started to investigate. Please note that I have also channels with DVB subtitles which work fine in Linux and this problem does not exist.

I have two recordings / .ts files produced by NextPVR of same channel and program

1) When these files are played in VLC player, in both cases "Subtitle" menu is active and shows "DVB" selection and "Finnish" track. But only when playing Windows recording, subtitles are actually displayed by player.

2) When using "TSDoctor", subtitle track is only shown for Windows recording

Linux https://www.dropbox.com/s/n8fv8t7olxsv52...r.png?dl=0

Windows https://www.dropbox.com/s/qtq63ju4owia4r...r.png?dl=0

3) dvbsnoop shows PID 103 data only for Windows recording

Linux
dvbsnoop -s ts -if nextpvr_debian_madmax.ts | grep "PID: 103"
<nothing found>

Windows
dvbsnoop -s ts -if nextpvr_win10_madmax.ts | grep "PID: 103"
PID: 103 (0x0067) [= ]
<above repeated multiple times>

3) ffmpeg -i does not show any obvious difference:

Linux

Code:
Input #0, mpegts, from 'nextpvr_debian_madmax.ts':

  Duration: 00:00:52.19, start: 1368.786456, bitrate: 7806 kb/s

  Program 11801

    Stream #0:0[0x65]: Video: h264 (High) ([27][0][0][0] / 0x001B), yuv420p(tv, top first), 1920x1080 [SAR 1:1 DAR 16:9], 25 fps, 25 tbr, 90k tbn, 50 tbc

    Stream #0:1[0x66](fin): Audio: mp2 ([3][0][0][0] / 0x0003), 48000 Hz, stereo, fltp, 256 kb/s

    Stream #0:2[0x67](fin): Subtitle: dvb_subtitle ([6][0][0][0] / 0x0006)

    Stream #0:3[0x68](fin): Subtitle: dvb_teletext ([6][0][0][0] / 0x0006)

Windows

Code:
Input #0, mpegts, from 'nextpvr_win10_madmax.ts':

  Duration: 00:00:28.21, start: 110.970456, bitrate: 8155 kb/s

  Program 11801

    Stream #0:0[0x65]: Video: h264 (High) ([27][0][0][0] / 0x001B), yuv420p(tv, top first), 1920x1080 [SAR 1:1 DAR 16:9], 25 fps, 25 tbr, 90k tbn, 50 tbc

    Stream #0:1[0x66](fin): Audio: mp2 ([3][0][0][0] / 0x0003), 48000 Hz, stereo, fltp, 256 kb/s

    Stream #0:2[0x67](fin): Subtitle: dvb_subtitle ([6][0][0][0] / 0x0006)

    Stream #0:3[0x68](fin): Subtitle: dvb_teletext ([6][0][0][0] / 0x0006)

My tuner details:

Code:
[109293.622058] tveeprom: Hauppauge model 204209, rev C2I6, serial# 14302176

[109293.622060] tveeprom: tuner model is SiLabs Si2157 (idx 186, type 4)

[109293.622062] tveeprom: TV standards PAL(B/G) NTSC(M) PAL(I) SECAM(L/L') PAL(D/D1/K) ATSC/DVB Digital (eeprom 0xfc)

[109293.622063] tveeprom: audio processor is None (idx 0)

[109293.622064] tveeprom: has no radio, has IR receiver, has no IR transmitter

[109293.622066] em28xx 1-6:1.0: dvb set to bulk mode.

[109293.679773] em28xx 1-6:1.0: chip ID is em28174

[109294.902656] em28xx 1-6:1.0: EEPROM ID = 26 00 01 00, EEPROM hash = 0x80eace4c

[109294.902660] em28xx 1-6:1.0: EEPROM info:

[109294.902663] em28xx 1-6:1.0:         microcode start address = 0x0004, boot configuration = 0x01

[109294.909323] em28xx 1-6:1.0:         AC97 audio (5 sample rates)

[109294.909327] em28xx 1-6:1.0:         500mA max power

[109294.909331] em28xx 1-6:1.0:         Table at offset 0x27, strings=0x0e6a, 0x1888, 0x087e

[109294.967657] em28xx 1-6:1.0: Identified as Hauppauge WinTV-dualHD DVB (card=99)

[109294.972250] tveeprom: Hauppauge model 204209, rev C2I6, serial# 14302176

[109294.972253] tveeprom: tuner model is SiLabs Si2157 (idx 186, type 4)

[109294.972257] tveeprom: TV standards PAL(B/G) NTSC(M) PAL(I) SECAM(L/L') PAL(D/D1/K) ATSC/DVB Digital (eeprom 0xfc)

[109294.972258] tveeprom: audio processor is None (idx 0)

[109294.972260] tveeprom: has no radio, has IR receiver, has no IR transmitter

[109294.972266] em28xx 1-6:1.0: dvb ts2 set to bulk mode.

[109295.171026] em28xx 1-6:1.0: Binding DVB extension

[109295.174450] i2c i2c-7: Added multiplexed i2c bus 10

[109295.174452] si2168 7-0064: Silicon Labs Si2168-B40 successfully identified

[109295.174453] si2168 7-0064: firmware version: B 4.0.2

[109295.176594] si2157 10-0060: Silicon Labs Si2147/2148/2157/2158 successfully attached

[109295.176606] dvbdev: DVB: registering new adapter (1-6:1.0)

[109295.176608] em28xx 1-6:1.0: DVB: registering adapter 0 frontend 0 (Silicon Labs Si2168)...

[109295.176609] dvbdev: dvb_create_media_entity: media entity 'Silicon Labs Si2168' registered.

[109295.176881] dvbdev: dvb_create_media_entity: media entity 'dvb-demux' registered.

[109295.177363] em28xx 1-6:1.0: DVB extension successfully initialized

[109295.177364] em28xx 1-6:1.0: Binding DVB extension

[109295.180813] i2c i2c-9: Added multiplexed i2c bus 11

[109295.180815] si2168 9-0067: Silicon Labs Si2168-B40 successfully identified

[109295.180816] si2168 9-0067: firmware version: B 4.0.2

[109295.182523] si2157 11-0063: Silicon Labs Si2147/2148/2157/2158 successfully attached

[109295.182531] dvbdev: DVB: registering new adapter (1-6:1.0)

[109295.182532] em28xx 1-6:1.0: DVB: registering adapter 1 frontend 0 (Silicon Labs Si2168)...

[109295.182534] dvbdev: dvb_create_media_entity: media entity 'Silicon Labs Si2168' registered.

[109295.182799] dvbdev: dvb_create_media_entity: media entity 'dvb-demux' registered.

[109295.184331] em28xx 1-6:1.0: DVB extension successfully initialized

[109295.184333] em28xx 1-6:1.0: Registering input extension

[109295.184914] Registered IR keymap rc-hauppauge

[109295.185030] rc rc0: Hauppauge WinTV-dualHD DVB as /devices/pci0000:00/0000:00:14.0/usb1/1-6/1-6:1.0/rc/rc0

[109295.185077] rc rc0: lirc_dev: driver em28xx registered at minor = 0, scancode receiver, no transmitter

[109295.185101] input: Hauppauge WinTV-dualHD DVB as /devices/pci0000:00/0000:00:14.0/usb1/1-6/1-6:1.0/rc/rc0/input22

Files can be downloaded here https://www.dropbox.com/sh/qg96n15943zsk...ElA5a?dl=0

Please let me know how can I debug more / what information to provide, thanks.

mvallevand · 2021-03-16, 11:21 PM

If you capture that channel with dvbv5-zap does it contain the subtitle stream?

Martin

***sub*** · 2021-03-17, 05:27 AM

It should contain whatever streams were in the broadcast. You'll probably need to post the logs from the capture time for us to know for sure what was happening though.

Sebu7 · (This post was last modified: 2021-03-17, 09:10 AM by Sebu7.)

(2021-03-16, 11:21 PM)mvallevand Wrote: If you capture that channel with dvbv5-zap does it contain the subtitle stream?

Martin

Thanks for suggestion, I'm not sure if I am doing this right because I get confusing results:

1) First I tested with a channel that has DVB subtitles and no problem with NextPVR Linux/Kodi showing these subtitles

a) Live stream created by NextPVR Linux - for this file everything works fine, also VLC and TS Doctor show expected results

Code:
Input #0, mpegts, from 'nextpvr_debian_yle2hd.ts':

  Duration: 00:00:37.69, start: 18453.851856, bitrate: 7362 kb/s

  Program 1502

    Stream #0:0[0x138]: Video: h264 (Main) ([27][0][0][0] / 0x001B), yuv420p(tv, bt709, top first), 1920x1080 [SAR 1:1 DAR 16:9], 25 fps, 50 tbr, 90k tbn, 50 tbc

    Stream #0:1[0x35c](dan): Audio: ac3 (AC-3 / 0x332D4341), 48000 Hz, stereo, fltp, 448 kb/s

    Stream #0:2[0x35f](dut): Audio: ac3 (AC-3 / 0x332D4341), 48000 Hz, stereo, fltp, 192 kb/s (visual impaired) (descriptions)

    Stream #0:3[0x84f](fin): Subtitle: dvb_subtitle ([6][0][0][0] / 0x0006)

    Stream #0:4[0x1389](fin): Subtitle: dvb_teletext ([6][0][0][0] / 0x0006), 492x250

b) For same channel, recording created by "dvbv5-zap -p -c dvb_channel.conf "Yle TV2 HD" -ss -r -o dvbzap_debian_yle2hd.ts" - for this file however I cannot see subtitles in VLC although they are selectable in "Subtitles" menu. Also TS Doctor does not show subtitles stream. If I don't user -p parameter for dvbzap ffmpeg only shows that file has video and audio track but nothing more.

Code:
Input #0, mpegts, from 'dvbzap_debian_yle2hd.ts':

  Duration: 00:01:05.07, start: 18209.851856, bitrate: 5850 kb/s

  Program 1501

  Program 1502

    Stream #0:0[0x138]: Video: h264 (Main) ([27][0][0][0] / 0x001B), yuv420p(tv, bt709, top first), 1920x1080 [SAR 1:1 DAR 16:9], 25 fps, 50 tbr, 90k tbn, 50 tbc

    Stream #0:1[0x35c](dan): Audio: ac3 (AC-3 / 0x332D4341), 48000 Hz, stereo, fltp, 448 kb/s

    Stream #0:2[0x35f](dut): Audio: ac3 (AC-3 / 0x332D4341), 0 channels, fltp (visual impaired) (descriptions)

    Stream #0:3[0x84f](fin): Subtitle: dvb_subtitle ([6][0][0][0] / 0x0006)

    Stream #0:4[0x1389](fin): Subtitle: dvb_teletext ([6][0][0][0] / 0x0006)

  Program 1503

  Program 13105

I am not sure why this does not work, I can see the difference at least in ffmpeg output that has extra "Program" lines that do not exist with NextPVR created file.

2) For problematic channel dvbv5-zap -p -c dvb_channel.conf "AVA HD" -ss -r -o dvbzap_debian_avahd.ts - result is same as in 1) b)

Code:
Input #0, mpegts, from 'dvbzap_debian_avahd.ts':

  Duration: 00:00:53.99, start: 41688.658267, bitrate: 7854 kb/s

  Program 3001

  Program 3291

  Program 4101

  Program 11702

    Stream #0:0[0xc9]: Video: h264 (High) ([27][0][0][0] / 0x001B), yuv420p(tv, top first), 1920x1080 [SAR 1:1 DAR 16:9], 25 fps, 25 tbr, 90k tbn, 50 tbc

    Stream #0:1[0xca](fin): Audio: mp2 ([3][0][0][0] / 0x0003), 48000 Hz, stereo, fltp, 256 kb/s

    Stream #0:2[0xcb](fin): Subtitle: dvb_subtitle ([6][0][0][0] / 0x0006)

    Stream #0:3[0xcc](fin): Subtitle: dvb_teletext ([6][0][0][0] / 0x0006)

  Program 11703

Sebu7 · (This post was last modified: 2021-03-17, 09:25 AM by Sebu7.)

(2021-03-17, 05:27 AM)sub Wrote: It should contain whatever streams were in the broadcast. You'll probably need to post the logs from the capture time for us to know for sure what was happening though.

Logs attached when tuning to problematic channel

Not sure what to search in logs because if I tune to channel with DVB subtitles working fine I get:

Code:
22:22:468 [INFO] Creating writer for: LIVE&/storage/live-Yle TV2 HD-3269-2.ts (live mode)

22:22:468 [DEBUG] mutex would be: Global\NPVR-mutex-808efc2f0480efb27d1811c065ba410d

22:22:468 [DEBUG] Created shared memory

22:22:658 [DEBUG] Mapping pid 0 (PAT)

22:22:658 [DEBUG] Mapping pid 212 (PMT)

22:22:658 [DEBUG] Mapping pid 312 (video)

22:22:659 [DEBUG] Mapping pid 860 (audio)

22:22:659 [DEBUG] Mapping pid 863 (audio)

22:22:659 [DEBUG] Mapping pid 2127 (audio)

22:22:659 [DEBUG] Mapping pid 2128 (audio)

22:22:659 [DEBUG] Mapping pid 5001 (audio)

22:22:709 [DEBUG] Received 31960 bytes from device so far

22:27:731 [DEBUG] Received 3402424 bytes from device so far

22:32:753 [DEBUG] Received 6532436 bytes from device so far

22:37:775 [DEBUG] Received 9738212 bytes from device so far

but there is no mention about subtitles

Sebu7 · (This post was last modified: 2021-03-17, 10:36 AM by Sebu7.)

More information about dvbzap test:

For problematic case 2) if I add -P (all pids) parameter for "dvbv5-zap -p -c dvb_channel.conf "AVA HD" -P -ss -r -o dvbzap_debian_avahd_all.ts" I get "everything" to that file.

Code:
Input #0, mpegts, from 'dvbzap_debian_avahd_all.ts':

  Duration: 18:20:55.86, start: 46113.946267, bitrate: 5 kb/s

  Program 3001

    Metadata:

      service_name    : MTV LIVE HD

      service_provider: Elisa Oyj

    Stream #0:19[0x3f3]: Video: h264 ([27][0][0][0] / 0x001B), none, 90k tbr, 90k tbn

    Stream #0:20[0x3f4](eng): Audio: mp3 ([4][0][0][0] / 0x0004), 0 channels

    Stream #0:13[0x3f5](eng): Audio: ac3 (AC-3 / 0x332D4341), 48000 Hz, 5.1(side), fltp, 384 kb/s

  Program 3291

    Metadata:

      service_name    : MTV3 HD

      service_provider: Elisa Oyj

    Stream #0:7[0xcdc]: Video: h264 (High) ([27][0][0][0] / 0x001B), yuv420p(tv, bt709, top first), 1920x1080 [SAR 1:1 DAR 16:9], 25 fps, 50 tbr, 90k tbn, 50 tbc

    Stream #0:10[0xcdd](fin): Audio: mp2 ([4][0][0][0] / 0x0004), 48000 Hz, stereo, s16p, 256 kb/s

    Stream #0:9[0xce3](swe): Audio: mp2 ([4][0][0][0] / 0x0004), 48000 Hz, stereo, s16p, 256 kb/s

    Stream #0:18[0xce1](dut): Audio: mp2 ([4][0][0][0] / 0x0004), 48000 Hz, stereo, s16p, 192 kb/s (visual impaired) (descriptions)

    Stream #0:21[0xcdf](fin): Subtitle: dvb_subtitle ([6][0][0][0] / 0x0006)

    Stream #0:22[0xce0](dut): Subtitle: dvb_subtitle ([6][0][0][0] / 0x0006)

    Stream #0:12[0xcde](fin): Subtitle: dvb_teletext ([6][0][0][0] / 0x0006), 492x250

  Program 4101

    Metadata:

      service_name    : Eurosport HD

      service_provider: Elisa Oyj

    Stream #0:14[0x200]: Video: h264 ([27][0][0][0] / 0x001B), none, 90k tbr, 90k tbn

    Stream #0:15[0x283](fin): Audio: mp3 ([3][0][0][0] / 0x0003), 0 channels

    Stream #0:16[0x282](swe): Audio: mp3 ([3][0][0][0] / 0x0003), 0 channels

  Program 11702

    Metadata:

      service_name    : AVA HD

      service_provider: Elisa Oyj

    Stream #0:6[0xc9]: Video: h264 (High) ([27][0][0][0] / 0x001B), yuv420p(tv, top first), 1920x1080 [SAR 1:1 DAR 16:9], 25 fps, 25 tbr, 90k tbn, 50 tbc

    Stream #0:8[0xca](fin): Audio: mp2 ([3][0][0][0] / 0x0003), 48000 Hz, stereo, fltp, 256 kb/s

    Stream #0:17[0xcb](fin): Subtitle: dvb_subtitle ([6][0][0][0] / 0x0006)

    Stream #0:11[0xcc](fin): Subtitle: dvb_teletext ([6][0][0][0] / 0x0006), 492x250

  Program 11703

    Metadata:

      service_name    : TV5MONDE EUROPE HD

      service_provider: Elisa Oyj

    Stream #0:0[0x12d]: Video: h264 ([27][0][0][0] / 0x001B), none, 90k tbr, 90k tbn, 180k tbc

    Stream #0:1[0x12e](fra): Audio: mp3 ([3][0][0][0] / 0x0003), 0 channels, fltp

    Stream #0:2[0x131](eng): Subtitle: dvb_subtitle ([6][0][0][0] / 0x0006)

    Stream #0:3[0x130](rus): Subtitle: dvb_subtitle ([6][0][0][0] / 0x0006)

    Stream #0:4[0x12f](fra): Subtitle: dvb_subtitle ([6][0][0][0] / 0x0006)

    Stream #0:5[0x132](eng,fra): Subtitle: dvb_teletext ([6][0][0][0] / 0x0006), 492x250

When I open this file in TS Doctor I need to select "AVA HD" for which subtitle stream is now shown properly. Then I can save this channel in TS Doctor to another .ts file which I can play in VLC and subtitles are shown fine.

So the subs are there and can be captured but I don't understand usage of dvbzap enough nor why NextPVR is not capturing these subs.

Is this somehow related to tuning parameters? For problematic channel:

Code:
[AVA HD]

        SERVICE_ID = 11702

        TRANSPORT_ID = 20

        VIDEO_PID = 201

        AUDIO_PID = 202

        PID_06 = 204 203

        FREQUENCY = 130000000

        MODULATION = QAM/256

        INVERSION = AUTO

        SYMBOL_RATE = 6900000

        INNER_FEC = NONE

        DELIVERY_SYSTEM = DVBC/ANNEX_A

PID 203 I think is used for DVB subtitle track according to TS Doctor.

Other channel that works fine with DVB subtitles/NextPVR there are no "extra PIDs" in tuning details, only VIDEO and AUDIO:

Code:
[Yle TV1 HD]

        SERVICE_ID = 1501

        TRANSPORT_ID = 34

        VIDEO_PID = 310

        AUDIO_PID = 850 1127 1310 5000

        FREQUENCY = 138000000

        MODULATION = QAM/256

        INVERSION = AUTO

        SYMBOL_RATE = 6900000

        INNER_FEC = NONE

        DELIVERY_SYSTEM = DVBC/ANNEX_A

Another problematic channel has also "PID_06":

Code:
[Sub HD]

        SERVICE_ID = 11801

        TRANSPORT_ID = 34

        VIDEO_PID = 101

        AUDIO_PID = 102

        PID_06 = 104 103

        FREQUENCY = 442000000

        MODULATION = QAM/256

        INVERSION = AUTO

        SYMBOL_RATE = 6900000

        INNER_FEC = NONE

        DELIVERY_SYSTEM = DVBC/ANNEX_A

mvallevand · (This post was last modified: 2021-03-17, 12:54 PM by mvallevand.)

You shouldn't be using -P to record a full mux most players will have problem with that. It looks like -p is copying the full PAT too so you probably don't want that either because most players only want to see one program

Going back to the test 1 if your aresaying that works ok I think it it is the missing PID's in the scan. You might want to try dvbv5-zap using the NextPVR conf file in /var/opt/nextpvr/ to confirm that the created file doesn't add the subtitle streams.

Martin

Sebu7 · (This post was last modified: 2021-03-17, 01:22 PM by Sebu7.)

(2021-03-17, 12:53 PM)mvallevand Wrote: You shouldn't be using -P to record a full mux most players will have problem with that. It looks like -p is copying the full PAT too so you probably don't want that either because most players only want to see one program

Going back to the test 1 if your aresaying that works ok I think it it is the missing PID's in the scan. You might want to try dvbv5-zap using the NextPVR conf file in /var/opt/nextpvr/ to confirm that the created file doesn't add the subtitle streams.

Martin

The main problem is that I cannot get dvbzap to write subtitle data, even for the channel that works fine and NextPVR writes subtitle data for, without using -P option.

Tuning details are identical for these problematic and non-problematic channels in /var/opt/nextpvr/ compared what I used in my previous tests. Problematic channels has this extra "PID_06" where non-problematic does not have it in tuning details. But I cannot figure out how to make dvbzap write subtitle data for non-problematic channel without -P option, I've tried all parameter combinations.

mvallevand · 2021-03-17, 01:33 PM

Do you mean the lower case -p that makes sense, regarding the full mux does not.

Martin

Sebu7 · 2021-03-17, 01:47 PM

(2021-03-17, 01:33 PM)mvallevand Wrote: Do you mean the lower case -p that makes sense, regarding the full mux does not.

Martin

No, I mean full mux "-P"

1) With -p, I get ffmpeg -i to report

"Stream #0:2[0xcb](fin): Subtitle: dvb_subtitle ([6][0][0][0] / 0x0006)" but in the .ts file there is no subtitle data (for problematic and non problematic channels)

Without -p, ffmpeg only reports video and audio stream and there is no subtitle data (for problematic and non problematic channels)

2) With -P, ffmpeg reports metadata and the actual channel with subtitle data can be extracted like I describe in earlier post.

Possibly Related Threads…
Thread		Author	Replies	Views	Last Post
	missing MediaInfo.Wrapper.Core on NextTool execution	spagio	7	597	2024-12-04, 01:44 AM Last Post: mvallevand
	No NVENC option in settings/transcoder and subtitles missing from ts recordings	AWellesley	6	1,107	2024-03-04, 03:19 PM Last Post: mvallevand
	BBC Four HD missing from Channel scan - Astra 28.2E	Heifer	12	2,082	2024-03-03, 01:49 PM Last Post: mvallevand
	Missing listings	WagMan	5	812	2023-12-21, 01:40 AM Last Post: mvallevand
	Missing EPG entries - Control Characters	Tugdwal	5	1,001	2022-10-11, 06:08 PM Last Post: sub
	NextPVR on Armbian missing a few channels	billybo8	3	926	2022-04-07, 04:16 PM Last Post: billybo8
	Missing DVB-T subtitles	Caesium	26	3,367	2022-02-18, 11:35 PM Last Post: sub
	HD channel missing	mark31	8	2,131	2020-11-08, 03:29 PM Last Post: mark31
	Features missing and problems encountered	koijh65	9	2,809	2020-04-28, 12:43 AM Last Post: sub
	IPTV EPG won't load - missing value in AddEPGEvents	fsnertz	1	1,185	2020-03-20, 03:49 PM Last Post: mvallevand