1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

New program for 1 step TTG downloads, decryption, encoding - kmttg

Discussion in 'TiVo Home Media Features & TiVoToGo' started by moyekj, Mar 15, 2008.

  1. Apr 23, 2014 #6661 of 10616
    wireman121

    wireman121 Member

    126
    0
    Nov 8, 2008
    Yes it does, that's what I meant to say.
     
  2. Apr 23, 2014 #6662 of 10616
    epstewart

    epstewart Member

    655
    0
    Mar 1, 2003
    My tests seem to show that, as far as closed captions are concerned, it doesn't seem to matter whether I put the ts=on parameter in the pyTivo settings for the particular share I'm using, or remove it. As long as I did the kmttg transfer from the Roamio Plus to the Mac with the kmttg config parameter set to download the file as a transfer stream, then sending it back the Roamio Plus seems to carry the closed captions along regardless.

    I haven't yet tried putting ts=on in "Global Server Settings," as the captions are already present in the file transferred back to the TiVo.

    I do understand the point you and moyekj are making about ts=on avoiding the transcoding of h.264 files pulled to the TiVo, so I will be using that parameter. I just wanted to note that, at least in my testing, that parameter seems to be optional with respect to preserving closed captions.
     
  3. Apr 23, 2014 #6663 of 10616
    moyekj

    moyekj Well-Known Member

    11,267
    81
    Jan 23, 2006
    Mission...
    It's only working because you are transferring back .TiVo TS files which pyTivo leaves as is regardless of the "ts" parameter setting. If you were to try .TiVo PS files or videos in mpeg2 program stream container the captions won't work on the TiVo.
     
  4. Apr 23, 2014 #6664 of 10616
    moonscape

    moonscape Member

    472
    3
    Jul 3, 2004
    SF Bay Area
    Thanks much. It was a Java problem. Reinstalled Java (had been missing console too) and now all's well again.
     
  5. Apr 23, 2014 #6665 of 10616
    epstewart

    epstewart Member

    655
    0
    Mar 1, 2003
    Kevin,

    I'm not quite clear on this. If I use the relevant kmttg config parameter to download files to the Mac using transport stream format, I gather that pyTivo will always send them back with captions, regardless of the "ts" setting.

    But if I download a file to the Mac as a program stream, by virtue of not enabling the kmttg parameter, I seem to be finding that employing pyTivo's "ts=on" setting does not give me captions when the resulting .TiVo file is moved back to the TiVo.

    So I can't quite see how "ts=on" is relevant to the retention of captions.

    What am I missing here?
     
  6. Apr 23, 2014 #6666 of 10616
    moyekj

    moyekj Well-Known Member

    11,267
    81
    Jan 23, 2006
    Mission...
    Perhaps you don't have ts=on setting under [Server] section of pyTivo? Take a look at your pyTivo.conf file and check if ts=on is under [Server] section of the file, if not then that's your problem. Also, when changing such pyTivo settings, you have to make sure you re-start pyTivo. When pyTivo is setup correctly if you try and transfer mpeg2 program stream container back it will remux to TS container. Note that I think you will also need to configure pyTivo for tivodecode so that PS .TiVo files can be decrypted and re-muxed.
     
  7. Apr 23, 2014 #6667 of 10616
    epstewart

    epstewart Member

    655
    0
    Mar 1, 2003
    Kevin,

    Well, I'm still not getting it.

    I checked pyTivo.conf:

    Code:
    [Server]
    tivodecode = /Users/eric/Desktop/kmttg_v1p0r/tivodecode/tivodecode
    tdcat = /Users/eric/Desktop/kmttg_v1p0r/tivodecode/tdcat
    ffmpeg = /Users/eric/Desktop/kmttg_v1p0r/ffmpeg/ffmpeg
    ts = on
    
    [_tivo_SD]
    
    [_tivo_HD]
    
    [Seagate 3TB Drive TiVo Downloads]
    path = /Volumes/Seagate 3TB Drive/TiVo Downloads
    type = video
    
    
    That path to tivodecode is in fact a good one. It's the binary that is in the kmttg folder! I can execute it in Terminal just fine. Note that I have "ts = on" under [Server].

    I do always restart pyTivo after making changes.

    My test file was downloaded while "Download TiVo files in Transport Stream format" was not checked. I assume that gave me a PS .TiVo file.

    Yet when I send my test file back to my Roamio it has no captions. I also can't tell from the Terminal window that tivodecode was actually brought into the scenario:

    Code:
    INFO:pyTivo:Last modified: Mon Apr 14 04:35:14 2014
    INFO:pyTivo:Python: 2.7.5
    INFO:pyTivo:System: Darwin-13.1.0-x86_64-i386-64bit
    INFO:pyTivo.beacon:Scanning for TiVos...
    INFO:pyTivo.beacon:LR Premiere III
    INFO:pyTivo.beacon:Bedroom
    INFO:pyTivo.beacon:Announcing shares...
    INFO:pyTivo.beacon:Registering: Seagate 3TB Drive TiVo Downloads
    INFO:pyTivo:pyTivo is ready.
    INFO:pyTivo:192.168.1.12 [23/Apr/2014 20:12:18] "GET /TiVoConnect?Command=QueryContainer&Container=Seagate%203TB%20Drive%20TiVo%20Downloads&ItemCount=0&SerialNum=74600119063AED3 HTTP/1.1" 200 -
    INFO:pyTivo:192.168.1.16 [23/Apr/2014 20:12:18] "GET /TiVoConnect?Command=QueryContainer&Container=Seagate%203TB%20Drive%20TiVo%20Downloads&ItemCount=0&SerialNum=8480001903A5399 HTTP/1.1" 200 -
    INFO:pyTivo:192.168.1.12 [23/Apr/2014 20:12:18] "GET /TiVoConnect?Command=QueryContainer&Container=%2F&DoGenres=1 HTTP/1.0" 200 -
    INFO:pyTivo:192.168.1.16 [23/Apr/2014 20:12:18] "GET /TiVoConnect?Command=QueryContainer&Container=%2F&DoGenres=1 HTTP/1.0" 200 -
    INFO:pyTivo:192.168.1.10 [23/Apr/2014 20:12:18] "GET /TiVoConnect?Command=QueryContainer&Container=%2F&DoGenres=1 HTTP/1.0" 200 -
    INFO:pyTivo:192.168.1.17 [23/Apr/2014 20:12:18] "GET /TiVoConnect?Command=QueryContainer&Container=%2F&DoGenres=1 HTTP/1.0" 200 -
    INFO:pyTivo:192.168.1.10 [23/Apr/2014 20:12:18] "GET /TiVoConnect?Command=QueryContainer&Container=%2F&DoGenres=1 HTTP/1.0" 200 -
    INFO:pyTivo:127.0.0.1 [23/Apr/2014 20:12:20] "GET /TiVoConnect?Command=Settings&Container=Settings HTTP/1.1" 200 -
    INFO:pyTivo:192.168.1.16 [23/Apr/2014 20:13:41] "GET /TiVoConnect?Command=QueryFormats&SourceFormat=video%2Fx-tivo-mpeg HTTP/1.1" 200 -
    INFO:pyTivo:192.168.1.16 [23/Apr/2014 20:13:41] "GET /TiVoConnect?Command=QueryContainer&Container=Seagate%203TB%20Drive%20TiVo%20Downloads&Recurse=Yes&SortOrder=!CaptureDate&ItemCount=8&Filter=x-tivo-container%2Ftivo-videos,x-tivo-container%2Ffolder,video%2Fx-tivo-mpeg,video%2F*&SerialNum=8480001903A5399 HTTP/1.1" 200 -
    INFO:pyTivo:192.168.1.16 [23/Apr/2014 20:13:41] "GET /TiVoConnect?Command=QueryFormats&SourceFormat=video%2Fx-tivo-mpeg-ts HTTP/1.1" 200 -
    INFO:pyTivo:192.168.1.16 [23/Apr/2014 20:13:41] "GET /TiVoConnect?Command=QueryFormats&SourceFormat=video%2Fx-tivo-mpeg-ts HTTP/1.1" 200 -
    INFO:pyTivo:192.168.1.16 [23/Apr/2014 20:13:42] "GET /TiVoConnect?Command=QueryFormats&SourceFormat=video%2Fx-tivo-mpeg-ts HTTP/1.1" 200 -
    INFO:pyTivo:192.168.1.16 [23/Apr/2014 20:13:51] "GET /TiVoConnect?Command=QueryFormats&SourceFormat=video%2Fx-tivo-mpeg HTTP/1.1" 200 -
    INFO:pyTivo:192.168.1.16 [23/Apr/2014 20:13:52] "GET /TiVoConnect?Command=QueryContainer&Container=Seagate%203TB%20Drive%20TiVo%20Downloads&Recurse=Yes&SortOrder=!CaptureDate&ItemCount=1&AnchorItem=%2FSeagate%25203TB%2520Drive%2520TiVo%2520Downloads%2FState%2520Circle%2520%252804_18_2014%2529.TiVo&AnchorOffset=-1&Filter=x-tivo-container%2Ftivo-videos,x-tivo-container%2Ffolder,video%2Fx-tivo-mpeg,video%2F*&SerialNum=8480001903A5399 HTTP/1.1" 200 -
    INFO:pyTivo:192.168.1.16 [23/Apr/2014 20:13:52] "GET /TiVoConnect?Command=TVBusQuery&Container=Seagate%203TB%20Drive%20TiVo%20Downloads&File=%2FState%20Circle%20(04_18_2014).TiVo&SerialNum=8480001903A5399 HTTP/1.1" 200 -
    INFO:pyTivo:192.168.1.16 [23/Apr/2014 20:13:57] "GET /Seagate%203TB%20Drive%20TiVo%20Downloads/State%20Circle%20(04_18_2014).TiVo?Format=video%2Fx-tivo-mpeg HTTP/1.1" 200 -
    INFO:pyTivo.video.video:[23/Apr/2014 20:13:57] Start sending "/Volumes/Seagate 3TB Drive/TiVo Downloads/State Circle (04_18_2014).TiVo" to Bedroom
    INFO:pyTivo:192.168.1.16 [23/Apr/2014 20:15:11] "GET /TiVoConnect?Command=QueryFormats&SourceFormat=video%2Fx-tivo-mpeg HTTP/1.1" 200 -
    INFO:pyTivo:192.168.1.16 [23/Apr/2014 20:15:11] "GET /TiVoConnect?Command=QueryContainer&Container=Seagate%203TB%20Drive%20TiVo%20Downloads&Recurse=Yes&SortOrder=!CaptureDate&ItemCount=8&AnchorItem=%2FSeagate%25203TB%2520Drive%2520TiVo%2520Downloads%2FState%2520Circle%2520%252804_18_2014%2529.TiVo&AnchorOffset=-1&Filter=x-tivo-container%2Ftivo-videos,x-tivo-container%2Ffolder,video%2Fx-tivo-mpeg,video%2F*&SerialNum=8480001903A5399 HTTP/1.1" 200 -
    INFO:pyTivo:192.168.1.16 [23/Apr/2014 20:15:11] "GET /TiVoConnect?Command=QueryFormats&SourceFormat=video%2Fx-tivo-mpeg-ts HTTP/1.1" 200 -
    INFO:pyTivo:192.168.1.16 [23/Apr/2014 20:15:11] "GET /TiVoConnect?Command=QueryFormats&SourceFormat=video%2Fx-tivo-mpeg-ts HTTP/1.1" 200 -
    INFO:pyTivo:192.168.1.16 [23/Apr/2014 20:15:11] "GET /TiVoConnect?Command=QueryFormats&SourceFormat=video%2Fx-tivo-mpeg-ts HTTP/1.1" 200 -
    INFO:pyTivo.video.video:[Errno 32] Broken pipe
    INFO:pyTivo.video.video:[Errno 32] Broken pipe
    INFO:pyTivo.video.video:[23/Apr/2014 20:15:49] Done sending "/Volumes/Seagate 3TB Drive/TiVo Downloads/State Circle (04_18_2014).TiVo" to Bedroom, 424673280 bytes, 28.94 Mb/s
    ERROR:pyTivo:Exception during request from ('192.168.1.16', 42622)
    Traceback (most recent call last):
      File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/SocketServer.py", line 593, in process_request_thread
        self.finish_request(request, client_address)
      File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/SocketServer.py", line 334, in finish_request
        self.RequestHandlerClass(request, client_address, self)
      File "/Applications/pyTivo/httpserver.py", line 91, in __init__
        client_address, server)
      File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/SocketServer.py", line 651, in __init__
        self.finish()
      File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/SocketServer.py", line 710, in finish
        self.wfile.close()
      File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/socket.py", line 279, in close
        self.flush()
      File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/socket.py", line 303, in flush
        self._sock.sendall(view[write_offset:write_offset+buffer_size])
    error: [Errno 32] Broken pipe
    
    
    So I'm doing something wrong still, I think. Do I need to add some more settings into pyTivo.conf, such as maybe my MAK?

    Thanks again for all your help ...
     
  8. Apr 23, 2014 #6668 of 10616
    moyekj

    moyekj Well-Known Member

    11,267
    81
    Jan 23, 2006
    Mission...
    Yes, you do need to supply MAK in pyTivo config so pyTivo can decrypt. Not exactly sure if pyTivo will decrypt PS .TiVo file automatically with ts=on setting. But other thing you can try is decrypt the PS .TiVo file using kmttg and then have pyTivo transfer the resulting .mpg file. You should find pyTivo will remux that one and result should have captions.
     
  9. Apr 23, 2014 #6669 of 10616
    moyekj

    moyekj Well-Known Member

    11,267
    81
    Jan 23, 2006
    Mission...
    Eric, I just confirmed that for .TiVo files, pyTivo pulls will not transcode them in any way regardless of the "ts" setting. So if you want to transfer back PS .TiVo files and preserve captions on the TiVo, you 1st need to decrypt them to .mpg before transferring back with pyTivo and ts=on setting.
     
  10. Apr 24, 2014 #6670 of 10616
    lpwcomp

    lpwcomp Well-Known Member

    8,277
    39
    May 6, 2002
    John's...
    The thing is, the only sure way I've found to retain usable captioning is VideoReDo. tivodecode usually at least garbles them. If I run projectx qsfix, they don't seem to be there at all,even garbled.
     
  11. Apr 24, 2014 #6671 of 10616
    moyekj

    moyekj Well-Known Member

    11,267
    81
    Jan 23, 2006
    Mission...
    Yes, it's documented that projectX kills captions, and the kmttg "QS Fix" tooltip warns in bold about projectX discarding captions. I don't recall issues with tivodecode garbling captions however, but I mostly used VideoRedo for decrypt/qsfix.
     
  12. Apr 24, 2014 #6672 of 10616
    epstewart

    epstewart Member

    655
    0
    Mar 1, 2003
    Thanks, Kevin,

    OK, that jibes with what I've been seeing. For my archival purposes, I don't really need to decrypt the .TiVo files to .mpg, and as long as I am using kmttg's program option to "Download TiVo files in Transport Stream format," it looks like pulling them back to the Roamio gives me the closed captions I want. As you say, the "ts" setting in pyTivo doesn't seem to make any difference in that one particular usage. But I will keep in mind that if I ever decrypt the .TiVo files and possibly transcode them, I will need to have "ts = on" set in pyTivo.
     
  13. Apr 25, 2014 #6673 of 10616
    AudioNutz

    AudioNutz New Member

    318
    0
    Nov 9, 2008
    I've been using KMTTG for several years, and love it. Recently I added a couple of S3 TiVo HD's to my home, and now I see double downloads (auto processing) on many of the shows coming from these new devices.

    For example, in my config I use [title]_[EpisodeNumber] for the file naming.

    Tonight it downloaded "Surviving Jack - Something to Talk About_106.tivo", and then it downloaded "Surviving Jack - Something to Talk About_105.tivo". Researching the auto.log shows me that sometimes these shows come from each of the two different TiVo's, but other times they actually come from the same TiVo.
    By the way...
    1. The KMTTG GUI shows me that both TiVos have [Ep 105] in the list.
    2. When the metadata file gets downloaded, one of them shows Episode 106, and the other shows Episode 105.

    To try to solve:
    I switched to Java downloads, rather than curl - no change.

    The only thing I can think to try next is to switch to transport stream downloads.
    Has anyone seen these double downloads before?
     
  14. Apr 25, 2014 #6674 of 10616
    moyekj

    moyekj Well-Known Member

    11,267
    81
    Jan 23, 2006
    Mission...
    kmttg tracks what has been auto downloaded in auto.history file. You can manually add an entry in there by selecting a title in the NPL table and choosing Auto Transfers->Add selected to history file. That should prevent further auto downloads of that title. You can also get visual indication in NPL table of what has been auto processed previously by enabling "Highlight processed shows in history file" under config->Visual tab.

    To get more complete episode information for your series 3 units supply your tivo.com login & password under config->Tivos tab if you haven't already.
     
  15. Apr 25, 2014 #6675 of 10616
    AudioNutz

    AudioNutz New Member

    318
    0
    Nov 9, 2008
    Kevin,
    Right, I've got all of that down to a science, and I use the login and password in the config. The weird thing is, there's only one entry in the history log, even though the show is being downloaded twice.

    I'm not able to manually add the entry in the history, because the 2nd show starts as soon as the 1st one is done. (auto means I don't watch it)
     
  16. Apr 25, 2014 #6676 of 10616
    ppeewang

    ppeewang New Member

    16
    0
    Aug 27, 2012
    anyway to remap the computer keyboard shortcuts for the remote feature ?
     
  17. Apr 25, 2014 #6677 of 10616
    moyekj

    moyekj Well-Known Member

    11,267
    81
    Jan 23, 2006
    Mission...
    Short of modifying source code, no.
     
  18. Apr 25, 2014 #6678 of 10616
    moyekj

    moyekj Well-Known Member

    11,267
    81
    Jan 23, 2006
    Mission...
    Don't understand. Bring up the GUI, refresh the NPL, select the show and then use the menu entry to add to history file.
     
  19. Apr 25, 2014 #6679 of 10616
    lpwcomp

    lpwcomp Well-Known Member

    8,277
    39
    May 6, 2002
    John's...
    What he's saying is he is not at the computer when the problem occurs.
     
  20. Apr 25, 2014 #6680 of 10616
    moyekj

    moyekj Well-Known Member

    11,267
    81
    Jan 23, 2006
    Mission...
    OK, but if it's a one off problem (affecting 1 particular title) then bring up kmttg GUI somewhere and add the history entry. There must be 1 computer that's not headless.
     

Share This Page