Easier to use pyTivo - pyTivo Desktop

Discussion in 'TiVo Coffee House - TiVo Discussion' started by Dan203, Jan 23, 2017.

  1. May 3, 2017 #541 of 2498
    webminster

    webminster Member TCF Club

    68
    9
    Dec 12, 2016

    Advertisements

    Wish it were that simple... Comcast has both MPEG2 and MPEG4. If I have TS option set, I often get a blank video downloading from an MPEG2 recording (like ABC programming). I find myself having to constantly change pyTivo mode back and forth, depending on which mode works.
     
  2. May 3, 2017 #542 of 2498
    Dan203

    Dan203 Super Moderator Staff Member TCF Club

    54,568
    7,548
    Apr 17, 2000
    Nevada
    That shouldn't happen. TS works for both MPEG-2 and MPEG-4. You will get blank recordings if you have the TS option unchecked and try to down an MPEG-4 show though.
     
  3. May 3, 2017 #543 of 2498
    webminster

    webminster Member TCF Club

    68
    9
    Dec 12, 2016
    Does for me, even so... for kmttg as well. The kmttg author once told me that there were bugs in TS support in TiVo side and sometimes PS is required*... Tried downloading "Agents of Shield" from my Bolt+ a couple of times in TS mode (MPEG2), both times blank. Switching modes is only way I can make it work, but the fact it's a global option makes it more difficult to swap back and forth.

    New program for 1 step TTG downloads, decryption, encoding - kmttg
     
  4. May 3, 2017 #544 of 2498
    Dan203

    Dan203 Super Moderator Staff Member TCF Club

    54,568
    7,548
    Apr 17, 2000
    Nevada
    Hmmm... I hadn't considered that scenario. Maybe I could add an option that would cause the download button to display a menu with the option to choose PS/TS for each show. It would be an extra click though, so I'd only want to do that if the user set an option.
     
    V7Goose and ClearToLand like this.
  5. May 3, 2017 #545 of 2498
    JoeKustra

    JoeKustra in the other Alabama TCF Club

    20,355
    3,796
    Dec 7, 2012
    Ashland, PA...

    Advertisements

    Maybe I'm cursed. Here's my experience. Downloaded today's copy of pyTiVo Desktop. Installed on laptop after removing old Desktop.

    It found my two basic Roamio units. I downloaded my Sunday's copy of Elementary. It's padded by one hour so it was an 11MB file. Note: old Desktop said this was a one hour program. New program indicated two hours.

    Setup share and the folder appeared on my other Roamio. This Roamio and laptop are on the same floor. Easy to watch.

    Started transfer from PC to Roamio. It failed at 3 minutes. Error in History: "Download Problem. This show was not downloaded onto this TiVo because it exceeded the expected size".

    Went to laptop and downloaded last night's Late Night (no padding) and NCIS (no padding).

    Started transfer of Late Night. Same failure at 7 minutes, 14 seconds.

    Started transfer of NCIS. No error. 5.63GB and transfer time of 8 min 25 seconds. All times and speeds are from the TiVo's network diagnostics. No other network, TiVo or PC activity during this time.

    What next?
     
    Last edited: May 3, 2017
  6. May 3, 2017 #546 of 2498
    Dan203

    Dan203 Super Moderator Staff Member TCF Club

    54,568
    7,548
    Apr 17, 2000
    Nevada
    That error indicates there is a glitch in the download and your TiVo is choking on it when you reupload. The fix is to either decrypt the file or run it through VideoReDo QuickStream Fix. This is a TiVo error, not a pyTivo issue. They seem to have serious issues with their TS format.
     
  7. May 3, 2017 #547 of 2498
    ClearToLand

    ClearToLand Old !*#$% Tinkerer!

    1,107
    173
    Jul 9, 2001
    Central Jersey
    I'm sorry Joe, but for someone as detail-oriented as you when describing entries in the TiVo logs, you're really lacking here on the file transfers troubleshooting. :oops: No, you're not cursed, just caught up in a loop.

    I'm not even going to talk about anything you've done previous - just from this point forward:
    1. STOP using TS / "Fast" TiVo-to-PC file transfers!
      - I only know kmttg settings so you'll have to get the PS / "Slow" setting from Dan.
    2. Forget about padding vs no padding - doesn't matter. Only TS vs PS matters.
    3. Transfer a show from TiVo-to-PC, using pyTiVo Desktop, using PS / "Slow" transfer format
    4. Transfer that show from PC-to-TiVo, using pyTiVo Deskop
      • If it succeeds, you now have a solution / work flow that works.
      • If it fails, you have bigger problems that we will need to continue to troubleshoot.
    IMO, *ALL* of your PC-to-TiVo errors are due to your initial TiVo-to-PC transfer(s) being in TS / "Fast" format, regardless of the tool you used...
     
    Mikeguy likes this.
  8. May 3, 2017 #548 of 2498
    JoeKustra

    JoeKustra in the other Alabama TCF Club

    20,355
    3,796
    Dec 7, 2012
    Ashland, PA...
    Ok, color me confused. Like I posted, I installed pyTiVo Desktop as requested. I ran the program. I was presented with My Shows on one Roamio. I saw no location or option to change the TS or PS option. I really wanted it to work, and guess I need to read this entire thread to find the option. No problem. It's not that big. With the old Desktop it was an easy option to find, but I feel it's no longer working unless slow means 90Mbps and fast means 92Mbps. Perhaps that's a clue to my problem? My network isn't perfect, but it's not bad either. I'm open to any pointers. My ego died years ago. :)
     
  9. May 3, 2017 #549 of 2498
    ClearToLand

    ClearToLand Old !*#$% Tinkerer!

    1,107
    173
    Jul 9, 2001
    Central Jersey
    Nope, fast or slow has nothing to do with your network (contrary to what you posted earlier, it was my, (possibly incorrect memory), understanding that PS transfers were larger files; maybe it was that it took the TiVo CPU longer to create each packet; whatever the reason, PS transfers (supposedly) take more wall clock time than TS transfers) - everything will continue to transfer at the previous ~93Mbps (the max we all see, allowing for some overhead on a 100Mbps wired connection).

    @Dan203, where's your Wiki page listing all of the optional settings for pyTiVo Desktop?

    @Mikeguy, you're running it - do you know how to specify PS instead of TS transfers? I haven't had a chance to install it yet...

    Thanks! :)

    You'll be making successful PS transfers back-and-forth in no time Joe. :)
     
  10. May 3, 2017 #550 of 2498
    Mikeguy

    Mikeguy Well-Known Member

    27,636
    9,209
    Jul 28, 2005
    ing
    TS currently is set/unset under Settings, via the gear symbol at the upper right of the main screen; it's a "global" setting for all transfers and, once checked (for TS mode) or unchecked (for PS mode) and then settings saved (bottom right), pyTivo shuts off and then starts up again (automatically). There were a few posts here recently about perhaps making TS/PS selectable per show (as Joe was looking to do).

    Also, even if TS mode is selected, if only a PS transfer is possible (such as, with an earlier TiVo box--my Series 2, for example), PS mode will be defaulted to.
     
    ClearToLand likes this.
  11. May 4, 2017 #551 of 2498
    Dan203

    Dan203 Super Moderator Staff Member TCF Club

    54,568
    7,548
    Apr 17, 2000
    Nevada
    Upper right hand corner is a gear icon. That's where the settings are. Just uncheck the TS option and it'll use PS instead, which works better for most, but not all, MPEG-2 files. But doesn't work with MPEG-4 at all, so beware of that.

    FYI in the next version there will be a new option that will give you two download links for each show one for TS and one for PS. That way you can decide which one you want to use on a per-recording basis.
     
  12. May 4, 2017 #552 of 2498
    Dan203

    Dan203 Super Moderator Staff Member TCF Club

    54,568
    7,548
    Apr 17, 2000
    Nevada
    FYI I just added a new feature that will help you out. I switched the TS option from a checkbox to a drop down with 3 options... TS, PS and Let me choose. When you select the 3rd option you'll get two download buttons next to each recording, one for TS and one for PS. That way you can dynamically choose which one to use without having to change the global option back and forth.
     
    Mikeguy likes this.
  13. May 4, 2017 #553 of 2498
    Dan203

    Dan203 Super Moderator Staff Member TCF Club

    54,568
    7,548
    Apr 17, 2000
    Nevada
    I might have figured out a way to fix this TS issue. I was playing with a file that throws the error in the debugger and I noticed that when the TiVo hits one of these bad spots the connection dies, then it sends another request for a partial download with an offset equal to the last bytes it received. There was an error in the pyTivo code that prevented that from working, which I fixed. But even then the TiVo would still get stuck in a loop where it would rerequest the same bytes over and over. However I found that if I scanned forward to the next sequence header then started outputting bytes the download would resume. I still need to figure out exactly how I'm going to put this together, but I think I might be able to fix this issue and you'll only get a minor blip in the recording where the error was.
     
  14. May 4, 2017 #554 of 2498
    JoeKustra

    JoeKustra in the other Alabama TCF Club

    20,355
    3,796
    Dec 7, 2012
    Ashland, PA...
    Update. I found the two places that control TS, and downloaded three programs, including the two hour Elementary. Then copied them to the other Roamio. All three worked. But the transfer from the PC to the Roamio was 36Mbps. But it worked. Thanks for the help.
     
  15. May 4, 2017 #555 of 2498
    ClearToLand

    ClearToLand Old !*#$% Tinkerer!

    1,107
    173
    Jul 9, 2001
    Central Jersey
    • What's the Make & Model of your PC? (i.e. what CPU does it have? What Passmark score?)
      .
    • While transferring PC-to-TiVo (or even TiVo-to-PC), check CPU Utilization in Task Manager - 100%?
      - the best I can do to-and-from my old backup PC is ~75Mbps average; Pentium E2200 CPU, Passmark 1201.
    I'm so glad things are finally working for you! See, you were never cursed. :)

    (I'm just waking up, but, weren't you getting 93Mbps TiVo-to-PC? via power line adapters? 36Mbps sounds like 802.11n.)
     
  16. May 4, 2017 #556 of 2498
    Dan203

    Dan203 Super Moderator Staff Member TCF Club

    54,568
    7,548
    Apr 17, 2000
    Nevada
    I made a change last night that seemed to speed up PC to TiVo transfers. Still working out how to handle these TS glitches though. Trying to figure out if I can detect them before I send the bad data to the TiVo rather then waiting for it to fail and then rerequest.

    One potential idea, if I can't figure out how to detect the errors on my own, is to insert livolibre into the send side so it decrypts all .tivo files as they're being sent since it seems to be able to more gracefully deal with the errors then TiVo can.
     
  17. May 4, 2017 #557 of 2498
    ClearToLand

    ClearToLand Old !*#$% Tinkerer!

    1,107
    173
    Jul 9, 2001
    Central Jersey
    What's the end result presented to the 'unknowing / don't-wanna-know-just-want-it-to-work' user going to look like on the TiVo re: metadata?

    I haven't played around with pyTiVo in months, (and haven't yet installed pyTiVo Desktop) but decrypting to a .TS file separates the mpeg from the metadata. You mentioned the tivolibre '-p' option to create metadata, IIRC. Does anything need to be set in pyTiVo, pyTiVo Desktop to use that metadata 'transparently' as if it was all still coming back wrapped in a .TIVO file?
     
  18. May 4, 2017 #558 of 2498
    JoeKustra

    JoeKustra in the other Alabama TCF Club

    20,355
    3,796
    Dec 7, 2012
    Ashland, PA...
    Thanks for asking. Yesterday, when it failed, my speed on the TiVo was just over 90Mbps on both units. This is a Dell I5-4460S 2.9GHz laptop 1Gb Ethernet to a basic Roamio. Both are on the same router. Speed when getting the programs from the other Roamio was 93Mbps. It uses a EX7000 configured as a wireless bridge. That Roamio is also the host for my Mini, but it's usually in Standby except for an hour in the morning. I see a small difference in the speed reported by Taskmgr and the pyTiVo Desktop, but I'll stick with quoting the speeds from TiVo's network diagnostics (transfer history).
     
  19. May 4, 2017 #559 of 2498
    Dan203

    Dan203 Super Moderator Staff Member TCF Club

    54,568
    7,548
    Apr 17, 2000
    Nevada
    I could still send the original .tivo header so all the metadata would stay intact. No need to use the -p option or anything like that. I can just send through the header bytes from the original .tivo file, then start sending the decrypted video portion of the file. As far as the TiVo is concerned it would be a .tivo file.
     
  20. May 4, 2017 #560 of 2498
    ClearToLand

    ClearToLand Old !*#$% Tinkerer!

    1,107
    173
    Jul 9, 2001
    Central Jersey
    But, I didn't ask you about your Network Performance in Task Manager - I asked about your CPU Utilization DURING transfers. ;)


    That's pretty respectable for our purposes.

    pyTiVo failed to re-install onto this old desktop a couple of weeks ago and I haven't looked into the problem yet but I do have Streambaby installed, so as soon as my Roamio Basic to Roamio OTA transfers finish, I'll Streambaby a file and check the TiVo Transfer History (my S-P-S-9-S is gone, so my TiVo re-booted overnight and thus the old history is gone). I don't know if I'm just 'dreaming' about getting ~90Mbps PC-to-TiVo so I'll have to check. Putting a second pot of coffee on now. :)
     

Share This Page

spam firewall

Advertisements