1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Easier to use pyTivo

Discussion in 'TiVo Coffee House - TiVo Discussion' started by Dan203, Jan 23, 2017.

  1. Jan 2, 2018 #1461 of 1654
    J_Palmer_Cass

    J_Palmer_Cass New Member

    7
    1
    Jan 1, 2018

    Try TS Doctor to look at bad areas of the TiVo file. The 30 day trial is enough time to see if the TS Doctor works for you.
     
  2. Jan 2, 2018 #1462 of 1654
    mlippert

    mlippert Active Member

    178
    25
    Apr 2, 2010
    Massachusetts
    Hmm, well it lists these intriguing functions:
    • Verify (show errors in streams)
    • Clean (remove unnecessary data)
    • Repair
    • Merge
    But overall I own VideoReDo and I think for saving my videos I've downloaded from my TiVo, it does what I need. (some of those functions would be nice to see (like verify), but I don't think it would improve my end result video file. And VRD does much more that TS Doctor seems to. (supporting other video encodings, video editing, decoding, etc).

    Still it's good to hear about other tools out there.
     
  3. Jan 2, 2018 #1463 of 1654
    J_Palmer_Cass

    J_Palmer_Cass New Member

    7
    1
    Jan 1, 2018
    VideoRedo is a different type of program than TS Doctor. I use PowerDirector Ultra for my video work. I may give VRD a trial in the future if I can get some decent TiVo TS downloads.

    This TS file issue is a big deal to me. I am only on day 2 of my TS Doctor trial. Primarily I use TS Doctor to find bad areas of the TS file(s). It is easy to miss bad areas of the file by any other method that I can find. If I buy the program, I may use it to cut the beginning and end of the TS file to minimize file size and save a cleaned TS file.

    All you have to do is take your final VRD adjusted TS file and run the "check only" function. If there are any bad areas the errors and warnings will be listed by time stamp by picture and sound stream. You view the picture of the problem areas right on the program to evaluate how much of a problem the error is in reality.

    You have to try the program to see how good your final processed TS files are. If you have a lot of completed TS files, you can check them out quickly. Try the program for a month, then delete it at the end of the trial.
     
    Last edited: Jan 2, 2018
    mlippert likes this.
  4. Jan 4, 2018 #1464 of 1654
    cp2k

    cp2k Member

    80
    2
    Mar 15, 2004
    I just started using pyTivo, and I love the fact that it works more efficiently than my old TiVo Desktop but I've noticed one unusual symptom/glitch.

    Typically I archive recordings from my TiVo with TiVo Desktop, edit them in VideoReDo, and then save them as .mkv files. I import those into TMPGEnc Authoring Works and burn Blu-Rays (sometimes, not every time) from the recordings. Typically TMPGEnc will recognize 720p files fine and "Smart Render" them to Blu-Ray without re-encoding, but 1080i files are usually listed as "Full Render". I discovered years ago that if I used a profile in VideoReDo that changed the GOP to "30" on all 1080i recordings on save they would import and "Smart Render" in TMPGEnc Authoring works.

    Today I tried copying a few programs over using pyTivo (I've tried both Transport Stream and Program Stream modes) with pyTivo doing the decoding using tivo-libre. I was surprised to find that the raw TS/PS files created by pyTiVo would import into TMPGEnc Authoring Works as "Smart Render". After I edit them in VideoReDo their properties are changed however, and they now require full rendering- even if I use my previous GOP change profile.

    If I upload the same program using TiVo Desktop, edit it in VideoReDo, and save it with the profile it works fine like it always does, however.

    Any idea what could be happening in VideoReDo to change the properties of the file to the degree that TMPGEnc won't accept it, and why does it only affect the pyTiVo files?

    Attached are screenshots of the properties of the same clip. The first is the raw PS stream from the TiVo using pyTivo, the second is the .mkv saved after editing in VideoReDo.

    FilefromPyTivo.JPG PostVRD.JPG
     
  5. Jan 5, 2018 #1465 of 1654
    cp2k

    cp2k Member

    80
    2
    Mar 15, 2004
    Just a follow-up/edit to my previous post. I've now found some instances where the pyTiVo generated .ts files don't show up as "smart render" capable, yet are smart render friendly after processing in VideoReDo the way I've done it in the past. So it isn't consistent either way.

    I'd be curious to know what rhyme/reason determines the "max number of GOP fields" a file pulled from the TiVo has, since that seems to be the sticking point in Blu-Ray compatibility.

    I'm dealing with strictly MPEG2 .TS files here too. Our cable company doesn't have any MPEG4 channels... yet.
     
  6. Jan 5, 2018 #1466 of 1654
    Dan203

    Dan203 Super Moderator Staff Member TCF Club

    41,937
    1,770
    Apr 17, 2000
    Nevada
    The TiVo records the stream as-is, so the GOP length is determined by the encoder at your cable company. 60 fields means that it will allow a maximum of 30 frames in a GOP. (since this is interlaced) Apparently some of your files have GOPs longer then 30 frames. There isn't any way to fix that other then processing the file with VideoReDo. All VideoReDo is doing when you set a max GOP length is it's scanning each GOP and if it exceeds the set value then it recodes a frame and inserts an I frame so that the GOP no longer exceeds the set value. If every GOP in the file exceeds 30 then it will end up recoding a lot of frames. But if only a few do then it'll be fast. If most/all of the frames exceed the value you might actually be better off just recoding the whole file, because the way VideoReDo shortens GOPs isn't the most efficient when it has to do every GOP in the file.
     
    mlippert likes this.
  7. Jan 5, 2018 #1467 of 1654
    cp2k

    cp2k Member

    80
    2
    Mar 15, 2004
    Thanks for the explanation. It is crazy though in that I recorded two movies back to back off the same channel. The first was compliant until I processed it with VideoReDo, then the GOP changed even though I didn’t tell it to change anything when saving.

    The second file recorded right after the first wasn’t compliant when pulled off the TiVo, but was after processing with VRD. I wonder why the encoders are so inconsistent?

    I wish there was a better option to create Blu-Ray discs, but the VRD/TMPG is the only consistent method I’ve found that doesn’t result in out of sync audio/video
     
    Last edited: Jan 5, 2018
  8. Jan 5, 2018 #1468 of 1654
    Dan203

    Dan203 Super Moderator Staff Member TCF Club

    41,937
    1,770
    Apr 17, 2000
    Nevada

    Did you trim anything from the file? What could be happening is that the program you're using is only checking the first GOP and assuming all the rest are the same. So when you make a cut you happen to line it up with a longer one and that triggers the program to recode. GOPs can be variable length so that's a poor assumption on their part, but unless they were to scan the entire file, which could take several minutes, they wouldn't be able to confirm that every GOP in the file was compliant.
     
  9. johnr2000

    johnr2000 New Member

    5
    1
    Mar 8, 2012
    Hi Dan203 & wmcbrine,

    My "My Tivo Recordings" share is no longer showing up under Devices on my Tivo.

    I have 2 Tivo's, a Roamio Plus and a Premier and have been using pyTivo for years and it's loaded as a service on my Windows 10 computer. In the past I would put movies in my "My Tivo Recordings" folder on my computer and then on my Tivo go to My Shows | Devices and select "My Tivo Recordings" to pull the movie into my Tivo. I'm sure this was working a few months ago.

    I haven't tried to import any shows into Tivo for a while until a few days ago. Now, my Roamio doesn't have "My Tivo Recordings" listed under Devices. Recently the Roamio's UI was updated (I'm not really liking the new UI!)

    When I ran pyTivo on my computer (localhost:9032) it didn't show "My Tivo Recordings" so I thought maybe it was broken. I uninstalled pyTivo (and related) completely and followed Dan203's instructions to install pyTivo Desktop. Still my Tivo doesn't show "My Tivo Recordings" under Devices. The pyTivo Desktop shows "My Tivo Recordings" but it doesn't show a listing of what's in it. I verified that I still have 9032 and another port open in Windows Firewall and have the correct MAK address and Tivo user ID and password.

    How do I get my Tivo to see "My Tivo Recordings" again?

    Thanks in advance.
     
  10. osu1991

    osu1991 Active Member

    874
    174
    Mar 6, 2015
    Oklahoma
    PC to TiVo transfers is no longer available using the new Hydra UI. If you need that functionality look at using Plex or revert your TiVo’s to the old UI which will result in the loss of all your dvr recordings in the process.

    TiVo to PC transfers still work with Hydra at the moment, so you can save any non copy protected content before reverting to the old UI.
     
  11. johnr2000

    johnr2000 New Member

    5
    1
    Mar 8, 2012
    Ok, I filed a complaint on the Tivo support site and I also talked to them on the phone and gave them a piece of my mind.
     
    jackstoker likes this.
  12. J_Palmer_Cass

    J_Palmer_Cass New Member

    7
    1
    Jan 1, 2018
    I have played around a bit more with problem TS TiVo files.

    I use the new pyTivo Desktop to download the TiVo files to my PC. I save about three TS TiVo files using the save with the least errors with retries set to 5.

    Then I use KMTTG to decode and QSfix to clean up the TS file.

    I then used TS Doctor check function to locate where the errors are in the decoded TS files.

    After review of the TS Doctor check log, I can look at the exact time stamp of the problem areas of the TS files.

    I have looked at three movie downloads, and it appears that all three movies can be patched together to make an error free TS file.

    The only question that I have is as follows. Is this worth the time to do this to get an error free copy? A cable broadcast error can not be corrected unless you have two different TiVo recordings of the same program.
     
  13. mlippert

    mlippert Active Member

    178
    25
    Apr 2, 2010
    Massachusetts
    That is a really good question. I've modified pytivo so it produces a log of the sync errors when downloading that looks like:
    Code:
    %YAML 1.2
    ---
    fileName            : "The Shannara Chronicles - ''Druid'' (Recorded Oct 11, 2017, SPIKEHD-E) (TS).tivo"
    fileSize            : 1926773824
    downloadStarted     : 2018-01-10T21:35:58Z
    attemptSaved        : 4
    totalErrorPackets   : 96
    downloadAttempts:
        - attemptNumber : 1
          status        : sync_errors_saved
          errorPackets:
              - { count:     36, start:   317642908, end:   317649676 }
              - { count:     10, start:   317649864, end:   317651744 }
              - { count:    109, start:   317651744, end:   317672236 }
              - { count:     93, start:   979883624, end:   979901108 }
              - { count:     23, start:  1297272556, end:  1297276880 }
              - { count:     15, start:  1297276880, end:  1297279700 }
              - { count:     27, start:  1939468524, end:  1939473600 }
        - attemptNumber : 2
          status        : sync_errors_saved
          errorPackets:
              - { count:     47, start:   317642908, end:   317651744 }
              - { count:    109, start:   317651744, end:   317672236 }
        - attemptNumber : 3
          status        : sync_errors_aborted
          errorPackets:
              - { count:     58, start:   643060944, end:   643071848 }
              - { count:     93, start:   979883624, end:   979901108 }
              - { count:     23, start:  1297272556, end:  1297276880 }
        - attemptNumber : 4
          status        : sync_errors_saved
          errorPackets:
              - { count:     58, start:   643060944, end:   643071848 }
              - { count:     23, start:  1297272556, end:  1297276880 }
              - { count:     15, start:  1297276880, end:  1297279700 }
    ...
    
    Even though it is still aborting any download w/ more sync errors than the previous best, you can still see that by merging some of these downloads I could get an error free copy, and this is frequently (although not always) the case.
    Because of the encryption it's not as simple as replacing the bad packets in one download with good packets from another.

    In the example above there are 109 packets in the biggest contiguous bad section. That's 20492 bytes and some of those are overhead.

    So (with no real knowledge) I don't think that a video frame is encoded in less that 20K, so that bad section affects 1 or 2 frames. However it could affect a reference frame which I'm guessing could cascade up to a GOP (group of pictures). If there are 30 frames per GOP and 30 frames per second, each bad section could cause a 1 sec glitch.

    A couple of 1 second glitches (probably shorter) seems unlikely to significantly compromise my enjoyment watching the video and so I haven't spent the time to figure out how to merge downloads.

    I am curious if my analysis is reasonable though.

    If you've identified the bad sections with TS Doctor, how long were they?
     
    Last edited: Jan 23, 2018
  14. garyprud

    garyprud Member

    37
    4
    Jan 13, 2017
    Thanks. Just d/l and hope to set up before the weekend is over. First-timer!
     
  15. Feb 6, 2018 #1475 of 1654
    Sparky1234

    Sparky1234 Totally

    1,309
    132
    May 8, 2006
    Does pytivo have a 25 show upload to the same folder limit? Running into an issue where 25 shows upload to same folder but 26+ loads individually to My Shows. dlfl with MetaGenerator suggested it might be a TiVo or pytivo limit.
     
  16. Feb 6, 2018 #1476 of 1654
    tivoknucklehead

    tivoknucklehead Well-Known Member

    1,037
    95
    Dec 12, 2002
    Orlando Florida
    haven't been in thread for months. does Hydra still not work with pytivo?
     
  17. Feb 6, 2018 #1477 of 1654
    lpwcomp

    lpwcomp Well-Known Member

    9,461
    295
    May 6, 2002
    John's...
    If such a limit exists (and I've never seen it myself), it would have to be something on the TiVo as grouping is based on the seriesId, not some explicit "put it in this group" command.
     
  18. Feb 6, 2018 #1478 of 1654
    lpwcomp

    lpwcomp Well-Known Member

    9,461
    295
    May 6, 2002
    John's...
    It's not just pyTivo, the only way to transfer something to a Hydrated TiVo is via the website, thus there is no way to transfer from an S2 or S3. Little chance that it is coming back as TiVo has decided that this capability is "obsolete". :mad:
     
  19. Feb 6, 2018 #1479 of 1654
    tivoknucklehead

    tivoknucklehead Well-Known Member

    1,037
    95
    Dec 12, 2002
    Orlando Florida

    thats what I thought. Having to transfer from PC to my old quad elite tivo and then to my Roamio online. such a a hassle and waste of time
     
  20. Feb 6, 2018 #1480 of 1654
    jhhyde

    jhhyde Member

    57
    4
    Dec 31, 2001
    Sammamish, WA

    and TiVo will soon be obsolete in my life if they keep taking away features and not fixing previous features that they have broken along the way. really believing this company is going down the sh*th*le.
     

Share This Page