New program for 1 step TTG downloads, decryption, encoding - kmttg

Discussion in 'TiVo Home Media Features & TiVoToGo' started by moyekj, Mar 15, 2008.

  1. Jan 29, 2019 #12081 of 12096
    mlippert

    mlippert Active Member

    222
    37
    Apr 2, 2010
    Massachusetts
    I'm pretty sure you can use handbrake or ffmpeg to transmux vs transcode the .ts to .mp4 or .mpg, although I'm not the one to tell you how.

    Sadly, I don't know of a profile, VRD or otherwise, that would transmux a .ts file to either a .mpg or a .mp4 depending on whether that .ts file contained an MPEG2 or an h.264 video stream.

    I'm not even sure if there's a profile that would transmux a .ts containing h.264 to a .mp4 (even if it transcoded the .ts if it had an MPEG2 stream). I'd find that useful, because I only download .ts files from the channels that are h.264. Of course what I'd really like is for kmttg's VRD QS Fix step to output a .mp4 when a TS .tivo is being decrypted. Kevin has said that's not possible, so I just do that manually when I use VRD to review the ad cuts. Doing that saves a step since the transmux is happening at the same time as cutting out the ads.
     
    giomania likes this.
  2. Jan 31, 2019 #12082 of 12096
    andrew1883

    andrew1883 Member

    61
    1
    Apr 25, 2008
    Other than QSFix, are there specific things VRD gives me? I've looked at it several times in the past but never pulled the trigger because I was getting what I wanted (move .TiVo files to PC, move .TiVo files to Premiere later when I want to watch them) without it. But I've also never worried about playing on other devices, removing commercials, etc.

    I'm seeing a lot of corrupted files this month. Not trying to move back to my Premiere, just playing the .TS using VLC. The shows starts okay but then at some point there's some corruption (e.g. 01.31.2019-11.21.12 ) which might get worse, then the rest is either out of sync or has no audio at all. I'm finding this by starting the .TS playing, then jumping to almost the end. I read that VRD lets you re-sync audio but it seems like it's just by shifting everything (and QSFix works but cutting out bits?).

    Great, another reason for VRD. :)

    I'm surprised by this (but I believe it). I would have thought some level of inherent (to file transfer) error correction would fix things. I've been transferring from TiVo Premiere (wired to router, maybe 6' cable) to ThinkPad (WiFi, maybe 15' from router). It's an Asus RT-N12D1 router, not the greatest but not a generic device either (it claims to have QoS but when I tried to set it up to support a VoIP connection, I couldn't figure it out). Would a cabled connection help? My notebook doesn't have a real ethernet port but there's an adapter I can get (or a USB adapter) and I might have a cable that long. I just figured I'd get transmission errors, not corrupted files.

    I guess if the .TS file takes 5min of playback for the picture to recover, and audio never does, I'd probably notice the jump. ;)

    I downloaded PyTiVo Desktop and it runs okay, but it says there are no TiVos (though kmttg and TiVo Desktop see the Premiere [still can't get a NPL through TD, but theoretically don't need it if kmttg or PD would work?]). Can't find any documentation either, I know this isn't the place but where would I find it?

    Thanks all!
    =aw
     
  3. Jan 31, 2019 #12083 of 12096
    mlippert

    mlippert Active Member

    222
    37
    Apr 2, 2010
    Massachusetts
    If you really don't care about transforming to other formats, then QSFix is probably the biggest thing. Of course included in the QSFix is also excising those TS corrupted parts that may make the video unwatchable.

    I haven't seen any huge corrupted sections of video here's an example of the sync error report for a download that had errors on all 4 attempts:
    Code:
    %YAML 1.2
    ---
    fileName            : "Freaky Friday (1976) (Aug_10_2018, DISNEYHD-E).tivo"
    fileSize            : 4244537568
    tivoName            : LivingRoomRoamio (192.168.100.81)
    downloadStarted     : 2018-08-11T20:20:15Z
    attemptSaved        : 4
    totalErrorPackets   : 148
    downloadAttempts:
        - attemptNumber : 1
          status        : sync_errors_saved
          transfer      : { bytes:  4244537568, seconds:  786.5, rate: " 41.17 Mb/s" }
          errorPackets:
              - { count:     70, start:  1130328096, end:  1130341256, startMB:  1077.96 }
              - { count:      5, start:  1502777716, end:  1502778656, startMB:  1433.16 }
              - { count:    117, start:  2684869828, end:  2684891824, startMB:  2560.49 }
              - { count:     19, start:  3057001352, end:  3057004924, startMB:  2915.38 }
              - { count:      9, start:  3850902980, end:  3850904672, startMB:  3672.51 }
              - { count:      3, start:  3850904860, end:  3850905424, startMB:  3672.51 }
              - { count:     14, start:  3850905424, end:  3850908056, startMB:  3672.51 }
        - attemptNumber : 2
          status        : sync_errors_saved
          transfer      : { bytes:  4244537568, seconds:  784.1, rate: " 41.30 Mb/s" }
          errorPackets:
              - { count:     28, start:   758954212, end:   758959476, startMB:   723.80 }
              - { count:     43, start:  2313695224, end:  2313703308, startMB:  2206.51 }
              - { count:    117, start:  2684869828, end:  2684891824, startMB:  2560.49 }
              - { count:     19, start:  3057001352, end:  3057004924, startMB:  2915.38 }
              - { count:     13, start:  3850902980, end:  3850905424, startMB:  3672.51 }
              - { count:     14, start:  3850905424, end:  3850908056, startMB:  3672.51 }
        - attemptNumber : 3
          status        : sync_errors_aborted
          transfer      : { bytes:  4238771984, seconds:  737.8, rate: " 43.83 Mb/s" }
          errorPackets:
              - { count:      5, start:  1502777716, end:  1502778656, startMB:  1433.16 }
              - { count:     46, start:  1893086208, end:  1893094856, startMB:  1805.39 }
              - { count:     92, start:  1893095044, end:  1893112340, startMB:  1805.40 }
              - { count:    108, start:  4243259168, end:  4243279472, startMB:  4046.69 }
              - { count:     65, start:  4243279660, end:  4243291880, startMB:  4046.71 }
        - attemptNumber : 4
          status        : sync_errors_saved
          transfer      : { bytes:  4244537568, seconds:  717.7, rate: " 45.12 Mb/s" }
          errorPackets:
              - { count:      5, start:  1502777716, end:  1502778656, startMB:  1433.16 }
              - { count:     21, start:  2684869828, end:  2684873776, startMB:  2560.49 }
              - { count:     95, start:  2684873964, end:  2684891824, startMB:  2560.50 }
              - { count:     13, start:  3850902980, end:  3850905424, startMB:  3672.51 }
              - { count:     14, start:  3850905424, end:  3850908056, startMB:  3672.51 }
    ...
    
    But you can see that the pieces aren't that large, even in total. This saved version had 148 bad packets, and each packet is 188 bytes, so that was 27824 bytes total, some of which is packet overhead. That much data probably isn't even one corrupted frame, much less a whole second's worth of frames (30 frames/second?).
    Of course if there are 7 different corrupted sections that could be 7 different frames that would have to be removed, or maybe a few more depending, but even so, it seems not enough to really disturb your viewing of the video by being removed.

    VRD has been quite good about leaving me with a watchable video. (I have had some cases where when VRD cut some sections out, the audio and video were out of sync, but I just contacted VRD support sent them the sample files and they fixed the issue. Like I said, I'm very happy to own their software.

    As for how to get "clean" downloads, a hardwired connection will not help. As far as anyone can tell the corruption is happening ON the TiVo itself, and it's somewhat random as to what section gets corrupted.

    There's a thread for @Dan203 's TiVo Desktop Easier to use pyTivo

    Hope all this helps
     
    giomania likes this.
  4. Jan 31, 2019 #12084 of 12096
    andrew1883

    andrew1883 Member

    61
    1
    Apr 25, 2008
    Thank you, that is helpful. Maybe I'll give VRD a try (though I seem to be getting all sorts of software to support a TiVo that may not have a lot more life -- and I doubt I'd invest the crazy sums they ask now for lifetime service).

    I read the other thread about corruption Downloading to computer, files corrupted and while it's mostly way over my head, it did seem the problems were mitigated by throttling the transfer, I guess so the TiVo can keep up. My cheap Asus RT-N12D1 router has a QoS setting that includes "Bandwidth Limiter", I set it for 10Mbps and then 5Mbps on the TiVo but it doesn't seem to be slowing down. For example, a 31min SD recording off AntennaTV transferred in about 2min ["size=579.63 MB elapsed=0:01:53 (43.03 Mbps)" to be precise], which feels like that QoS setting isn't working. I probably just don't know what it's doing, but it seems pretty straightforward. Guess I can try NetLimiter 4 Lite? Is limiting speed something that could be added to kmttg? Obviously it would have to be worth the effort, and I don't know how much effort that is (wouldn't need to be very flexible, maybe even a toggle or multiple choice with only a couple of choices).

    [​IMG]

    If anyone has ideas of other things I can try, please let me know. I guess NetLimiter is next.

    Thanks!
     
  5. Feb 2, 2019 #12085 of 12096
    andrew1883

    andrew1883 Member

    61
    1
    Apr 25, 2008
    A quick follow-up to say I downloaded a trial of Net Limiter and set pytivo.exe to 5 Mb/s (which it presents as 610.35 KB/s). pyTivo Desktop immediately slowed from 30-50 Mb/s.

    Before using Net Limiter, this one movie (The Harvey Girls, recorded on TCMHD with duration 1:45:59 and size 2.91 GB) has been failing (defined as downloading with packet errors) over and over. It usually first generated 135 errors at about the same point, so consistently I wonder(ed) if there was actually a problem with the recording. Other errors would appear in variable quantities.

    [​IMG]
    With the DL limited to 5 Mb/s, PTD successfully downloaded the movie with no packet errors, the first time. Of course it took longer than before, I assume 6-10x since it went from 30-50 Mb/s to 5 Mb/s. Guess I could try 10 Mb/s and see if it's better (TiVo Premiere). I feel like I should stick with PTD (and 5 tries) in case some errors are introduced, though I prefer kmttg's flexibility of filenaming but knowing the file is as clean as it's going to get, might be worth it. OTOH if I consistently get clean transfers at 5 Mb/s with PTD, perhaps I can trust my TiVo Premiere to handle it and stick with kmttg. :)

    [added: I turned Net Limiter up from 5 Mb/s to 7 Mb/s and got a clean 1st try on a 1:45 movie (11 GB) but errors on another that's running now. Guess I'll go back to 5. :(

    Thanks everyone for the help so far, and thanks to the developers for all this great software. Any additional tips will be appreciated. :)

    =aw
     
  6. Feb 9, 2019 #12086 of 12096
    scottb

    scottb Member

    66
    0
    Dec 31, 2002
    I have a KMTTG support question:

    Question about new KMTTG consistent crash on “mediainfo cli” after a prior long run of KMTTG stability:

    Possible recent system changes that could have triggered new “mediainfo cli” crash:
    Recently updated Java when java update notification became available
    MS Office 2013 application patches delivered by Windows Update Online

    System:
    Windows 7 64-bit
    Java 8 update 201 (64-bit) - 8.0.2010.9 (Java upgrade performed 1/21/2019, but crash started on 2/9/2019)
    KMTTG 2.4l
    KMTTG win 32 tools 2.1n.zip

    Crash appears to occur during or near end of KMTTG transfer from TiVo to PC:

    Windows Event Viewer Application Log:
    Log Name: Application
    Source: Application Error
    Date: 2/9/2019 10:50:21 AM
    Event ID: 1000
    Task Category: (100)
    Level: Error
    Keywords: Classic
    User: N/A
    Computer: OSCAR
    Description:
    Faulting application name: mediainfo.exe, version: 0.7.59.0, time stamp: 0x512744ad
    Faulting module name: MediaInfo.dll, version: 0.7.62.0, time stamp: 0x51274491
    Exception code: 0xc000000d
    Fault offset: 0x00216050
    Faulting process id: 0x2544
    Faulting application start time: 0x01d4c0a84e9e64b0
    Faulting application path: C:\KMTTG\mediainfo_cli\mediainfo.exe
    Faulting module path: C:\KMTTG\mediainfo_cli\MediaInfo.dll
    Report Id: 8cf7e391-2c9b-11e9-bd95-382c4a6f0785
    Event Xml:
    <Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
    <System>
    <Provider Name="Application Error" />
    <EventID Qualifiers="0">1000</EventID>
    <Level>2</Level>
    <Task>100</Task>
    <Keywords>0x80000000000000</Keywords>
    <TimeCreated SystemTime="2019-02-09T18:50:21.000000000Z" />
    <EventRecordID>1782863</EventRecordID>
    <Channel>Application</Channel>
    <Computer>OSCAR</Computer>
    <Security />
    </System>
    <EventData>
    <Data>mediainfo.exe</Data>
    <Data>0.7.59.0</Data>
    <Data>512744ad</Data>
    <Data>MediaInfo.dll</Data>
    <Data>0.7.62.0</Data>
    <Data>51274491</Data>
    <Data>c000000d</Data>
    <Data>00216050</Data>
    <Data>2544</Data>
    <Data>01d4c0a84e9e64b0</Data>
    <Data>C:\KMTTG\mediainfo_cli\mediainfo.exe</Data>
    <Data>C:\KMTTG\mediainfo_cli\MediaInfo.dll</Data>
    <Data>8cf7e391-2c9b-11e9-bd95-382c4a6f0785</Data>
    </EventData>
    </Event>
     
  7. Feb 10, 2019 #12087 of 12096
    scottb

    scottb Member

    66
    0
    Dec 31, 2002
    Update:

    So, I went to: MediaInfo - Download MediaInfo for Microsoft Windows and updated MediaInfo from 0.7 to 18.12, and so far, the KMTTG transfer mediaInfo-cli application crashes have stopped. Maybe this will help someone else having the same issue.

    Scott

     
  8. Feb 17, 2019 #12088 of 12096
    PSU_Sudzi

    PSU_Sudzi Well-Known Member

    1,928
    528
    Jun 4, 2015
    Philly suburbs
    So I have Comcast with the mpeg4 switch and am trying to offload a show to my computer but all I get is garbles with no sound. I have transport stream selected as the option with checking for errors and rejecting if any are found. Is this correct?
     
  9. Feb 17, 2019 #12089 of 12096
    mlippert

    mlippert Active Member

    222
    37
    Apr 2, 2010
    Massachusetts
    Are you running kmttg (which this thread is for) or PyTivo Desktop (you should be using the Easier to use pyTivo thread for that)

    I ask because the options you mention sound more like the latter.
     
  10. Feb 17, 2019 #12090 of 12096
    PSU_Sudzi

    PSU_Sudzi Well-Known Member

    1,928
    528
    Jun 4, 2015
    Philly suburbs
    I've actually tried it using both programs and get the same result but will repost this there (thanks for the heads up, came across this thread via the search feature). Is there a way to make mpeg4 transfers work in kmttg?
     
  11. Feb 17, 2019 #12091 of 12096
    mlippert

    mlippert Active Member

    222
    37
    Apr 2, 2010
    Massachusetts
    Using kmttg for mpeg4 transfers have been working fine for people here. I personally have been using my own customized version of pytivo do download from h.264 channels, so I'm not the best person to help you. I know you do have to use TS downloads, and other than using VideoRedo (which is a Windows app) I'm not sure how you should best deal with the errors that occur randomly with TS downloads.
    It wouldn't hurt to verify you environment (OS, version of kmttg, TiVo) for others here to be able to help you.
     
  12. Feb 17, 2019 #12092 of 12096
    PSU_Sudzi

    PSU_Sudzi Well-Known Member

    1,928
    528
    Jun 4, 2015
    Philly suburbs
    I'm running Windows 10, gen3 of the UI (version before Hydra), and I was using v2.4h and just switched to v2.4l but still get the same result. Have TS stream checked and metadata and decrypt.
     
  13. Feb 17, 2019 #12093 of 12096
    reneg

    reneg Active Member

    986
    131
    Jun 19, 2002
    In kmttg, next to the green start jobs button, there is a checkbox for TS Downloads, check that and decrypt checkbox. The decrypt checkbox will convert the .tivo file to a .ts file. There are multiple methods of decrypt supported by kmttg - tivodecode (default), tivolibre, DirectShow Dump, or Videoredo. I use Videoredo to decrypt my files, it's enabled under the Videoredo tab instead of Program Options like the other decrypt methods.
     
  14. Feb 17, 2019 #12094 of 12096
    PSU_Sudzi

    PSU_Sudzi Well-Known Member

    1,928
    528
    Jun 4, 2015
    Philly suburbs
    It looks like after the TS file was complete, I could view that video but not the TIVO file, I guess that's how it supposed to work? Thank you both for your help!
     
  15. Feb 17, 2019 #12095 of 12096
    reneg

    reneg Active Member

    986
    131
    Jun 19, 2002
    I usually check the Remove .Tivo file after decrypt option and only deal with .ts files.
     
    PSU_Sudzi likes this.
  16. Feb 17, 2019 #12096 of 12096
    PSU_Sudzi

    PSU_Sudzi Well-Known Member

    1,928
    528
    Jun 4, 2015
    Philly suburbs
    Will do that now as it’s unwatchable.
     

Share This Page