New program for 1 step TTG downloads, decryption, encoding - kmttg

Discussion in 'TiVo Home Media Features & TiVoToGo' started by moyekj, Mar 15, 2008.

  1. Feb 27, 2019 #12101 of 12887
    ClearToLand

    ClearToLand Old !*#$% Tinkerer!

    1,105
    171
    Jul 9, 2001
    Central Jersey

    Advertisements

    QoS / Bandwidth Limiting on a router is between your LAN (LAN ports) and the Internet (your WAN port). To affect TS Sync Errors, you need it between your TiVo and your PC, both residing on your LAN. That's why I used a managed network switch and @reneg used a program on his PC.
     
  2. Feb 27, 2019 #12102 of 12887
    mlippert

    mlippert Active Member

    316
    76
    Apr 2, 2010
    Massachusetts
    Heh, very funny :)
    But in all seriousness, if the errors after correction/removal are not noticeable how is that any different from converting the video to a different lossy format? If you convert to a different lossy format you've lost parts of the original, but if you can't tell, it will be fine for you :)

    That said, I do use my version of pytivo to download all h.264 videos and use kmttg afterwards as you do, but even then I usually don't worry if after 4 attempts I have less than 300 back blocks, and I let videoredo clean it up. My pytivo reports enough info that I can use videoredo to see where the error occurs if I care. When I initially did that, many times the error was in a commercial I'm was cutting out anyway. I've stopped checking because the result after videoredo cleaned it up was fine for me.
     
  3. Feb 27, 2019 #12103 of 12887
    ClearToLand

    ClearToLand Old !*#$% Tinkerer!

    1,105
    171
    Jul 9, 2001
    Central Jersey
    You're confusing "Apples & Oranges" here:

    b = bits; B = bytes; 1 B(yte) = 8 b(its); 1MB/s = 8Mb/s; 5MB/s = 40Mb/s​

    When @reneg initially began using Net Limiter, I asked him to stick with keeping our discussions in Mb/s (bits) even though Net Limiter, AFAICT, deals with MB/s (bytes) but he didn't agree. IMO, those folks not technical can easily miss the b vs B difference.

    You're the first TCF member with a Premiere that has shown an interest in TS Sync Errors and Bandwidth Throttling. Since the Premiere has a slower CPU than both the Roamio Basic / OTAs that I use and the Bolts that @mlippert (wireless) and @reneg (wired) use, what is the unthrottled maximum transfer speed TiVo-to-PC reported in Network Diagnostics for your (wired?) Premiere?

    FYI, I do my TiVo-to-PC transfers in batches (~20-30 files). With "Retries=5", I start out unthrottled (~93.5Mbps). Sometimes *MANY* shows transfer error-free. Next I drop my managed switch to 32Mbps (64Mbps doesn't seem to help). Those that still have errors, I retry again now at 16Mbps. That's the lowest that I've ever had to go. Before going to 16Mbps, I also like to free up at least 100GB on a second TiVo, transfer the problematic show(s) there, and try again. IIRC, it's all detailed in the other thread...
     
  4. Feb 27, 2019 #12104 of 12887
    ClearToLand

    ClearToLand Old !*#$% Tinkerer!

    1,105
    171
    Jul 9, 2001
    Central Jersey
    I have a curiosity question:

    I note that you are (were?) quite often a daily visitor here on TCF as am I. Before you posted this problem with Comcast MPEG-4 channels and Transport Stream Protocol file transfers, were you aware of TS Sync Errors?
     
  5. Feb 27, 2019 #12105 of 12887
    ClearToLand

    ClearToLand Old !*#$% Tinkerer!

    1,105
    171
    Jul 9, 2001
    Central Jersey

    Advertisements

    @mlippert ,

    I always meant to get back to you on this - no slight / minimization of your effort intended! :cool:

    You have your Python 3 version; I have my Python 2 version (runs from IDLE ;) ); both based on the work of @Dan203 ("0x47 every 188" :thumbsup: ). You shared yours; I did not (no one ever asked; how about you? many users?). Regardless, I personally find the TCF interest in TS Sync Errors remains minuscule, AFAICT. :( I believe that @Dan203 's "Plug-N-Play" installation (vs @wmcbrine 's pyTiVo installation) garnered more new users than the "0x47 every 188" feature but the TS Sync Error detection (which I pushed hard for :D ) was the greatest achievement for me.

    If you recall, I initially lost *MANY* (50+?) offloaded shows when I (Roamio Basic / kmttg / pyTiVo newbie) blindly transferred them TiVo-to-PC via kmttg Transport Stream Transfer Protocol to an external 3TB USB HDD and then unsuccessfully tried to copy them back ~6 months later. :mad:

    My current workflow, with pyTiVo Desktop, kmttg, StreamBaby, Plex, Terramaster NAS and Hauppauge HD PVR has been flawless. My current Plex clients (PMP on Win7, Amazon Fire HD 8s) have no need to transcode and StreamBaby *EASILY* plays all my GT 720p @ 4Mbps MPEG-2 material. For H.264 material (although StreamBaby easily will transcode it), my two ~10yo Patriot Box Office media streamers effortlessly continue to do the job via DLNA.
     
  6. Feb 27, 2019 #12106 of 12887
    ClearToLand

    ClearToLand Old !*#$% Tinkerer!

    1,105
    171
    Jul 9, 2001
    Central Jersey
    GOOGLE the portion of your QUOTEd in Red post above and read what Adam Sawicki has to say. Learn the difference between codecs and containers; transcode and remux. It's unbelievable the amount of information available to us via the internet - you only have to learn to separate the "Wheat from the chaff". ;)

    If you have pyTiVo or StreamBaby installed, you can view the ffmpeg commands they create when playing different file types. You can then use this info to create your own custom profiles in kmttg. ffmpeg itself has *PAGES* of documentation available on the internet.

    Have fun learning! :) [Teach a man to fish vs give a man a fish...]
     
  7. Feb 27, 2019 #12107 of 12887
    ClearToLand

    ClearToLand Old !*#$% Tinkerer!

    1,105
    171
    Jul 9, 2001
    Central Jersey
    About a year or so ago, when I was using kmttg to Ad Cut a MPEG-2 .ts file using the .edl file created from SkipMode, I reported a bug to @moyekj that the resulting _cut file was .mpg instead of .ts. By copying the kmttg-created batch file before it was auto-deleted, IIRC, I found a "-f vob" parameter inserted in the ffmpeg command. SEARCH TCF and / or ffmpeg documentation if you're still interested.

    Auto-determining whether the .ts file is MPEG-2 or H.264 would probably involve calling MediaInfo during the job stream. IIRC, @reneg once used DOS batch files inside a kmttg custom command. You'll have to see what the kmttg available file args are. Remuxing a H.264 .ts to .mp4, Stack Overflow via GOOGLE says it's as simple as:

    ffmpeg -i input.ts -acodec copy -vcodec copy out.mp4​

    but I would first check what pyTiVo or StreamBaby use as parameters.

    That's all I've got off the top of my 'slightly foggy' head...
     
  8. Feb 27, 2019 #12108 of 12887
    ClearToLand

    ClearToLand Old !*#$% Tinkerer!

    1,105
    171
    Jul 9, 2001
    Central Jersey
    First, other technical folks, like yourself, are not the audience I'm addressing. I recently read an interesting post from @fcfc2 regarding ' forum readers':
    ...Some folks either by god given intelligence, or a good education know how to search and study up on things on their own....this is not the common experience by my estimation. Manufacturers seem oblivious to this and provide little in the way of documentation or even links to "easy to understand" pages online. And even though there is information available, it is not always as easy to digest as it could be, and it takes time....most people today are "plug and play" types, anything beyond that is incomprehensible and not worth the effort. These folks are irritated when asked to "think" period.

    Now, if we take just the first sentence of your post:
    I see it very easy for a non-technical "Plug and Play" type ("irritated when asked to 'think'") to interpret that as there are no problems when using Transport Stream Transfer Protocol for MPEG-4 transfers (via kmttg). VideoReDo is not even in the equation - at this point in time. It may be in YOUR mind but AFAICT the 'Average Joe' looking to pinch pennies wherever possible is not contemplating spending $100 to correct an error that no one besides @Dan203 is monitoring and reporting.

    Here's an example - this TCF user, thanks to pyTiVo Desktop, is aware of the errors:
    For a non-pyTiVo Desktop user, unaware of any TS Sync Errors, what do you think the chances of successfully copying that file back PC-to-TiVo months later (after the original is long gone) would be? @JoeyS doesn't appear to know what a "TS" error is. Are 500+ significant? VideoRedo? What's that??? o_O

    I don't see anyone besides me making a big deal over TS Sync Errors. I was badly bitten by them once and I don't want to see other newbies disappointed if they discover them 'after the fact'. I don't post everyday and it's plainly evident (at least to me) that the majority of TCF members don't bother to read much more than the narrow topic of interest that they logged in to post a new (answered many times before) question on in the first place. :rolleyes:

    Back in the days when I ran a RCP/M BBS on a Z80 CPU computer w/64K RAM and 8" floppies with a Hayes 2400 baud SmartModem, you needed a technical background just to be able to build a computer and be able to *FIND* (no internet - no GOOGLE - POTS telephones!) and log into a RCP/M BBS. Nowadays, with folks logging on via their Smartphones, the technical level of expertise has dropped tremendously (along with their pride in spelling and grammar if I may add :p ).
     
    PSU_Sudzi and kpeters59 like this.
  9. Feb 27, 2019 #12109 of 12887
    ThAbtO

    ThAbtO TiVoholic by the bay TCF Club

    12,459
    1,092
    Apr 6, 2000
    SF Bay Area
    Updated in your original thread. (I know I asked you to post about KMTTG related material here, but it wasn't necessary to repeat this issue here. It was for next time. ;))
     
    Last edited: Feb 27, 2019
  10. Feb 27, 2019 #12110 of 12887
    reneg

    reneg Well-Known Member

    1,145
    231
    Jun 19, 2002
    Nope, I still use both pyTivo Desktop & bandwidth limiting to download files from my Tivos. I still get quicker results for the bandwidth limited transfers.

    When I xfer files that I intend to archive, I use pyTivo Desktop. When I xfer files without skip data and I don't intend to archive, I use kmttg with VideoRedo doing the decrypt so I can mark the skip points and import the skip point back into kmttg.
     
    Last edited: Feb 27, 2019
  11. Feb 27, 2019 #12111 of 12887
    PSU_Sudzi

    PSU_Sudzi Well-Known Member

    2,524
    941
    Jun 4, 2015
    Philly suburbs
    Yes, I read/posted here frequently but was not 100% sure of the issue aside from what I saw in some posts and tried to follow along. But its not always easy as responses to one question might appear 7 responses later in between other questions, etc. Up until now my primary use for pyTiVo was uploading files to my TiVo and kmttg was for backing up season passes, channel lists, wish lists, and thumbs.I hadn't a need to offload a recording to my computer since before the transition occurred.
     
  12. Feb 27, 2019 #12112 of 12887
    reneg

    reneg Well-Known Member

    1,145
    231
    Jun 19, 2002
    Xfer errors can be noticeable in closed captions as garbled text. If you don't care about the closed captions, then it's fine.
     
  13. Feb 27, 2019 #12113 of 12887
    PSU_Sudzi

    PSU_Sudzi Well-Known Member

    2,524
    941
    Jun 4, 2015
    Philly suburbs
    Thanks for the tips. I was able to get it to work, the problem was I thought the first file kmttg generated (maybe it was a *.TiVo file or a *.mpg file, I forget) that was just garble was the end product but what I needed was for the TS file to be created.
     
  14. Mar 2, 2019 #12114 of 12887
    m_jonis

    m_jonis Member

    677
    7
    Jan 3, 2002
    Albany, NY
    I saw on another thread, that someone said that kmttg can be used to transfer shows (non-copy protected, of course) from "old" Tivo to the new Bolt? But I'm having difficulty finding out how to do that in this tread. I'm fairly certain I can save the shows to PC and back again, but there was an earlier post (like way long ago) that seemed to imply you could go "direct" as you'd lose some metadata if you went via the PC.

    Basically I'm trying to work around the defect in Tivo Online where you can only transfer one show at a time, or else it'll only transfer like 10 minutes of it.

    Thanks!
     
  15. Mar 2, 2019 #12115 of 12887
    lrhorer

    lrhorer Active Member

    6,933
    10
    Aug 31, 2003
    San...
    Moyekj,

    Your program started out great, and has since steadily advanced to beyond terrific. The feature set is just astounding. Thanks for all your hard work over the years. I do have one small feature request. It would be really handy if there were some conditional naming rules, especially around the Series naming function. If KMTTG could scan the metadata and omit any fields associated with Series data if the video is not episodic, it would save some trouble. So, for example, if the naming rule is: [mainTitle][/][mainTitle] - [SeriesEpNumber] - [episodeTitle] (Recorded [wday] [month] [mday], [year], [channel]), but the metadata is something like:

    Code:
    isEpisode : false
    isEpisodic : false
    then remove the [SeriesEpNumber] and [episodeTitle], adjacent whitespace, and any non-directive text between them.
     
  16. Mar 2, 2019 #12116 of 12887
    mlippert

    mlippert Active Member

    316
    76
    Apr 2, 2010
    Massachusetts
    @Irhorer I think you can get that with the current naming rule functionality
    My naming rule is:
    Code:
    [mainTitle] ["- s" season]["e" episode " - "][episodeTitle " "]["(" movieYear ") "]([month]_[mday]_[year], [channel])
    That naming rule gives me this for series:
    Code:
    The Good Place - s03e10 - The Book of Dougs (Jan_10_2019, WBTS-LD).TiVo
    and this for movies:
    Code:
    I Married a Witch (1942) (Sep_03_2018, TCMHD).TiVo
     
  17. Mar 2, 2019 #12117 of 12887
    ThAbtO

    ThAbtO TiVoholic by the bay TCF Club

    12,459
    1,092
    Apr 6, 2000
    SF Bay Area
    KMTTG does not transfer to Tivo from Computer, only Tivo to Computer.
    Basic Tivo to Tivo transfer does not require any software, but with v21+, its been made more difficult and only works with Premiere and up (involving online.tivo.com.)
     
    m_jonis likes this.
  18. Mar 3, 2019 #12118 of 12887
    m_jonis

    m_jonis Member

    677
    7
    Jan 3, 2002
    Albany, NY
    Thank you for the info! Much appreciated.
     
  19. Mar 3, 2019 #12119 of 12887
    Mikeguy

    Mikeguy Well-Known Member

    27,636
    9,205
    Jul 28, 2005
    But, pyTivo Desktop does TiVo -> PC -> TiVo. :)
     
  20. Mar 3, 2019 #12120 of 12887
    ThAbtO

    ThAbtO TiVoholic by the bay TCF Club

    12,459
    1,092
    Apr 6, 2000
    SF Bay Area
    But, not on v21+, TE4.
     

Share This Page

spam firewall

Advertisements