1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

New program for 1 step TTG downloads, decryption, encoding - kmttg

Discussion in 'TiVo Home Media Features & TiVoToGo' started by moyekj, Mar 15, 2008.

  1. Jun 10, 2013 #5301 of 10413
    moyekj

    moyekj Well-Known Member

    11,144
    32
    Jan 23, 2006
    Mission...
    I think the answers you are looking for are covered in VideoRedo_configuration Wiki. There are some special considerations to get VideoRedo running in service mode.
     
  2. Jun 10, 2013 #5302 of 10413
    jonathan.ibell

    jonathan.ibell New Member

    2
    0
    Jun 10, 2013
    Halleluiah! Yep, NZ does use H.264. With that box ticked it’s now transferring as it should… I didn’t realise it would be so easy, and clearly I’d forgotten ticking this box last time I installed the programme.

    Thanks so much for the prompt assistance – great to have it all up and running again.
     
  3. Jun 11, 2013 #5303 of 10413
    howards

    howards Member

    77
    0
    Oct 31, 2007
    I posted in the Premiere topic:

    http://www.tivocommunity.com/tivo-vb/showthread.php?t=505329

    about some of my experiences after configuring an 801.11ac access point/bridge combination and the resultant performance. I was using kmttg transfers to test performance.

    Performance was initially very disappointing - only about 30Mbps. Then I had the idea of switching my kmttg upload target from a USB 2.0 RAID disk (which I assume is low performance) to a motherboard SATA disk. Transfer performance immediately doubled to 60Mbps, in line with what some other people are seeing.

    This suggests to me a possible performance improvement in kmttg. If the code were multithreaded so that the task that writes to the disk is independent of the task that transfers from the Tivo, I think one would see faster transfers. I did not go look at the source to see if this is already multithreaded. I think my test here shows that kmttg is I/O bound on the disk writes (which is a surprising result to me).
     
  4. Jun 11, 2013 #5304 of 10413
    moyekj

    moyekj Well-Known Member

    11,144
    32
    Jan 23, 2006
    Mission...
    That's not really practical since if you don't write the accumulating incoming stream to disk right away that means you are storing it in memory, and using your example, up to 50% of the recording would need to be buffered in memory draining the machine of memory and affecting overall system performance. Set kmttg to download to a faster drive and then set subsequent steps in the flow to go to your USB drive.
     
  5. Jun 11, 2013 #5305 of 10413
    mattack

    mattack Active Member

    20,743
    4
    Apr 9, 2001
    sunnyvale
    Note, I *was* able to resume a transfer from my Premiere 4 to my Tivo HD the other day (I tried it again and had already chosen from paused point before I realized I thought it didn't work anymore). Anyway, it DID work.

    So I tried with kmttg again. It DIDN'T work, but it didn't get an error either... It just stuck at 0 MB transferred for a a few minutes before I cancelled the download. (I know I have an older kmttg, since the resume from paused point was turned off automatically for Premiere on current kmttg.)

    I haven't checked exact version #s on the Premiere, and I'm pretty busy this week, but I wonder if there was a slight update past the original seed version of the Tivo software to the final one that I think started widespread rollout (according to the other threads).
     
  6. Jun 11, 2013 #5306 of 10413
    moyekj

    moyekj Well-Known Member

    11,144
    32
    Jan 23, 2006
    Mission...
    I haven't released version yet that ignores "resume" for series 4 TiVos. But I have 20.3.1 and it doesn't work and for me still puts TiVo web server in "server busy" state.
     
  7. Jun 11, 2013 #5307 of 10413
    howards

    howards Member

    77
    0
    Oct 31, 2007
    That's not the way systems such as this are typically programmed. Yes, it uses some additional memory, but the amount used is controllable - you allocate a fixed set of multiple buffers worth of transfer data (which would be nowhere near the size of 50% of the recording). You tune the number (and size) of buffers through performance experimentation.

    Moving the disk-writing to a separate thread allows overlap of the network transfer thread with the disk-writing, without requiring stalling the transfer thread every time you do a disk write. Performance of a disk-writing thread is likely to be bursty, since disks are subject to variable rotational delays. Having a separate disk writing thread also provides the opportunity to experiment with grouping multiple network transfer thread buffers into a single disk-write buffer and seeing if any additional performance is gained that way (the longer the buffer, the better the disk I/O performance on many OSes).

    While I found out about this by having two different speeds of hard disk on my system, that doesn't mean the system is performing optimally on the faster disk. In fact, if kmttg is currently single-threaded, a performance increase should be achievable no matter how fast the disk is (limited by the network transfer speed) unless the OS releases the application to run state immediately after the disk write I/O call (before the physical disk write is performed). Very few systems do that - most systems suspend the I/O caller so that an error result can be returned from the I/O.

    Java has the advantage of making experimenting with threads extremely easy. If you're familiar with the terminology, I'm just talking about standard producer/consumer threads - an ancient technique in computing.

    FWIW, I'm a computer programmer with 30 years of specialization in systems realtime programming.

    kmttg is a fantastic program as is, so I'm not pushing for anything. It's just an idea in case you're interested in experimenting. For all I know, kmttg might already be multithreaded. Since it's an issue I've dealt with many times, it caught my tweaker's eye.
     
  8. Jun 11, 2013 #5308 of 10413
    moyekj

    moyekj Well-Known Member

    11,144
    32
    Jan 23, 2006
    Mission...
    kmttg uses threads all over the place. You wouldn't be able to perform multiple tasks in parallel otherwise and of course you couldn't use the GUI while tasks are running if there wasn't any threading being used, and you wouldn't be able to see updating STATUS statistics, etc. Download tasks are no different than anything else and run in their own thread, but ultimately if you have a slow disk it's going to be slow writing to it no matter what games you play. Choose a faster disk to write to if you want faster downloads.
     
  9. Jun 11, 2013 #5309 of 10413
    jdwheel1

    jdwheel1 New Member

    9
    0
    Jun 1, 2003
    Texas
    Thanks to moyekj for pointing in the right direction for fixing my trouble with automatic transfers. A careful read of the wiki documentation does answer many of the questions.... if I just had taken the time to read it... call me lazy.

    KMTTG is fantastic for my needs.
     
  10. Jun 14, 2013 #5310 of 10413
    az1097

    az1097 New Member

    82
    0
    Apr 3, 2013
    I'm using v1p0a. When I try to remote schedule a specific show why does it say "RPC error response: 0x30001"?
     
  11. Jun 14, 2013 #5311 of 10413
    moyekj

    moyekj Well-Known Member

    11,144
    32
    Jan 23, 2006
    Mission...
    It will probably fail if you try and schedule same show on TiVo itself as well. How far out is it? If it's 11+ days away it may be an entry that's not unavailable on TiVo local guide listings yet.
     
  12. Jun 14, 2013 #5312 of 10413
    az1097

    az1097 New Member

    82
    0
    Apr 3, 2013
    I did not schedule the same show on the Tivo and using kmttg, I'm able to schedule recordings past that particular one which fails even where there are no other scheduled programs in that time slot.
     
  13. Jun 14, 2013 #5313 of 10413
    moyekj

    moyekj Well-Known Member

    11,144
    32
    Jan 23, 2006
    Mission...
    It happens - a discrepancy between RPC listings and local guide listings most likely. If you use the iOS or Android apps to try and schedule same program most likely it wouldn't work either since they use same scheduling mechanism kmttg is using.
     
  14. Jun 14, 2013 #5314 of 10413
    az1097

    az1097 New Member

    82
    0
    Apr 3, 2013
    When I try to get listings for any channel, for the past few hours, I get "RPC error response: The middlemind connection is currently down".
     
  15. Jun 14, 2013 #5315 of 10413
    lpwcomp

    lpwcomp Active Member

    8,081
    2
    May 6, 2002
    John's...
    The TiVo servers are down.
     
  16. Jun 15, 2013 #5316 of 10413
    Hyrax

    Hyrax New Member

    112
    0
    Sep 1, 2007
    Hello-
    I've been using kmttg for over 4 years and it is great. My Tivo is a Premiere XL. I just upgraded my cable plan to include more than basic service, so I've suddenly got a lot more stuff to archive. Unfortunately, I've also started having an occasional problem with only partial recordings transferring from my Tivo via kmttg. What I see is about 1.4 GB of the recording making it across before the transfer just stops. These are recordings from non-premium stations.

    For example, there's been a marathon of episodes of a show that I've been recording and transferring from my Tivo to my PC. I've successfully used kmttg to move over 80 episodes of that one show to my PC. However, one episode refused to completely transfer. Hour episodes are about 5 GB, but only a bit over 1 GB or so of that episode was transferred.

    From another channel I tried to transfer a movie, but only 1.4 GB of the 10 GB made it. Other movies from this channel transfer just fine.

    I've tried every combination of kmttg options I can think of that might help. That includes, Curl and Java downloads, transfer as a transport stream or not, decoding with VRD or tivodecode, and probably other things. I've made sure that the Tivo was not recording anything at the time I was trying to transfer.

    I've also tried using the patched version of the most current version of Tivo Desktop. That has never failed me before, but on at least two occasions it acted exactly the same as kmttg.

    This is not a huge problem, but it is a vexing one. I'd like to be able to archive complete seasons of a show and watch them as time allows. These partial downloads make that difficult.

    I did a quick search of this thread and don't see a solution to my problem. Hopefully, I just described the problem differently and someone knows what I should do to solve it.

    Thanks in advance,
    Tim
     
  17. Jun 15, 2013 #5317 of 10413
    moyekj

    moyekj Well-Known Member

    11,144
    32
    Jan 23, 2006
    Mission...
    Hyrax, there's really nothing you can do about partial transfers for Premieres anymore. The problem is on TiVo http server side for recordings with certain "glitches" in them, so whatever software you use to transfer will have same problem. It used to be with kmttg you could use "Resume Downloads" option to so you could skip past the "glitch" and set a pause point and then download from pause point. But 20.3.1 software update for Premieres broke that capability, so now there's no good workaround I know of short of recording the show again on the TiVo.

    If you have more than 1 TiVo in the house then you can play games such as skipping past the problem point and using MRV resume to transfer to another TiVo, then download that partial recording via kmttg. However if you only have 1 TiVo then you are basically SOL.
     
  18. Jun 15, 2013 #5318 of 10413
    Hyrax

    Hyrax New Member

    112
    0
    Sep 1, 2007
    Thanks for the reply, moyekj.

    I used to have a TivoHD, but gave it to a relative who is currently not using it. I'll try to get it back and see what MRV does.

    If I were to use the TivoHD instead of the Premiere to record these marathons, would it allow me to use kmttg's resume feature?
     
  19. Jun 15, 2013 #5319 of 10413
    moyekj

    moyekj Well-Known Member

    11,144
    32
    Jan 23, 2006
    Mission...
    Yes, that feature still works for series 3 TiVos (there are no further software updates for series 3 to break anything anymore).
     
  20. Jun 22, 2013 #5320 of 10413
    miricle

    miricle New Member

    63
    0
    Jan 26, 2002
    Waltham, MA
    I've been using kmttg for quite some time and I just had a few feature requests that I've come up with over the years that would be useful for myself and probably others. Some of these are Win-x64 related, other could be for anyone.

    1) I really wish that atomic jobs would be inserted after encoding completes. Right now, atomic jobs get put at the very end of the job queue -- meaning if I'm downloading a bunch of shows, I have about 3/4 of the atomic jobs after ALL processing is complete, meaning my encoded jobs are not ready to put onto something like an iPad until everything is done.
    2) Would be nice to be able to have my computer go into standby/power save mode once all jobs are done. Sometimes I run jobs that go late into the night. Would be nice if the computer could go to sleep when kmttg is done.
    3) Download 64bit handbrake (not sure if any other Windows tools are available in 64bit) rather than 32bit. I can put 64bit handbrake in place and have it work okay - only a little faster, etc. Maybe use 64bit Java for ProjectX as well.
    4) Have an iPad and iPad-retina handbrake profile - I made one based on Handbrake's profile but would be nice for the distribution to have one.
    5) grr, I had one more, can't remember it now *sigh*
     

Share This Page