1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

New program for 1 step TTG downloads, decryption, encoding - kmttg

Discussion in 'TiVo Home Media Features & TiVoToGo' started by moyekj, Mar 15, 2008.

  1. Apr 25, 2014 #6681 of 10407
    lpwcomp

    lpwcomp Active Member

    8,075
    2
    May 6, 2002
    John's...
    FWIW, here's my take on what the OP is describing:

    He has autotransfers running, either via the server or looping in the GUI.
    It is sometimes downloading the same episode twice, once from each TiVo, and somehow they are getting two different episode numbers.

    He only discovers this after the fact. He may not even be home when it happens.

    He posted an example. This was not a one time occurrence.

    To the OP: Do you by any chance have the "Treat each recording as unique" box checked on the Auto Transfer entries for which this is occurring?

    Also, it would be helpful if you posted the relevant portions of the log and auto.history. That would give everyone a better idea of what kmttg is doing.
     
  2. Apr 25, 2014 #6682 of 10407
    AudioNutz

    AudioNutz New Member

    318
    0
    Nov 9, 2008
    lpwcomp is correct, this happens every night now, and it's with many shows. I checked, and I am not using the "Treat Each Recording as unique" with these shows, but I may be with some of others.

    Last night the shows that had double downloads were:
    The Big Bang Theory - The Anything Can Happen Recurrence
    The Millers - Tomlandia
    Two and a Half Men - Lotta Delis in Little Armenia
    Surviving Jack - Something to Talk About
    Bad Teacher - Pilot
    Sirens - There's No 'I' in Cream
    Anger Management - Charlie Spends the Night With Lacey
    Black Box - Kiss the Sky

    If it was just one show doing it once in a while, I wouldn't really worry about it, however when 8 shows do it on a single night, I'm waiting for 64GB of downloads, rather than 32GB.
    History file is attached, but auto.log is too large to attach on this forum.
     

    Attached Files:

  3. Apr 25, 2014 #6683 of 10407
    lpwcomp

    lpwcomp Active Member

    8,075
    2
    May 6, 2002
    John's...
    OK, I can duplicate at least part of the behavior. I record "Jeopardy!" on two different TiVos. One records the SD channel and one records the HD channel. I have an auto transfer entry for it, but it is normally set to transfer from a particular TiVo. I changed it to All, started "Loop in GUI" and ended up with 2 metadata jobs, one for each TiVo, the first one finished before the second one was added. So I'm thinking there is a timing issue.

    My suggestion to you would be to change the auto transfer entries to use a preferred TiVo rather than all.
     
  4. Apr 26, 2014 #6684 of 10407
    moyekj

    moyekj Well-Known Member

    11,130
    27
    Jan 23, 2006
    Mission...
    Yes, if you have auto entries set to look at all TiVos and you have duplicate recordings on different TiVos then this behavior is to be expected. The auto.history entry doesn't get added until after a successful download has completed (for cases where downloads are interrupted or fail), so it's possible to queue up same show on multiple TiVos when there's no auto.history entry preventing that.
    As lpwcomp suggested, for shows that you duplicate on both TiVos you should change the auto transfers setup to look for a particular TiVo instead of all.
     
  5. Apr 26, 2014 #6685 of 10407
    rad1701

    rad1701 Member

    173
    0
    Aug 17, 2003
    Ok, I'm getting closer on using kmttg. I turned off the 'Fast Transfer' setting in Tivo Desktop. So, I just tried using only kmttg this morning to move a new TV show from my Roamio to my PC and convert it (using the ff_h264_high_rate setting). I got some error messages below even though I did end up with a playable .mpg file. Any idea on these errors?

    Also - what is the best encoding profile to use to get the best looking hidef file (and one that VLC can play, can be later edited on video software, etc.)? Thanks for the help!

    [​IMG]
     
  6. Apr 26, 2014 #6686 of 10407
    moyekj

    moyekj Well-Known Member

    11,130
    27
    Jan 23, 2006
    Mission...
    I addressed this already in your previous post:
    http://www.tivocommunity.com/tivo-vb/showthread.php?p=10084065#post10084065
    (The double prefix problem is still there)
     
  7. Apr 26, 2014 #6687 of 10407
    rad1701

    rad1701 Member

    173
    0
    Aug 17, 2003
    Yeah, I see that now and fixing it. The weird thing is when I go to the Config area and use the files browser to select the directories that's the way it lists them in the config area. how about the second part of my question:

    What is the best encoding profile to use to get the best looking hidef file (and one that VLC can play, can be later edited on video software, etc.)? Thanks for the help!
     
  8. Apr 26, 2014 #6688 of 10407
    moyekj

    moyekj Well-Known Member

    11,130
    27
    Jan 23, 2006
    Mission...
    Best option for that is to not encode at all. VLC plays mpeg2 files and many editors handle mpeg2. i.e. Just enable "decrypt" task and nothing else.
     
  9. Apr 26, 2014 #6689 of 10407
    AudioNutz

    AudioNutz New Member

    318
    0
    Nov 9, 2008
    Yeah, this is very strange. Sometimes this happens on a single TiVo. I had one of the TiVo's turned off for several days, and it was doing it then as well. The other weird thing is, the shows are being recorded on the same TV network, at the same time. KMTTG's GUI shows the same Ep numbers, but switches it on the fly in auto-download, or loop in gui.

    This never happened when I had 3xSeries2 TiVo's with KMTTG, it just started when I switched to the HD units. I'm in the process of moving my KMTTG and pytivo services to a new PeeCee, we'll see if this problem follows.

    If it does, I'll try the setup change to look at particular TiVo for a particular show
     
  10. Apr 26, 2014 #6690 of 10407
    lpwcomp

    lpwcomp Active Member

    8,075
    2
    May 6, 2002
    John's...
    Based on preliminary testing, it looks like there is also a potential problem if the "Check TiVos interval" is less than the download time.
    But the timing would have to be just right (or wrong :).

    Some questions that haven't been asked or answered:

    Are you running the latest version of kmttg?

    Do you possibly have duplicate entries in the auto transfer list?

    Any chance you are running multiple instances of kmttg?
     
  11. Apr 26, 2014 #6691 of 10407
    moyekj

    moyekj Well-Known Member

    11,130
    27
    Jan 23, 2006
    Mission...
    Don't understand what you mean. What happens exactly? I'm really not following what you are saying.
    That's likely a mismatch between local TiVo guide data and the TiVo Mind server guide data. Since you have series 3 units and supply tivo.com login information the NPL is 1st populated with local data and then kmttg grabs server data to supplement, and episode numbers can change in that process. (You don't have to be in auto transfers mode to see that happen, simply refresh the NPL and wait for the "remote" job to finish). For series 2 units, "remote" jobs aren't supported at all so you had only local TiVo guide data. You can turn off the "remote" part if you want by not configuring kmttg with login information, but that is usually much worse as local guide data tends to have a lot of missing information, especially episode info.
     
  12. Apr 26, 2014 #6692 of 10407
    BankZ

    BankZ New Member

    188
    0
    Aug 16, 2007
    I was wrong. It happens with all themes (just not as bad). The latest versions don't seem stable on my Macs. I am going to have to try older versions
     
  13. Apr 26, 2014 #6693 of 10407
    AudioNutz

    AudioNutz New Member

    318
    0
    Nov 9, 2008
    Thanks for continuing to chat about this, guys. I think Kevin is on to something...
    Yes. When this started, I was on "p", but I moved to "r" when it was released recently.

    Great suggestion! I just checked, and no, I don't have any duplicates for these shows.

    I thought of that too. I've had two instances fighting each other in the past, and usually they fight each other for the TiVo server, and since it won't let you have two downloads at a time, one or the other just fails. These duplicates are happening in perfect sequence. But... I checked, and no multiples.

    What I'm saying is, three weeks ago I only had a single TiVo in the house, because the second one was out for some "soldering". During the time when I only had one single TiVo in the house, this duplicate download syndrome was happening.

    Now this is VERY promising. Remind me again the benefits of having my logon info in there? Remind me the difference between regular NPL vs. Remote NPL?

    I really appreciate the help on this. I bet theres a difference in the metadata vs. The mind server guide data! Thanks, TWC! :eek:
     
  14. Apr 27, 2014 #6694 of 10407
    moyekj

    moyekj Well-Known Member

    11,130
    27
    Jan 23, 2006
    Mission...
    I don't understand how the so-called duplicate download syndrome could apply to 1 unit unless you are somehow recording duplicates of shows on that unit which would be unusual.

    The "remote" task for series 3 units connects to middlemind.tivo.com to collect NPL information. As I mentioned, typically local guide data has holes such as missing episode information which the remote data collection can fill. That is one advantage of supplying logon information. It is also what allows some of the other limited Remote tab functionality available to series 3 units. (Series 4 and later units with RPC functionality have much more complete Remote tab functionality).
     
  15. Apr 27, 2014 #6695 of 10407
    lpwcomp

    lpwcomp Active Member

    8,075
    2
    May 6, 2002
    John's...
    I could be wrong, but I think there is some data available in the remote NPL that isn't there locally, and vice versa.

    Can't really blame TWC for this. It's all coming from TiVo.
     
  16. Apr 27, 2014 #6696 of 10407
    AudioNutz

    AudioNutz New Member

    318
    0
    Nov 9, 2008
    Right! I don't understand how that would happen either.

    LOL! I blame TWC for EVERYTHING! All kidding aside, I assumed that TiVo was getting the mind information from TWC. I blame TWC for my need to stay on S3 or earlier devices, and also the requirement for the soldering.

    Ok guys, like I said, I really appreciate the help on this. After some testing, I've discovered that removing my logon information does indeed help this. The trouble is, I needed to completely delete config.ini because deleting the logon information in the config window brings it right back the next time I open the window. I haven't figured out what process is bringing it back, but doing a very limited amount of config allows it to stay removed. I'm just guessing, but my prime suspect is configuring the pytivo tab allows KMTTG to steal the logon info from the pytivo.conf. It's not in the actual config.ini file, but it's in the GUI... Weird!

    Questions:
    1. I thought that the auto jobs were filtering by the number in the auto.history. Since these shows are placing a single entry in the auto.history, does it make sense that this mind data is causing this?
    2. Is there a way to solve this so the auto decision is made by the mind data, or the local data, rather than both, as it seems?
    3. Is there a way to use the pytivo tab, without it automagically putting the logon information in the TiVos tab?
     
  17. Apr 27, 2014 #6697 of 10407
    epstewart

    epstewart Member

    648
    0
    Mar 1, 2003
    Kevin,

    I've still been trying to see how to have my cake and eat it too, that is, download shows in a form that preserves closed captions on the Mac while allowing me to send shows back to the TiVo Roamio Plus still with captions intact -- and also allowing me to (if I want) decrypt and transcode the Mac copies at will, again preserving captions on the Mac and (when pulled back to the TiVo) showing captions on the TiVo.

    As we've said before, I can archive shows along with their captions if I download them to the Mac using the Program Option Download TiVo files in Transport Stream format in kmttg, creating a TS-format .TiVo file on the Mac that apparently cannot be decrypted or processed any further. It can, however, be pulled back to the TiVo with closed captions intact. Whether the pyTivo ts = on setting is used seems to make no difference in this scenario.

    I can also, in kmttg, leave the Program Option Download TiVo files in Transport Stream format unchecked and download the show in Program Stream (PS) format as a .TiVo file, and also decrypt that file into a .mpg (MPEG) file. It looks like both the .TiVo file and the .mpg file on the Mac retain closed captions.

    Then, using pyTivo on the Mac, I can transfer either of these files back to the TiVo by "pulling" them over to the TiVo from its Now Playing List (NPL).

    By the way, I put copies of the tdcat and tivodecode binaries from kmttg in pyTivo's /bin subdirectory. (It already had an ffmpeg binary there.) In pyTivo's Global Server Settings I set ts = on and I furnished my TiVo's Media Access Key (MAK) and (not relevant to this discussion?) my username and password at TiVo.com.

    I seem to be finding that the Mac's decrypted, PS-format .mpg file retains its closed captions when pulled back to the TiVo!

    I'm not sure whether providing tdcat and/or tivodecode binaries to pyTiVo was necessary to make that work, or whether I really needed to specify my MAK. Are tdcat, tivodecode, and my MAK really needed in this regard?

    Apparently, pyTiVo is using ffmpeg when it sends .mpg files back to the TiVo, correct?

    The Mac's un-decrypted, PS-format .TiVo file plays fine when pulled back to the TiVo, but lacks captions.

    I guess you have said it before, but please explain again why the decrypted PS version in a .mpg file, like the un-decrypted TS version in a .TiVo file, maintains closed captions all the way back to the TiVo, while the un-decrypted PS version (again in a .TiVo file) loses its captions when pulled back to the TiVo.

    One would think that since the decrypted PS version is derived from the un-decrypted version, the decrypted version would stand a better chance of winding up with missing captions.

    Is the explanation that using ffmpeg in the process of pulling a .mpg file to a TiVo is what allows captions to work?

    Thanks again for your help, Kevin.
     
  18. Apr 27, 2014 #6698 of 10407
    moyekj

    moyekj Well-Known Member

    11,130
    27
    Jan 23, 2006
    Mission...
    It's quite simple: with ts=on setting pyTivo will make sure transfers to TiVo are in mpeg2 transport stream container. So if you transfer decrypted .TiVo PS container files back using pyTivo, it will use ffmpeg to re-mux to TS container which is why things will work. TiVo Desktop OTOH will leave PS mpeg2 files alone and you don't get captions.
     
  19. Apr 27, 2014 #6699 of 10407
    epstewart

    epstewart Member

    648
    0
    Mar 1, 2003
    Thanks, Kevin, I think I now understand!
     
  20. Apr 28, 2014 #6700 of 10407
    ThAbtO

    ThAbtO TiVoholic by the bay

    6,715
    7
    Apr 6, 2000
    SF Bay Area
    It seems Resume Downloads are working again on Roamio under 20.4.1 as I just tested it with an old version v0p9i.

    Code:
    >> RESUMING DOWNLOAD WITH OFFSET=3599892480 i:\video\KPIX 5 News at Noon -  - (RAW) -  2014.04.28-12.00.TiVo ...
    http://192.168.1.120:80/download/KPIX%205%20News%20at%20Noon.TiVo?Container=%2FNowPlaying&id=16222
    Saved 1 queued jobs to file: jobData.dat
    i:\video\KPIX 5 News at Noon -  - (RAW) -  2014.04.28-12.00.TiVo: size=433.54 MB elapsed=0:02:07 (28.64 Mbps)
    ---DONE--- job=javadownload output=i:\video\KPIX 5 News at Noon -  - (RAW) -  2014.04.28-12.00.TiVo
    
    Downloaded the last 3.5 minutes of an 1/2 hr recording as a test.
     

Share This Page