1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

New program for 1 step TTG downloads, decryption, encoding - kmttg

Discussion in 'TiVo Home Media Features & TiVoToGo' started by moyekj, Mar 15, 2008.

  1. Nov 1, 2012 #4381 of 10413
    lrhorer

    lrhorer Active Member

    6,924
    0
    Aug 31, 2003
    San...
    Fine, but what moyekj said and what you continue to say are completely different.

    Yeah, I got that.

    That's my point. Kmttg has never shown the OAD in the list of shows from the TiVos, to my knowledge. I wish it did, and indeed I requested that very feature 3 months ago in this post. See the subsequent conversations.

    I must be missing something, here. First of all, when you say "pull" I presume you mean pull from the PC to the TiVo (GoBack) not from the TiVo to the PC (TTG, or in context kmttg). To my knowledge no contents of any default.txt file has anything to do with the kmttg list of shows. The date shown by kmttg, both in the TiVo NPL window and the log file window is and always has been the date the show was recorded, according to the TiVo's response to the XML request from kmttg.

    Hmm. Maybe I am getting a glimmer of what you are saying. Are you saying the date reported by the TiVo only for shows transferred back to the Tivo from the PC are now being reported differently? If so, then moyekj is most certainly correct that this is a pyTivo / TiVo issue, since kmttg only reports what the TiVo tells it. OTOH, it also doesn't help me, at all, since I don't care about the OAD of transferred material, but do often care about the OAD of material not yet transferred from the TiVo to the PC.
     
  2. Nov 1, 2012 #4382 of 10413
    elprice7345

    elprice7345 Member TCF Club

    145
    0
    Sep 28, 2009
    Houston, TX
    My apologies for not understanding the code (I’m not a programmer) or using the correct terminology and therefore lengthening what I thought was a shorter conversation.

    Perhaps a screen capture from kmttg will help (attached).

    The top show was pulled from my PC to the TiVo before the update. It correctly displays the OAD from the metadata file. The bottom show has exactly the same metadata, but was transferred after the update. The kmttg date for the bottom show reflects the time I started transferring the show.

    The OAD displays correctly on my TiVo for both shows

    I've also attached the default.txt and metadata files in case that clarifies anything.

    My original point was that the TiVo reports the dates correctly, but kmttg is reporting the dates differently after the update.

    Is this something that can be fixed in kmttg, is it a pyTivo issue, or is it a bug introduced on the TiVo side?

    Ed
     

    Attached Files:

  3. Nov 1, 2012 #4383 of 10413
    moyekj

    moyekj Well-Known Member

    11,150
    33
    Jan 23, 2006
    Mission...
    I duplicated what you guys are seeing with the new TiVo software by experimenting with some pyTivo pulls.

    From what I could see from NPL XML (behavior with new Premiere software):
    There is a new entry called <ShowingStartTime> in the XML in addition to <CaptureDate>. The ShowingStartTime is influenced by metadata (time first else originalAirDate) while now the CaptureDate is purely the time at which you made the transfer. If there is no time information in metadata then ShowingStartTime is close to but not equal to CaptureDate.

    Older software XML (such as my S3 OLED unit):
    There is no <ShowingStartTime> entry, only <CaptureDate>.

    So it looks like the proper course of action now would be to use <ShowingStartTime> if available, else <CaptureDate>. I'll have to implement this for next release.
     
  4. Nov 2, 2012 #4384 of 10413
    lpwcomp

    lpwcomp Active Member

    8,081
    2
    May 6, 2002
    John's...
    It has nothing to do with code or terminology. The problem is that you continue to misunderstand what you are seeing. Before the update there were two date fields, the OAD and the recording date. What kmttg was displaying was the recording date, which it sees as "Capture Date". Now there are three fields, the OAD, the date of the original recording, and the date it was transferred which is what kmttg now sees as the "Capture Date". Only the first two are displayed by the TiVo.

    As I said before, the "time : OAD" entry in your default.txt file simply instructs pyTivo to set the record date/time to the same value specified for the originalAirDate.

    It is not a bug in pyTivo, the TiVo s/w or kmttg and in fact, IMHO, makes "capture date" more accurate as it now reflects the actual date/time the recording was made on that TiVo, rather than the date/time of the source recording.

    Having said that, I am in favor of the proposed change to kmttg.

    One more thing. If you ever end up with episodes of a series whose OAD is prior to @1970, having time : OAD is problematic as it might cause the TiVo to crash.
     
  5. Nov 2, 2012 #4385 of 10413
    moyekj

    moyekj Well-Known Member

    11,150
    33
    Jan 23, 2006
    Mission...
    I checked in the code with the changes last night and it seems to be working well.
     
  6. Nov 2, 2012 #4386 of 10413
    windracer

    windracer joined the 10k club

    11,580
    3
    Jan 3, 2003
    St. Pete, FL
    Quick encoding question ...

    I have been having problems with encoding recordings from CBS (1080i) downloaded via kmttg. The download and decrypt works fine, but ffmpeg seems to hang, leaving just a 42mb file. I am using this custom profile I created for use with AirVideo:

    Code:
    # Description (single line, keep short)
    <description>
    airvideo h264 + 2 channel aac encoding (1080i source)
    
    # Encode command or script (single line)
    # Known keywords: FFMPEG, HANDBRAKE, MENCODER, PERL, INPUT, OUTPUT, PWD, CPU_CORES, SRTFILE
    <command>
    /etc/tivo/airvideo/ffmpeg-for-airvideo -y -i INPUT -threads CPU_CORES -flags +loop -g 30 -keyint_min 1 -bf 0 -b_strategy 0 -cmp +chroma -refs 1 -coder 0 -me_range 16 -subq 5 -partitions +parti4x4+parti8x8+partp8x8 -trellis 0 -sc_threshold 40 -i_qfactor 0.71 -qcomp 0.6 -ss 0.0 -vcodec libx264 -vf crop=1920:1080:0:0,scale=800:448,pad=800:448 -aspect 800:448 -async 1 -f mp4 -crf 24 -qmin 24 -r 29.97 -ar 48000 -ac 2 OUTPUT
    
    # Encoded output file extension
    <extension>
    m4v
    
    I use the same profile for encoding shows off of other 1080i channels (like NBC) just fine, it only seems to fail on CBS shows, and even then not ALL the time, but enough to be annoying. I've seen this on BBT, HIMYM, and CSI.

    If I run the kmttg-generated encode command-line manually, I'll get this:

    Code:
    Output #0, mp4, to '/etc/tivo/togo/The Big Bang Theory - The Extract Obliteration (2012-11-01).m4v':
      Metadata:
        encoder         : Lavf53.0.3
        Stream #0.0: Video: libx264, yuv420p, 800x448 [PAR 1:1 DAR 25:14], q=24-31, 200 kb/s, 2997 tbn, 29.97 tbc
        Stream #0.1: Audio: aac, 48000 Hz, 2 channels, s16, 64 kb/s
    Stream mapping:
      Stream #0.0 -> #0.0
      Stream #0.1 -> #0.1
    Press [q] to stop encoding
    Input stream #0.1 frame changed from rate:48000 fmt:s16 ch:6 to rate:48000 fmt:s16 ch:2
    
    < snip out encoding frames ... and then >
    
    frame=  524 fps= 11 q=30.0 size=    2156kB time=16.32 bitrate=1082.5kbits/s dup=
    [mpeg @ 0x206cf60] Invalid timestamps stream=0, pts=1620028, dts=1620029, size=29737
    So it seems to be hanging on that "invalid timestamps" message. Is this an example of where something like QSF would help? I'm running kmttg on Linux so I don't have access to VideoRedo but I'm wondering if that's even the cause. Any ideas? Thanks!
     
  7. Nov 2, 2012 #4387 of 10413
    moyekj

    moyekj Well-Known Member

    11,150
    33
    Jan 23, 2006
    Mission...
    Yes, QSF most likely would fix the problem. Note that on Linux (or any platform) you can use ProjectX for QSF step, so no need for VRD as long as you don't mind losing captions.
     
  8. Nov 2, 2012 #4388 of 10413
    windracer

    windracer joined the 10k club

    11,580
    3
    Jan 3, 2003
    St. Pete, FL
    Cool, I'll give that a shot, thanks!

    edit: that worked! I've added the QSF step to all my auto-transfers from CBS which should take care of the problem. Thanks again!
     
  9. Nov 3, 2012 #4389 of 10413
    moyekj

    moyekj Well-Known Member

    11,150
    33
    Jan 23, 2006
    Mission...
    Anybody else with 20.2.2 software seeing some crazy Episode Numbers in kmttg NPL?

    For example, "Two and a Half Men" recorded Thu 11/1 is giving me episode # 25849648.
    I thought perhaps it was some weird bug in kmttg but checking the NPL XML from the TiVo that's exactly how it shows up there.
    Then I thought perhaps shows with more than 9 seasons perhaps were screwed up with 20.2.2 but I see for example "Dancing with the Stars" which is season 15 with correct episode #s so that's not it. Perhaps it was just a glitch in guide listings for that particular "Two and a Half Men" episode...
     
  10. Nov 3, 2012 #4390 of 10413
    lpwcomp

    lpwcomp Active Member

    8,081
    2
    May 6, 2002
    John's...
    Well both my Premieres have 20.2.2 and I am seeing weird episode #s for "Two and a Half Men", but the two facts are not related. The most recent episodes show ep #s of 25849648, 25819482, and 25819479 but they were recorded on and remain on my THD.
     
  11. Nov 3, 2012 #4391 of 10413
    moyekj

    moyekj Well-Known Member

    11,150
    33
    Jan 23, 2006
    Mission...
    OK thanks, so I think that proves it's a guide issue of some sort, not related to 20.2.2.
     
  12. Nov 3, 2012 #4392 of 10413
    moyekj

    moyekj Well-Known Member

    11,150
    33
    Jan 23, 2006
    Mission...
    v0p9a version just released.

    This contains new RPC "Deleted" tab which allows you to see and recover shows from Recently Deleted folder.

    Also adds a "Include History" boolean to the "Won't Record" tab that when enabled means past history will be included in the table so that one can explore why certain shows of interest did not record in the past.

    Finally includes update discussed above to properly list record dates for shows transferred to TiVos running the new 20.2.2 software.

    See release_notes for all the details.
     
  13. Nov 4, 2012 #4393 of 10413
    Beven

    Beven New Member

    10
    0
    Sep 6, 2011
    So after receiving the latest tivo update, I'm getting the following error when trying to transfer within kmttg:

    ---DONE--- job='REMOTE NP List' TiVo=LivingRoom
    >> DOWNLOADING D:\from_tivo\Shark Tank (11_02_2012).TiVo ...
    C:\kmttg\curl\curl.exe --retry 3 --anyauth --globoff --user tivo:MAK --insecure --cookie-jar C:\Users\Fdisk\AppData\Local\Temp\cookie3583094416204174099.tmp --url http://192.168.1.109:80/download/Shark Tank.TiVo?Container=/NowPlaying&id=227259 --output "D:\from_tivo\Shark Tank (11_02_2012).TiVo"
    D:\from_tivo\Shark Tank (11_02_2012).TiVo: size=0.00 MB elapsed=0:00:07 (0.00 Mbps)
    <h2>Server Busy</h2>
    Download failed to file: D:\from_tivo\Shark Tank (11_02_2012).TiVo
    Exit code: 0
    % Total % Received % Xferd Average Speed Time Time Time Current
    Dload Upload Total Spent Left Speed

    0 31 0 31 0 0 283 0 --:--:-- --:--:-- --:--:-- 283
    0 31 0 31 0 0 283 0 --:--:-- --:--:-- --:--:-- 0
    0 51 0 51 0 0 217 0 --:--:-- --:--:-- --:--:-- 217
    0 51 0 51 0 0 217 0 --:--:-- --:--:-- --:--:-- 0
    Warning: Transient problem: HTTP error Will retry in 1 seconds. 3 retries
    Warning: left.
    Throwing away 51 bytes

    0 51 0 51 0 0 653 0 --:--:-- --:--:-- --:--:-- 653
    0 51 0 51 0 0 653 0 --:--:-- --:--:-- --:--:-- 0
    Warning: Transient problem: HTTP error Will retry in 2 seconds. 2 retries
    Warning: left.
    Throwing away 51 bytes

    0 51 0 51 0 0 544 0 --:--:-- --:--:-- --:--:-- 544
    0 51 0 51 0 0 544 0 --:--:-- --:--:-- --:--:-- 0
    Warning: Transient problem: HTTP error Will retry in 4 seconds. 1 retries
    Warning: left.
    Throwing away 51 bytes

    0 51 0 51 0 0 544 0 --:--:-- --:--:-- --:--:-- 544
    0 51 0 51 0 0 544 0 --:--:-- --:--:-- --:--:-- 0
    Shark Tank (11_02_2012).TiVo: Download attempt # 2 scheduled in 10 seconds.
    No rows selected
    No rows selected


    Any ideas?
     
  14. Nov 4, 2012 #4394 of 10413
    moyekj

    moyekj Well-Known Member

    11,150
    33
    Jan 23, 2006
    Mission...
    Reboot the TiVo.
     
  15. Nov 4, 2012 #4395 of 10413
    Beven

    Beven New Member

    10
    0
    Sep 6, 2011
    Already tried twice :(
     
  16. Nov 4, 2012 #4396 of 10413
    elprice7345

    elprice7345 Member TCF Club

    145
    0
    Sep 28, 2009
    Houston, TX
    I saw the same episode issue before and after the update, but only with 2.5 Men.
     
  17. Nov 4, 2012 #4397 of 10413
    ThAbtO

    ThAbtO TiVoholic by the bay

    6,738
    8
    Apr 6, 2000
    SF Bay Area
    What did you do to reboot? Menu restart or power cut?
    Sometimes the menu restart will not fix the problem as a power cut can.
     
  18. Nov 4, 2012 #4398 of 10413
    Beven

    Beven New Member

    10
    0
    Sep 6, 2011
    All this system really does is just grab shows from tivo and encode, so not quite sure what went wrong. But after reinstalling Java and redownloading the latest kmttg, everything's transferring again.

    But now, after downloading shows, it's not able to delete them from the xl4:

    >> ENCODING WITH PROFILE 'hb_ipod' TO FILE D:\tivo_encoded\Top Gear - Best of 09-10 (11_03_2012).m4v ...
    C:\kmttg\handbrake\HandBrakeCLI.exe -i "D:\from_tivo\Top Gear - Best of 09-10 (11_03_2012).mpg" -t 1 -c 1 -f mp4 -I -X 320 -e x264 -b 700 -a 1 -E faac -B 160 -R 48 -6 dpl2 -D 0.0 -x level=30:bframes=0:cabac=0:ref=2:vbv-maxrate=768:vbv-bufsize=2000:analyse=all:me=umh:no-fast-pskip=1:subq=6:8x8dct=0:trellis=0:weightb=0:mixed-refs=0 -v 1 -o "D:\tivo_encoded\Top Gear - Best of 09-10 (11_03_2012).m4v"
    TWP Delete: connection failed: http://192.168.1.109:8080/confirm/del/268105
    java.net.ConnectException: Connection timed out: connect
     
  19. Nov 4, 2012 #4399 of 10413
    moyekj

    moyekj Well-Known Member

    11,150
    33
    Jan 23, 2006
    Mission...
    For an XL4 (or any series 4 machine) you should be using "Enable iPad style delete task" not "Enable TivoWebPlus Delete task".
    (You also have to turn on "Enable iPad style communications with this TiVo" under Config-Tivos for that TiVo if you haven't done so and you have to refresh the NPL with that enabled before you will be able to delete).
     
  20. Nov 4, 2012 #4400 of 10413
    elprice7345

    elprice7345 Member TCF Club

    145
    0
    Sep 28, 2009
    Houston, TX
    Thanks for quick turn around moyekj! I've tested and everything looks good for me.

    Also - the new enhancements are welcome additions!

    Thanks!!
    Ed
     

Share This Page