1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

New program for 1 step TTG downloads, decryption, encoding - kmttg

Discussion in 'TiVo Home Media Features & TiVoToGo' started by moyekj, Mar 15, 2008.

  1. Nov 11, 2009 #1501 of 10413
    moyekj

    moyekj Well-Known Member

    11,143
    31
    Jan 23, 2006
    Mission...
    If download fails then file will not be deleted, so that's probably why.
     
  2. Nov 11, 2009 #1502 of 10413
    Stormspace

    Stormspace Electrocuted by TiVo

    5,171
    0
    Apr 13, 2004
    Hartsville, SC
    Does this work without Videoredo? What does Videoredo do?
     
  3. Nov 11, 2009 #1503 of 10413
    moyekj

    moyekj Well-Known Member

    11,143
    31
    Jan 23, 2006
    Mission...
    Yes, while VideoRedo is not required it is highly recommended if using with Series 3 Tivos.
    VideoRedo can be used for a few things in the kmttg flow:
    1. Quickstream Fix (batch mode). Digital cable recordings typically come with glitches which may cause issues such as A/V sync problems when trying to further process them to cut out commercials or encode to a different format. This tool is the only guaranteed solution to fix those kinds of issues. There are some free utilities out there which can help in some cases but I have tried them all and nothing comes close to VideoRedo's utility from my experience (and I'm sure others can attest to that as well).
    2. Review detected commercials (GUI mode). Give you an opportunity to review commercials detected by either comskip or by VideoRedo's own utility and to correct them (no commercial detection tool is perfect for all video sources).
    3. Cut out commercials (batch mode). Without VideoRedo kmttg uses mencoder to cut out commercials but especially if there are glitches in the source mpeg this can lead to A/V sync issues.
     
  4. Nov 11, 2009 #1504 of 10413
    BLKMGK

    BLKMGK New Member

    6
    0
    Dec 10, 2003
    Okay, I've fired it up as Admin and I've gone ahead and purchased the TVSuite product. I realize the higher end package isn't needed but I'm finding that I am liking some of the features so what the heck:) I will test some more and report back, if I can get this working in an automated fashion I'll be pretty happy! Just seems really weird to get those errors when I'd followed instructions :p

    FWIW, even with the Quickstream Fix failing etc. I've been able to use the trial product to cut the commercials manually and compress things with meGUI pretty well. No glitches but not quite at the quality level I'm looking for yet. If I can get this pretty close to what a torrented show looks like from HD media I'll be pretty happy. The encoder config files are no fun to play with but I'll keep tweaking. I'd be interested in knowing what folks find works best downsampling HD content. I'd like to get down to under 400megs for an hour show - we'll see.

    Thanks!

    Edit: Okay, not sure what fixed it but either the full registration or the running as Admin cleared those errors! I have noticed that VRD sometimes makes glaring errors with commercials, has anyone got settings better tuned than default for an automated flow?
     
  5. Nov 11, 2009 #1505 of 10413
    moyekj

    moyekj Well-Known Member

    11,143
    31
    Jan 23, 2006
    Mission...
    Took a while, but I finally found a mostly automated flow that I like that includes cutting out commercials and encoding to another format for my portable media player. In general I don't like using the commercial detection programs as they can take a while and are usually not accurate, so I usually do the commercial cutting myself, but to this point that meant breaking up a task set into at least 2 stages which was incovenient.

    In next release I've added a new VideoRedo related option called "Bring up VideoRedo to make manual cuts". If you have that option enabled and you enable the "Ad Cut" task what it does is before the "Ad Cut" task begins it will start VideoRedo GUI with the video file loaded in. Then you simply make the cuts and save the project and close VRD and then kmttg will proceed to the "Ad Cut" and subsequent tasks. Thus no need to break up the task set into 2 stages as I was doing previously.
    i.e. It's a way of running "vrdrerview" task without having to enable "Ad Detect" task.
     
  6. Nov 11, 2009 #1506 of 10413
    moyekj

    moyekj Well-Known Member

    11,143
    31
    Jan 23, 2006
    Mission...
    Comskip generally does a better job at commercial detection than VRD, but neither one is perfect most of the time.
     
  7. Nov 12, 2009 #1507 of 10413
    moyekj

    moyekj Well-Known Member

    11,143
    31
    Jan 23, 2006
    Mission...
    Just out of curiosity I tried out TiVo Desktop 2.8 (with Plus key) on a few .TiVo files to see if it could generate encoded files (I chose Apple iPod profile) with good A/V sync without the need for cleaning them up with VideoRedo. All 3 files I tried resulted in pretty badly out of sync mp4 encodings.

    So I really don't know how people using TiVo Desktop with recordings from digital S3 TiVos get by using that software... Seems to me like a flow using VideoRedo QS Fix is pretty much a must for me.
     
  8. Nov 12, 2009 #1508 of 10413
    spocko

    spocko TiVo HD

    432
    1
    Feb 4, 2009
    Interesting idea, but I think the terminology is a bit confusing. It sounds like you are talking about a manual "ad detect" followed by an automated "ad cut"? If so, a better name for the new option might be "Use VideoRedo for manual ad detect".

    If doing manual ad detect, does the automated ad cut provide much benefit? Seems like it would be easy enough for the user to also do the cut manually. That could open up the possibility of using other tools besides VRD. You could allow the user to configure the app to be used for manual detect+cut, e.g. VRD, Womble, etc. Kmttg could spawn the app and pass the input file as an arg. The user could make any desired cuts and save the result. The only caveat I can think of is that the user would have to save to the correct filename to allow kmttg to perform subsequent tasks.
     
  9. Nov 12, 2009 #1509 of 10413
    moyekj

    moyekj Well-Known Member

    11,143
    31
    Jan 23, 2006
    Mission...
    The key is integration with subsequent tasks without having to break up the task set into 2 or more stages.

    Previous flow using VRD for manual cuts:
    1. kmttg with metadata, decrypt, VRD QS Fix
    2. Open up VRD manually, find mpeg file, make manual cuts and save to a new file name.
    3. kmttg FILES mode for subsequent steps such as captions, encode, etc.
    OR
    1. kmttg with metadata, decrypt, VRD QS Fix, Ad Detect, Ad Cut, other tasks
    (Problem with this one is Ad Detect step takes a while and is usually not accurate and creates more work having to correct cut points).

    New flow using VRD for manual cuts with this option set:
    1. kmttg with metadata, decrypt, VRD QS Fix, Ad Cut, other tasks
    (Saves time skipping Ad Detect step and making it easier to define accurate cuts manually).

    Why still the Ad Cut task in kmttg? You hit on it - you still want to be able to use the kmttg file naming convention such that subsequent tasks know where to find the output file automatically.
     
  10. Nov 12, 2009 #1510 of 10413
    spocko

    spocko TiVo HD

    432
    1
    Feb 4, 2009
    Yeah, if the user was doing a manual cut, they would have to use the correct file naming convention and output folder when saving the output. That could be error prone, so it makes sense to do the automated cut if VRD is available. Maybe it's not worth the trouble to try to accommodate other apps.

    A related question: When automating things via VRD, does kmttg remove the VRD project files that it creates or does it leave them? I could envision people wanting it both ways. That could be a program option.
     
  11. Nov 12, 2009 #1511 of 10413
    moyekj

    moyekj Well-Known Member

    11,143
    31
    Jan 23, 2006
    Mission...
    There is a related none too obvious option under File Settings - "Remove .edl & .mpg files after comcut". Obviously that was created before VRD integration to remove comskip .edl file and .mpg file after Ad Cut job, but it will also look for and delete VRD .Vprj files if enabled. I have been asked before to have a separate option to remove .mpg file which makes sense but I never got around to implementing that yet. So some cleanup is past due in that area.
     
  12. Nov 12, 2009 #1512 of 10413
    spocko

    spocko TiVo HD

    432
    1
    Feb 4, 2009
    Cool, I had overlooked that option.
     
  13. Nov 13, 2009 #1513 of 10413
    Hcour

    Hcour Member

    869
    11
    Dec 24, 2007
    Planning on installing Windows 7 next wk. Should pytivo and kmttg work ok?
     
  14. Nov 13, 2009 #1514 of 10413
    PaulS

    PaulS Member

    674
    1
    Sep 16, 2002
    Southern NH
    I've been running pyTivo, kmttg and StreamBaby under Win7 64-bit for a few months now with no issues.
     
  15. Nov 13, 2009 #1515 of 10413
    Hcour

    Hcour Member

    869
    11
    Dec 24, 2007
    Exxxxxcellent! Thanks!
     
  16. Nov 14, 2009 #1516 of 10413
    CrispyCritter

    CrispyCritter Purple Ribbon Wearer

    3,646
    1
    Feb 28, 2001
    North...
    I'm trying out kmttg and pyTivo on a Ubuntu box - they're working very well together. I'm impressed with how solid things are, and kmttg has really become full-featured! Many thanks and kudos to the developers! A couple of questions and a few observations.
    Questions:
    1. When looking from a TiVo to a pyTivo video share, I want episode numbers to appear in the title. I'm currently doing this by munging the "episodeTitle" field in a kmttg custom script. Is that the "approved" method? (Other approaches seem to almost work, or work some of the time depending on pyTivo caching settings)
    2. Is there any way to tell kmttg which TiVo to autoload from? I've got some shows being recorded in SD on one TiVo and HD on another. Is it just luck which one I get?


    Observations/Bugs
    (I don't need any of these fixed for me, just things I happened to notice).
    1. Unlike other configure settings, FILES Default Path is not updated when you save configure (it starts working next kmttg invocation).
    2. With a massive autotransfer in GUI mode, the status/queue becomes unreadable because successful completion of tasks is not always picked up (many downloads listed as "Running", etc).
    3. I've got 3 shows that auto-transfer perfectly, once every hour for the past day! I assume the problem is they are episodes, but the metadata file is missing episodeNumber (my fault) so they don't get entered in auto.history?
    4. I get an awful lot of "server busy" errors. I assume most if not all are due to still running TiVo Desktop from another machine, but 1 in 5 transfers failing seems like a lot.
    5. Still a reference to "kmttg.pl" on the auto-transfer doc page.
    6. Took a couple tries to figure out what to do to avoid errors when saving 'configure' with programs like HandBrake I don't have (blanking out the program entry doesn't work, changing to /dev/null doesn't work, changing to /bin/cat works).
     
  17. Nov 14, 2009 #1517 of 10413
    moyekj

    moyekj Well-Known Member

    11,143
    31
    Jan 23, 2006
    Mission...
    Sounds like a good approach and good use of "custom" task to me.
    Not in current release. In upcoming release there is a TiVo filter available for each Auto Transfer entry as well as some global filters among other things.


    Yes, once File Browser is initiated it will keep last used value, so that setting only affects things when you first start kmttg GUI.

    auto.history is marked with programId entries (not episodeNumber since many shows don't have episodeNumbers) which are supposed to be unique for each program. Somehow I suppose those shows don't have programIds which I can't say I've seen before... Is there something special about those 3 programs? One potential way to avoid re-downloads is to turn off the "Overwrite existing files" and "Remove .TiVo after file decrypt" options.

    I never get "server busy" errors with my 2 S3 TiVos, but I'm not running TiVo Desktop.

    Thanks, fixed it.

    it's perfectly fine to ignore the error messages and save changes anyway - they are just there to alert you that you may have a wrong setting. On Linux there are some programs not available on that platform so there tends to be more of these errors printed.
     
  18. Nov 14, 2009 #1518 of 10413
    orangeboy

    orangeboy yes, I AM orangeboy!

    4,083
    0
    Apr 19, 2004
    East Moline, IL
    This sounds like the situation when a file gets pulled from a pyTivo share. The metadata for programId doesn't go with the show. I had the same problem when pyTivo push was giving me issues and I had to resort to manually pulling the shows instead. Pushing sets the shows to be copy protected, so kmttg doesn't attempt to download it (again).
     
  19. Nov 15, 2009 #1519 of 10413
    moyekj

    moyekj Well-Known Member

    11,143
    31
    Jan 23, 2006
    Mission...
    There is no pyTivo programId metadata tag available.
    I just checked with a pyTivo pull that the pulled pyTivo program does not have programId tag which means kmttg doesn't have a way to get a unique id for it:
    Code:
    <Item>
    ...
    <Details>
    <ContentType>video/x-tivo-raw-tts</ContentType>
    <SourceFormat>video/x-tivo-raw-tts</SourceFormat>
    ...
    <HighDefinition>No</HighDefinition>
    <ByteOffset>0</ByteOffset>
    <RecordingQuality>75</RecordingQuality>
    <TvRating>7</TvRating>
    </Details>
    ...
    </Item>
    
    A normally recorded program on the other hand does have programId:
    Code:
    <Item>
    ...
    <Details>
    <ContentType>video/x-tivo-raw-tts</ContentType>
    <SourceFormat>video/x-tivo-raw-tts</SourceFormat>
    ...
    <SourceChannel>702</SourceChannel>
    <SourceStation>KCBSDT</SourceStation>
    <HighDefinition>Yes</HighDefinition>
    <ProgramId>EP7128720112</ProgramId>
    <SeriesId>SH712872</SeriesId>
    ...
    </Details>
    ...
    </Item>
    
    So I think what I can do is if programId does not exist I will use the Url id instead. Example:
    Code:
    <Url>
    http://192.168.1.107:80/download/NUMB3RS.TiVo?Container=&#37;2FNowPlaying&id=2558207
    </Url>
    
    I'll grab the id from the end of the Url
     
  20. Nov 15, 2009 #1520 of 10413
    moyekj

    moyekj Well-Known Member

    11,143
    31
    Jan 23, 2006
    Mission...
    Since there is no guarantee the Url id should be unique, especially with multiple Tivos in the house what I've done is if ProgramId doesn't exist then make a fake ProgramId as urlid_size. That should be unique enough I think with very small chance for it to be repeated. Tried it out with a couple of pyTivo pulls and running auto transfers and now it's working great. This fix will be in upcoming release.
     

Share This Page