1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Sharing commercial skip files

Discussion in 'TiVo Home Media Features & TiVoToGo' started by moyekj, Mar 5, 2016.

  1. innocentfreak

    innocentfreak Active Member

    8,968
    6
    Aug 25, 2001
    Florida
    Yeah unfortunately I don't have VRD so I just used the comskip included with KMTTG.

    I am downloading Colony 108 and The Family 101 now.
     
  2. innocentfreak

    innocentfreak Active Member

    8,968
    6
    Aug 25, 2001
    Florida
    Here are the zip files.
     

    Attached Files:

  3. moyekj

    moyekj Well-Known Member

    11,298
    100
    Jan 23, 2006
    Mission...
    OK thanks. So you don't have a way of checking/reviewing the data generated by comskip? Because looks to me your Colony comskip points are quite a bit off for me. It's best to have manually verified data to do this analysis otherwise we don't know if it's the algorithm failing or if the cut points are wrong.

    Note that for Windows there is a comskip GUI and a kmttg option to turn on comskip review with the GUI. config--Program Options--Use comskip GUI to review detected commercials. When GUI comes up press F1 to see instructions, and then you have to press Esc to close it (don't click on X).
     
    Last edited: Mar 6, 2016
  4. innocentfreak

    innocentfreak Active Member

    8,968
    6
    Aug 25, 2001
    Florida
    I will try that. I never mess with comskip so wasn't aware of an easy way to check it.
     
  5. moyekj

    moyekj Well-Known Member

    11,298
    100
    Jan 23, 2006
    Mission...
    FYI, I worked on this a little more with some more samples from reneg and looks like it can be pretty accurate in generating cuts accurate within 2-3 I-frames. However, given that this solution requires one to download a file in order to generate .srt captions file I think the appeal is very limited. If I have to take the time to download a show in order to generate .srt file anyway then I may as well spend the couple of minutes it takes to find and generate my own cut file using VideoRedo. So don't think this is worth pursuing much further given current limitations. If there was some other way to sync cut points somehow without requiring a download of anything then this would be a LOT more attractive.
     
  6. davidblackledge

    davidblackledge Registered l√úser

    483
    4
    Sep 9, 2008
    NM
    Well, those of us that just want it to work and don't want to manually process anything, it's valuable. I'd rather have a background process that says "download TS, extract srt, (generate automatic ad skip), delete download. Then import community ad detect file when available (instead of automatic one) so AutoSkip works when I play this later."

    In general, community ad vetting is worthwhile even without AutoSkip. It would be great to use that instead of automatic comskip to know your _cut file is reliable.

    People like me are cheap and lazy. We'll use the free comskip and don't want to take the time to check the values (especially since comskip's GUI is reallllllllly bad IMO - I've been thinking about how to make an alternate external GUI). If we could get quality from the people who care enough to manually edit their files and simply automatically share the result, then you get a lot of happy people.

    That said, there may be even more complexities to this process than you've found so far, so it might still be an awful lot of effort even beyond figuring out how to make this a service.
     
  7. moyekj

    moyekj Well-Known Member

    11,298
    100
    Jan 23, 2006
    Mission...
    One thing I did learn is for TS downloads not to use VRD QS Fix for decrypting for the purpose of importing skip files because it can alter the timing in the decrypted .ts file vs the original .TiVo file and therefore also affect the timing in the .srt caption file. Instead I had to switch to using tivolibre with DirectShow compatibility turned on (or DSD would have worked too). That preserved the timing properly. TS downloads are needed in order to make sure you don't get corrupted captions.

    Yeah, comskip GUI is essentially worthless. VRD is definitely the way to go for an editor and well worth the money.

    I guess I'll keep poking this concept some more and perhaps take it to the point where there is some mostly automated way to import a skip share given a zip file that contains a cut file and srt file, and then see where it goes from there.
     
  8. moyekj

    moyekj Well-Known Member

    11,298
    100
    Jan 23, 2006
    Mission...
    Version 2.1m of kmttg just released has some "hidden" functionality for importing skip data for someone that wants to try it.

    See SkipShareImport Wiki.

    For a sample skip share I've attached a zip file containing my .Vprj file and .srt file for season 1, episode 1 of the show "Of Kings and Prophets". If you don't have that recording then post here asking for a different one from the list of shows I posted earlier in this thread.

    If this turns out to be usable then of course the next step would be defining a server to hold he zip files and a mechanism for kmttg to find and download them automatically. But for now we'll just have to rely on manual downloads of zip files for testing this out.

    The GUI for doing the import is pretty crude right now but I think good enough for testing purposes.
     

    Attached Files:

  9. moyekj

    moyekj Well-Known Member

    11,298
    100
    Jan 23, 2006
    Mission...
    Since Grimm season 5 ep 12 is missing TiVo SKIP I generated AutoSkip data for it. Find it attached to this post.
     

    Attached Files:

  10. lew

    lew Active Member

    4,009
    9
    Mar 12, 2002
    Kevin. I should be able to recover from my RDF Hawaii Five O Elementary, Agent Carter and Blindspot. If you get a chance post Blindspot.
     
  11. moyekj

    moyekj Well-Known Member

    11,298
    100
    Jan 23, 2006
    Mission...
    Blindspot ep 11 is already posted in post #6 of this thread.
     
  12. moyekj

    moyekj Well-Known Member

    11,298
    100
    Jan 23, 2006
    Mission...
    So anybody tried this yet? I see a few downloads of the zip files. Any feedback/problems or is this all too confusing?
     
  13. keenanSR

    keenanSR Member TCF Club

    979
    6
    Oct 12, 2004
    Santa Rosa CA
    I've only been following the "how-to" casually, so in my case, I need to do a deeper reading of how it's all done. So for me, yes, it's somewhat confusing.
     
  14. lew

    lew Active Member

    4,009
    9
    Mar 12, 2002
    I didn't realize you had posted Blindspot. I wasn't interested until you updated kmttg. I gave it a go.

    Worked great. Maybe a second or two of commercial. It can't be exact, I like to err on the side of not missing part of the program. From my point of view the actual commercial skip was perfect.

    My bad in not reading documentation. I first just tried to get captions. Job bombed. I then decrypted the file then tried to extract captions. Bombed. Finally I converted the decrypted video from ts to mpg. Caption extraction worked.

    Suggestion: If you think sharing commercial skip is viable set up a job which does whatever is necessary to extract the subtitles.

    Observation--question. Downloading, decrypting, convert to mpeg file then extract captions takes time, I understand it can be automated. Suppose we skip the caption step but pad a second or two before and after the commercial break. Will that be close enough or will be looking for trouble.

    What you're doing is impressive. I can see using it if the process can be automated. Set up an "auto transfer" job so the captions are extracted soon after the recording is completed.
     
  15. moyekj

    moyekj Well-Known Member

    11,298
    100
    Jan 23, 2006
    Mission...
    There already is. If you press 'c' bindkey with an NPL show selected and the srt file is not already created, a dialog box comes up asking you if you want to download and create it. If you say OK then kmttg queues up all the necessary tasks to download and create it automatically (a combined download/decrypt followed by captions task). Then once the srt file is available press 'c' again and then it will be automatically set in the import form.

    More refinement and automation is needed, but for now the focus in on testing functionality. An option to pad the skip points by user specified # seconds is something I've mentioned previously and can pretty easily be coded in. I'm looking to see if there are cases when there are gross inaccuracies in skip points of more than a couple of seconds.
     
    Last edited: Mar 13, 2016
  16. lew

    lew Active Member

    4,009
    9
    Mar 12, 2002
    My post wasn't very well written my bad.

    I used the 'c' shortcut. The caption extraction bombed. I don't think the c job overrides the default configuration, if necessary. I'm set to download as ts streams, decrypt using VRD, and I don't have the tivolibre checked.

    I know you talked about an option to pad the skip points. I'm wondering/speculating if that option will allow us to skip creating a srt file from our recording.

    My other point/suggestion was to set up the caption extraction as an auto transfer job.
     
  17. moyekj

    moyekj Well-Known Member

    11,298
    100
    Jan 23, 2006
    Mission...
    It does override any configuration by forcing use of TS download and tivolibre for decrypt. I'd be interested to see message window contents you get when it "bombs out". (Make sure your tools package is up to date since ccextractor was updated a while back).

    EDIT: I seem to recall you're using a Mac though right? In that case the problem may be a too old version of ccextractor being used. Download latest version from here for your Mac:
    https://sourceforge.net/projects/ccextractor/
     
    Last edited: Mar 14, 2016
  18. lew

    lew Active Member

    4,009
    9
    Mar 12, 2002
    failed exit code

    edited to add:

    I'm running Windows 7. I'm using VRD, I don't think they have an Apple version.

    The "c" job downloaded, didn't decrypt and extraction failed.

    I think your logic assumes QS fix will be run to decrypt the tivo file but the c job doesn't bother with that step.

    I don't know if I had checked the option to decrypt using QS fix. My normal work flow is to download as tivo ts (encrypted), edit with VRD then decrypt during the cut/encode step. Depending on my source program I might skip the QS fix step.

    I think the options I'm selecting in configuration is affecting the way you process a c job.

    My 2 cents. Relatively few of kmttg have a licensed copy of VRD. I know what I have to do to make it work. I don't care if it's fixed but I'm willing to help trouble shoot if you want.

    I'm using current tools. I updated to the same version. I'll see if that makes a difference.
     
    Last edited: Mar 14, 2016
  19. garryj

    garryj New Member

    13
    0
    Sep 14, 2006
    Bellevue, WA
    I had used VRD to create my own skip points in Grimm(s05e12) prior to your release of v2.1n_beta, but after your release I cleaned out the target folder and ran through the "c" procedure to transfer the recording and create a local .srt caption file.

    The recording transfer and .srt file creation went without a hitch. On re-viewing using your caption file "diff" process, the skip points ended up fairly well placed. In a couple of places the ad ran for a couple of seconds before the skip took place, but the entry back into the program looked to be pretty good.

    The attached .zip has your original files with my local .srt added. Though it's likely not very useful, I included the .VProj file that has my manual edit skip points.
     

    Attached Files:

  20. moyekj

    moyekj Well-Known Member

    11,298
    100
    Jan 23, 2006
    Mission...
    No, as I mentioned above, for captions generation I force use of "tdownload_decrypt" and "captions" jobs regardless of your VRD settings. So if you delete your existing srt file and use the 'c' bindkey that's what kmttg should run to generate captions, and it should not bomb out. If it is bombing out I'd like to see the messages.
     

Share This Page