1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

New program for 1 step TTG downloads, decryption, encoding - kmttg

Discussion in 'TiVo Home Media Features & TiVoToGo' started by moyekj, Mar 15, 2008.

  1. Nov 17, 2010 #2841 of 10413
    HockeyFan

    HockeyFan Guest

    110
    0
    Oct 9, 2010
    Having issue with files being deleted after downloaded.

    I do not have 'delete .tivo file after download' checked.

    If I add just one file to the queue it downlads fine. If I add multiple files it deletes all but the last one after its downlads.

    I did re-install java prior to this problem. Is this a java issue? has anyone had this issue?

    I have all profiles removed and just download the tivo file to offload storage space. my only selection is the meta data.

    Thanks.
     
  2. Nov 17, 2010 #2842 of 10413
    sirfergy

    sirfergy New Member

    288
    0
    May 18, 2002
    I tried using the ShowAnalyzer proxy, but it doesn't seem to be doing anything. Is there something special I have to do?
     
  3. Nov 17, 2010 #2843 of 10413
    moyekj

    moyekj Well-Known Member

    11,150
    33
    Jan 23, 2006
    Mission...
    There is no "delete .tivo file after download" option. If all you have checked is "metadata" task then a download and metadata file generation is all that runs, no deletes are in effect regardless of option settings. So short of the downloads failing for some reason they should not get deleted. Queue up a couple of files and let them run through and then post the entire contents of the kmttg message window. It should be pretty obvious from that what is happening.
    Only other thing I can think of is if you have set the File Naming setting such that each show does not get a unique file name relative to other shows then possibly the shows are overwriting each other if you have Overwrite existing files option set, or not downloading at all if you have that option disabled.
     
  4. Nov 17, 2010 #2844 of 10413
    innocentfreak

    innocentfreak Active Member

    8,950
    3
    Aug 25, 2001
    Florida
    I haven't had a chance to play with it yet. Obvious question but did you also install and setup Show Analyzer?

    Worst case you can post on Show Analyzer forums.

    I am going to try to mess with it this weekend.
     
  5. Nov 17, 2010 #2845 of 10413
    moyekj

    moyekj Well-Known Member

    11,150
    33
    Jan 23, 2006
    Mission...
    Most likely nothing useful. It executes following url:
    Code:
    http://<tivoip>/TiVoConnect?Command=ResetServer
    
    That command was documented in HMO documentation (back when TiVo actually still had a web site with such information) but it most likely doesn't do anything useful, though the TiVo web server does accept the command.

    I don't know what to tell you about stalled and/or slow downloads. With both my S3 OLED and Premiere units I've never had those kinds of issues (downloading from various OSs including XP, Vista 64, Win 7 64 and Linux) so I do not have conditions to debug anything along those lines. Apparently the web servers in THD units are more prone to having those issues perhaps because they are too underpowered. If you are getting very slow transfers and/or stalls I would check the more obvious things you have control over such as:
    * Your network connections (wired is always better than wireless)
    * Firewall and antivirus software, especially Kaspersky and the like can cause issues.
     
  6. Nov 17, 2010 #2846 of 10413
    marbordom

    marbordom Member

    38
    0
    Sep 29, 2007
    Bronx, NY
    Thanks for the response.

    As to the Reset Web Server. I sometimes use it but have no clue if it actually re-enabled transfer of it the server just revived its functionality over night on its own.

    As to the stalled downloads: I made an experiment today in only downloading and decrypting 31 episodes of one show in SD quality. 22 of these 31 downloads have already completed w/o hickup while the Tivo did not record anything this afternoon. The test actually uses c:\cygwin\bin\curl.exe insteda of the 'java option' for download. Either SD or being 'idle' seems to help.

    My next test will be to run only HD shows and see how this goes before I re-enable the qsfix, adscan and adcut again. I noticed that some VideoRedo3.exe tasks stay alive when I restart the service. Is it possible that kmttg does not purge some of its processes like:
    cmd.exe /c ... VB script ...
    when net stop kmttg is called ?

    BTW: I am using Win 7 , connect Tivo and and Acer Revo via a 100MBit switch of a Buffalo router. Windows runs AVG and its own firewall.

     
  7. Nov 17, 2010 #2847 of 10413
    moyekj

    moyekj Well-Known Member

    11,150
    33
    Jan 23, 2006
    Mission...
    For something like VideoRedo note that is is really a 2 level deep command: a call to cscript which in turn initiates VideoRedo COM jobs. So by killing cscript alone this does not kill VideoRedo. For recent kmttg releases I use a scheme for the various VideoRedo scripts which monitors the presence of a file while it's running such that if the file is no longer present then VideoRedo exits. i.e. To kill a VideoRedo job it simply means deleting a file which causes VideoRedo and cscript jobs to exit. That's what happens under controlled circumstances. When shutting down service it may not be gracefully calling all appropriate kill procedures such as the above. In any case that should not be affecting downloads.

    The fact that your SD downloads work very well and your trouble is with HD downloads does seem to point the finger at the TiVo having trouble doing it's conversions properly for TTG transfers - either glitches in the stream or too big of a load for processor to handle (since HD files obviously involve more processing than SD files on TiVo side).
     
  8. Nov 17, 2010 #2848 of 10413
    sirfergy

    sirfergy New Member

    288
    0
    May 18, 2002
    It runs ok standalone, but executing comskip.exe (the proxy) doesn't seem to do anything.
     
  9. Nov 17, 2010 #2849 of 10413
    HockeyFan

    HockeyFan Guest

    110
    0
    Oct 9, 2010
    Download failed to file: G:\TIVO3\Avatar (11_06_2010).TiVo
    Exit code: 23

    curl: (23) Failed writing body (2293 != 10416)

    all files get same failure messages except last one in queue which succeeds.

    If I set one of the failed files to be last in another queue it will succeed.

    Had no problems for last three weeks.
     
  10. Nov 17, 2010 #2850 of 10413
    moyekj

    moyekj Well-Known Member

    11,150
    33
    Jan 23, 2006
    Mission...
    Check volume G (disk space, etc). curl is not able to write all the data properly to that volume is the error being printed out.
     
  11. Nov 17, 2010 #2851 of 10413
    ThAbtO

    ThAbtO TiVoholic by the bay

    6,738
    8
    Apr 6, 2000
    SF Bay Area
    It sounds like its overwriting the .tivo file as it downloads. Are you using the default filenaming scheme in your ocnfiguration?
     
  12. Nov 18, 2010 #2852 of 10413
    HockeyFan

    HockeyFan Guest

    110
    0
    Oct 9, 2010
    I was using drive that was reformated fat32.:eek: I was running out of space on several externals and used this one forgetting that I changed it to fat32 for ps3 backup. New drive comes today.

    donwloads now have no issues. Can not play older .tivo files using windows media player anymore. I found that video redo states that the media access key is wrong. .tivo files play fine on pc using tivo dekstop.

    Its been a long week at work and not paying attention to detail when at home.

    Is video redo worth purchasing to use for editing with kmttg?
     
  13. Nov 18, 2010 #2853 of 10413
    ThAbtO

    ThAbtO TiVoholic by the bay

    6,738
    8
    Apr 6, 2000
    SF Bay Area
    FAT32 has a limitation of 4GB on files, I use NTFS on Win XP. Most, if not all, of my transfers from Tivo HD are greater than 4GB.

    i use kmttg to transfer and decode to .mpg, then VideoReDo has no problems when I go to edit those commercials. Its well worth the cost. VideoReDo TVSuite also can make DVDs in single and double layer DVD-R's and DVD-RW's.
     
  14. Nov 19, 2010 #2854 of 10413
    HockeyFan

    HockeyFan Guest

    110
    0
    Oct 9, 2010

    Thanks. All past issues seem to be resolved. Look forward to try out editing shows this weekend.
     
  15. Nov 19, 2010 #2855 of 10413
    marbordom

    marbordom Member

    38
    0
    Sep 29, 2007
    Bronx, NY
    I noticed something in regards to failing downloads:

    While running kmttg v0p7q in GUI mode with Auto Transfers Loop in Gui enabled shows started to fail downloading again. The download was enabled via java not curl. After en/re enabling a few times with no effect I exited the GUI (via File->Exit)
    The error messages were all of kind:
    2010_11_17_19:55:26 ERROR: http IO exception for: http://192.168.0.20:80/download/Raising Hope.TiVo?Container=/NowPlaying&id=2209442
    2010_11_17_19:55:26 ERROR: Server returned HTTP response code: 503 for URL: http://192.168.0.20:80/download/Raising Hope.TiVo?Container=/NowPlaying&id=2209442

    which translates into: HTTP Error 503 - Service unavailable

    Then I accessed the Tivo via Firefox and tried to download manually.
    This gave the message:
    Server Busy
    too many transfers in progress

    I restarted kmttg this time with no Auto Transfers Loop in Gui so it was idling

    Since I have no other TTG client running I was sure that a process from kmttg must have been still running. Therefore in cygwin I issued: tasklist | grep java and found four java processes of which I killed the first three via
    taskkill /f /pid <pid>

    After this 'killing spree' kmttg began downloading again.

    So my observation is that even when exiting kmttg from the GUI a stuck java download kept running. I have a suggestion although am not a Java programmer I do this in my shell scripting sometimes:
    1) Is it possible to record the PID of each subprocess in a text file or the autlo.log.0 logfile ? That way once the user shuts down kmttg or its service it can be tracked if all processes are terminated
    Example:
    javadownload <args> <Showname> PID
    or
    curl.exe <arguments> <Showname> PID

    2) Or can an exit handler be coded which takes care of leaving no trace behind?
    3) Is there a way to restore functionality by decoding the HTTP error messages from the TIVO and then conditionally e.g. kill a download which is stuck / not making progress since it is blocking the queue?

    Note: This program is so good that I consider learning java.
     
  16. Nov 19, 2010 #2856 of 10413
    moyekj

    moyekj Well-Known Member

    11,150
    33
    Jan 23, 2006
    Mission...
    There already is a procedure that calls "kill" method for any job that is running if kmttg is closed, so under normal circumstances when you close kmttg there should not be anything left behind. It's easy to experiment with - for example start a "decrypt" job and then exit kmttg and then check if "tivodecode" is still running - it shouldn't be. Or switch to curl downloads and start a download and then exit kmttg and check if curl is still running. Depending on how kmttg is closed I suppose it may not be getting to the graceful exit which may be problem you are running into.
     
  17. Nov 20, 2010 #2857 of 10413
    Hcour

    Hcour Member

    870
    11
    Dec 24, 2007
    Now I can't transfer anything at all via kmttg. It says "Warning: Transient problem: HTTP error. Will retry in 4 seconds." None of the retries are successful.

    I tried via the web and it says "Server Busy. Too many transfers in progress."

    I'm not transferring anything and my Bittorrent client is closed.
     
  18. Nov 20, 2010 #2858 of 10413
    ThAbtO

    ThAbtO TiVoholic by the bay

    6,738
    8
    Apr 6, 2000
    SF Bay Area
    Guess its time to reboot the Tivo.
     
  19. Nov 20, 2010 #2859 of 10413
    moyekj

    moyekj Well-Known Member

    11,150
    33
    Jan 23, 2006
    Mission...
    It was a rather obscure issue but I tracked down why kmttg JVM did not always kill all running process and exit properly when closing kmttg GUI as is supposed to be the case. I've checked in the change for next release. If you would like to test it out generate build from latest SVN or PM me for a beta copy with the fix.
     
  20. Nov 20, 2010 #2860 of 10413
    marbordom

    marbordom Member

    38
    0
    Sep 29, 2007
    Bronx, NY
    Awesome,

    moyekj, your turnaround time is unbelievable. As to using the new code: I have never built the code from svn myself but if you have a pointer with instructions I will give it a try. This way I can learn and hopefully at some point contribute somehow to this project.
    Bug: So the actually bug in JVM only applies to exiting from running with the GUI but not when shutting down the service via net stop kmttg ? I am asking since usually I am running the service only and never observed this problem. But this week I was trying various options in the GUI and noticed the not-terminated processes.

     

Share This Page