TiVo Community
TiVo Community
TiVo Community
Go Back   TiVo Community > Main TiVo Forums > TiVo Home Media Features & TiVoToGo
TiVo Community
Reply
Forum Jump
 
Thread Tools
Old 08-02-2010, 03:58 PM   #2491
marbordom
Registered User
 
Join Date: Sep 2007
Location: Bronx, NY
Posts: 27
So I ran kmttg since last night as "Run once in GUI". The result is:
2 Shows were downloaded and processed but the last one got stuck again.

There is no NOTE: Shutdown but other unrelated errors:
2010_08_02_10:36:43 ERROR: PARSE_MPEG12: add_frames(47498) failed, exit
2010_08_02_10:36:43 ERROR:
2010_08_02_10:36:46 >> Running custom command ...
2010_08_02_10:36:50 c:\cygwin\home\user\bin\postprocess.bat "e:\.tivo\CUT\Leverage - The Boost Job (08_01_2010)_cut.mpg" e:\TIVO
2010_08_02_10:37:53 NOTE: custom job completed: 00:01:02
2010_08_02_10:37:53 NOTE: exit code: 0
2010_08_02_10:37:53 ---DONE--- job=custom
2010_08_02_11:28:31 NOTE: Auto config settings saved
2010_08_02_11:30:22 NOTE: Removing job: {source=https://192.168.0.20:443/TiVoVideoDetails?id=1877957 tivoName=DVR5974 type=decrypt status=queued familyId=3.04}
2010_08_02_11:30:22 NOTE: Removing job: {source=https://192.168.0.20:443/TiVoVideoDetails?id=1877957 tivoName=DVR5974 type=comcut status=queued familyId=3.1}
2010_08_02_11:30:22 NOTE: Killing 'download' job: C:\kmttg\curl\curl.exe --retry 3 --anyauth --globoff --user tivo:MAK --insecure --cookie-jar C:\Users\user\AppData\Local\Temp\cookie751828343547506502.tm p --url http://192.168.0.20:80/download/Burn...ing&id=1877957 --output "e:\.tivo\ORIG\Burn Notice - Where Theres Smoke (07_29_2010).TiVo"
2010_08_02_11:30:22 ERROR: mpeg file not found: e:\.tivo\MPG\Burn Notice - Where Theres Smoke (07_29_2010).mpg
2010_08_02_11:30:23 >> CREATING e:\.tivo\CUT\Bewitched - Santa Comes to Visit and Stays and Stays (07_29_2010)_cut.mpg.txt ...
2010_08_02_11:30:23 C:\kmttg\curl\curl.exe --retry 3 --anyauth --globoff --user tivo:MAK --insecure --cookie-jar C:\Users\user\AppData\Local\Temp\cookie5702979565910547588.t mp --url https://192.168.0.20:443/TiVoVideoDetails?id=1845398 --output C:\Users\user\AppData\Local\Temp\meta1363277213042505942.tmp
2010_08_02_11:30:23 >> Running custom command ...
2010_08_02_11:30:23 c:\cygwin\home\user\bin\postprocess.bat "e:\.tivo\CUT\Burn Notice - Where Theres Smoke (07_29_2010)_cut.mpg" e:\TIVO
2010_08_02_11:30:25 NOTE: metadata job completed: 00:00:02
2010_08_02_11:30:25 ---DONE--- job=metadata output=e:\.tivo\CUT\Bewitched - Santa Comes to Visit and Stays and Stays (07_29_2010)_cut.mpg.txt
2010_08_02_11:30:26 >> DOWNLOADING e:\.tivo\ORIG\Bewitched - Santa Comes to Visit and Stays and Stays (07_29_2010).TiVo ...
2010_08_02_11:30:26 C:\kmttg\curl\curl.exe --retry 3 --anyauth --globoff --user tivo:MAK --insecure --cookie-jar C:\Users\user\AppData\Local\Temp\cookie2672569525425738517.t mp --url http://192.168.0.20:80/download/Bewi...ing&id=1845398 --output "e:\.tivo\ORIG\Bewitched - Santa Comes to Visit and Stays and Stays (07_29_2010).TiVo"
2010_08_02_11:30:39 NOTE: custom job completed: 00:00:15
2010_08_02_11:30:39 NOTE: exit code: 0
2010_08_02_11:30:39 ---DONE--- job=custom

The last show: starting in log as '2010_08_02_11:30:26 >> DOWNLOADING' was now stuck with no increasing file size ~585 out of 750 MB
I noticed that after this happened two curl processes show up in task manager even if kmttg is closed.

After that I captured the curl command:
and ran it in a command shell. It also gets stuck at 585 MB. Interesting is that the downloaded size stays at 585MB and the download rate drops almost linear while the process is stuck.
So I have Windows Firewall turned off now and retry. The next step is to kill all curl processes prior.
marbordom is offline   Reply With Quote
Old 08-03-2010, 02:12 PM   #2492
Tiresius
Registered User
 
Join Date: Mar 2004
Location: Mesa, AZ
Posts: 34
Audio Sync issue with ffmpeg(but not HB)

Kevin(&all),

First off, great program. I remember years ago you were building some excellent tools for the Motorola 64xx DVR's before you joined the Tivo ranks(I think you had some replaytv boxes too).

I'm testing kmttg to move HD shows from my Series 3 Tivo to my iPad to watch while travelling. My test cases have been with 1080i recordings of the CBS series "Flashpoint".

Everything has gone great and they look great, except for an audio sync issue when using ffmpeg. The audio lags behind the video by almost 2 seconds. It happens from the beginning of the video and stays the same throughout(it does not get progressively worse). The issue occurs and seems the same with both episodes that I have tested. The issue can be observed by watching the file in iTunes or Quicktime(i.e. you don't need an iPad to see it) I'm aware that video redo can be used to fix some sync issues, but I'm not sure this is the type it fixes.

I'm using the ff_ipad profile, but modified it to higher resolution as I'm more concerned about res than file size since I'll watch once and delete.
I did find an "-async 1" switch that I tried, but it made no difference.

Here's the current command line in my .enc file:
FFMPEG -async 1 -y -i INPUT -threads CPU_CORES -vcodec libx264 -level 31 -subq 6 -me_range 16 -qmin 10 -qmax 50 -g 300 -s 1280xHEIGHT -r 29.97 -b 2500k -maxrate 4000k -acodec aac -ac 2 -ab 160k -ar 48000 -f mp4 OUTPUT

I don't know what most of the switches are, but the only thing I modified is adding the "-async 1" and changed "-s 1280xHEIGHT) to get 1280x720 resolution.

FYI, the Tivo file and MPG file do not have the audio sync issue.
I also tried handbrake(from the HB gui) and did not have the sync issue.
Also, after avoiding it for years -I actually bought Tivo Desktop Plus to test this. The audio sync issue does not occur, but the video looks like s^#t since the resolution they use for ipad is 640x360(WTF!), and you have no control to change it. Wish I could get that money back...

I would just use HB, but it is ridiculously SLOW, took 3 1/2 hours to do the same episode that ffmpeg did in about an hour.
In HB I used an the AppleTV profile at 960x544, with the AAC audio codec mixed down to Dolbly Pro Logic II.

Any thoughts?

Last edited by Tiresius : 08-03-2010 at 02:42 PM.
Tiresius is offline   Reply With Quote
Old 08-03-2010, 05:43 PM   #2493
moyekj
Registered User
 
Join Date: Jan 2006
Location: Mission Viejo, CA
Posts: 9,300
Tiresius, yeah the good 'ole ReplayTV days were great...
VideoRedo QS Fix does fix glitches in the original mpg files such that when they are re-encoded the A/V sync issues go away, so that's the most reliable way to go.

The ffmpeg -async parameter can work. Note that -async 1 is a special case which only tries to fix sync issue at the very start of the stream.
This from the ffmpeg docs:
Quote:
Originally Posted by ffmpeg docs
`-async samples_per_second'
Audio sync method. "Stretches/squeezes" the audio stream to match the timestamps, the parameter is the maximum samples per second by which the audio is changed. -async 1 is a special case where only the start of the audio stream is corrected without any later correction.
So you can try with a much bigger async number such as -async 4800. Note that if sync is too far off that the audio stream correction may distort audio too much though and I saw in the past that using -async parameter can actually crash ffmpeg at times if timestamps are corrupted which is why I don't use it in default profiles. Can't hurt to try it though...

P.S. There is some limited control over TD+ profiles you can achieve by editing xml files - search this forum for xml perhaps to find them. However there is little you can do and typically I don't think you can go higher resolution than the intended target device supports, which is probably TiVo protecting itself from content providers in case someone tries to use TD+ to generate high quality encryption free encodings to distribute over internet.
__________________
Roamio Pro, Elite, Premiere
Cox - Motorola CableCards & TAs
Slingbox 350 via TiVo Mini & TiVo Stream for remote viewing

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.


To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

Last edited by moyekj : 08-03-2010 at 05:51 PM.
moyekj is offline   Reply With Quote
Old 08-03-2010, 06:39 PM   #2494
AudioNutz
Registered User
 
Join Date: Nov 2008
Posts: 302
Have you tried -async 50 ?
__________________
I am the Stig
AudioNutz is offline   Reply With Quote
Old 08-03-2010, 07:45 PM   #2495
Tiresius
Registered User
 
Join Date: Mar 2004
Location: Mesa, AZ
Posts: 34
Quote:
Originally Posted by AudioNutz View Post
Have you tried -async 50 ?
Based on your's and Kevin's suggestion, I'll try -async 50 or 4800.

FYI, I did try the default hb_appletv profile from kmttg. Worked, no audio sync issues, but it took HandBrake 4 1/2 hours vs. about an hour with ffmpeg.

Kevin, on the TD+, I'll fish around for the xml info and see what I come up with. Since the native display of the device is 1024x768 and Apple's recommendations for video are 1280x720 or 960x544, I just can't see a legitimate reason for Tivo do use such a low-res, other than maybe filesize.

My encodes with mtttg have been running about 1-1.2Gb for the 1-hour program.

I'll let you know if I have any luck with ffmpeg.

Cheers,
Ray
Tiresius is offline   Reply With Quote
Old 08-04-2010, 07:16 AM   #2496
ferror
Registered User
 
Join Date: May 2005
Location: Austin, TX
Posts: 65
Quote:
Originally Posted by marbordom View Post
So I ran kmttg since last night as "Run once in GUI". The result is:
2 Shows were downloaded and processed but the last one got stuck again.
Just wanted to weigh in that I also recently started having the problem with downloads getting stuck for no reason. I have been running kmttg for several months without this particular problem, but something just recently changed. Maybe it is a Windows update, but not sure. The last time this worked was using the same version of kmttg (v0p7l) and curl (7.20.0) under Windows 7 x64. Downloads will progress to some random point in the file and then the flow of data simply stops, but curl is still running indefinitely. Cancelling the stuck download will get the next file downloading for awhile, but I have to add that file back to the bottom of the list. I can't quantify this (just a hunch), but it seems like it happens a little more frequently when the machine in under heavy load.

This makes the whole experience very tedious now.
ferror is offline   Reply With Quote
Old 08-04-2010, 08:11 AM   #2497
marbordom
Registered User
 
Join Date: Sep 2007
Location: Bronx, NY
Posts: 27
stuck curl downloads

Quote:
Originally Posted by ferror View Post
Just wanted to weigh in that I also recently started having the problem with downloads getting stuck for no reason. I have been running kmttg for several months without this particular problem, but something just recently changed. Maybe it is a Windows update, but not sure. The last time this worked was using the same version of kmttg (v0p7l) and curl (7.20.0) under Windows 7 x64. Downloads will progress to some random point in the file and then the flow of data simply stops, but curl is still running indefinitely. Cancelling the stuck download will get the next file downloading for awhile, but I have to add that file back to the bottom of the list. I can't quantify this (just a hunch), but it seems like it happens a little more frequently when the machine in under heavy load.

This makes the whole experience very tedious now.
Thanks ferror. Knowing that I am not the only person having that problem let me think I am not crazy. Your description is exactly the same I experience. I have finally noticed finally that firewall, User Access Contol and other nonsense are not the problem. Curl will get stuck on mu Win7 system either in service, GUI mode or even when I issue the command in a command shell. That said: I can download the same show showing the stuck download via curl from a MacBook in a shell. Also running iTivo runs smooth.
That said all indicators point to a Windows problem and not a Tivo, kmttg or curl problem themselves. As suggested I also bet my pennies on a Windows update .. but which one ..
marbordom is offline   Reply With Quote
Old 08-04-2010, 09:06 AM   #2498
AgtScully
Registered User
 
Join Date: May 2009
Posts: 10
Quote:
Originally Posted by marbordom View Post
Thanks ferror. Knowing that I am not the only person having that problem let me think I am not crazy. Your description is exactly the same I experience. I have finally noticed finally that firewall, User Access Contol and other nonsense are not the problem. Curl will get stuck on mu Win7 system either in service, GUI mode or even when I issue the command in a command shell. That said: I can download the same show showing the stuck download via curl from a MacBook in a shell. Also running iTivo runs smooth.
That said all indicators point to a Windows problem and not a Tivo, kmttg or curl problem themselves. As suggested I also bet my pennies on a Windows update .. but which one ..
Marbordom, maybe you’re on to something with the Windows 7 update theory. I'm having a similar problem where the “RUN IN GUI” works fine but kmttg in service mode will shut down on its own . The debug log has me and moyekj scratching our heads.
AgtScully is offline   Reply With Quote
Old 08-04-2010, 11:37 AM   #2499
Network_Guy
Registered User
 
Join Date: Apr 2010
Posts: 5
Question kmttg and VideoReDo "qsfix failed"

I am running VideoReDo on WHS.

When I run the VideoReDo from a console, QuickStream Fix runs fine. When I manually start kmttg and have it run VideoReDo QSFIX, it also runs fine.

The problem happens when kmttg runs automatically as a service.

Any suggestions?

Thanks,
__________________
John
Network_Guy is offline   Reply With Quote
Old 08-04-2010, 04:25 PM   #2500
ThAbtO
TiVoholic by the bay
 
ThAbtO's Avatar
 
Join Date: Apr 2000
Location: SF Bay Area
Posts: 4,989
Quote:
Originally Posted by ferror View Post
Just wanted to weigh in that I also recently started having the problem with downloads getting stuck for no reason. I have been running kmttg for several months without this particular problem, but something just recently changed. Maybe it is a Windows update, but not sure. The last time this worked was using the same version of kmttg (v0p7l) and curl (7.20.0) under Windows 7 x64. Downloads will progress to some random point in the file and then the flow of data simply stops, but curl is still running indefinitely. Cancelling the stuck download will get the next file downloading for awhile, but I have to add that file back to the bottom of the list. I can't quantify this (just a hunch), but it seems like it happens a little more frequently when the machine in under heavy load.

This makes the whole experience very tedious now.
I have seen this issue under v0p7l under Win XP. I haven't seen it under v0p7j.
__________________
Series 2 (PLS, sold)
TiVo HD 1TB (157 HD Hrs, PLS, "652")
Roamio! Oh, wait, Its Juliet!
OTA! OTA! OTA!

~~~~~

The TiVo Apocalypse begins on Sat 2013 Feb 16 00:00 GMT!
ThAbtO is offline   Reply With Quote
Old 08-04-2010, 04:48 PM   #2501
moyekj
Registered User
 
Join Date: Jan 2006
Location: Mission Viejo, CA
Posts: 9,300
Quote:
Originally Posted by Network_Guy View Post
I am running VideoReDo on WHS.

When I run the VideoReDo from a console, QuickStream Fix runs fine. When I manually start kmttg and have it run VideoReDo QSFIX, it also runs fine.

The problem happens when kmttg runs automatically as a service.

Any suggestions?

Thanks,
Make sure service is setup to use same account you run the GUI in. See section on windows service in:
http://code.google.com/p/kmttg/wiki/auto_transfers
__________________
Roamio Pro, Elite, Premiere
Cox - Motorola CableCards & TAs
Slingbox 350 via TiVo Mini & TiVo Stream for remote viewing

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.


To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
moyekj is offline   Reply With Quote
Old 08-04-2010, 06:22 PM   #2502
AudioNutz
Registered User
 
Join Date: Nov 2008
Posts: 302
Quote:
Originally Posted by Tiresius View Post
...but it took HandBrake 4 1/2 hours vs. about an hour with ffmpeg...
Is this on Windows or Mac?
__________________
I am the Stig
AudioNutz is offline   Reply With Quote
Old 08-04-2010, 07:26 PM   #2503
Tiresius
Registered User
 
Join Date: Mar 2004
Location: Mesa, AZ
Posts: 34
Quote:
Originally Posted by AudioNutz View Post
Is this on Windows or Mac?
Windows XP, Athlon 64 4200+ dual-core. Yeah, I know pretty old, but it's the difference between ffmpeg and HB that's shocking.

In repeated recodes, it's actually 90 minutes for ffmpeg vs. the hour I said before. But it is 4 1/2 hours for HB.

FYI, running videoredo stream fix before encoding with ffmpeg did make the sync issue go away. Before running videoredo, I did test -async 100 and 4800 with ffmpeg, no help.
Odd that the issue didn't occur when using HB, Tivo Desktop +, or Pavtube Converter and did not occur when playing the two original .mpg files that I was testing with.

For the price of VideoRedo, I could buy Roxio 2010, which would take advantage of the 32 CUDA cores in my Nvidia Graphics card, potentially speeding up my conversion over what my 5 year old CPU can do. I wish they had a trial version that I can test it with.
Tiresius is offline   Reply With Quote
Old 08-04-2010, 10:14 PM   #2504
AudioNutz
Registered User
 
Join Date: Nov 2008
Posts: 302
Well... If it were a Mac, I would have told you about a bug that I found in handbrake, where speed takes a 4x hit.

I'm having trouble recalling the exact reason, but it seems that if you give it a set of resolutions, it was doing something funny with the aspect ratio. This happened at 1x the speed of ffmpeg. But... If you coerced the aspect ratio back to be correct, the encoding process needed to scale each frame of the video as it processed, and this took 4x the amount of time.

Open source developers are typically very difficult to convince that their stuff has a bug... so I gave up, and I'm still using ffmpeg. It's certainly not perfect, but it's what i got...

Maybe the same 'bug' exists on the Windows side! Try taking out the aspect ratio and resolution settings, and encode a show again. If it speeds back up... Bingo, same bug.

....er.... Ummm... "Un-Documented Feature"
__________________
I am the Stig
AudioNutz is offline   Reply With Quote
Old 08-04-2010, 11:15 PM   #2505
moyekj
Registered User
 
Join Date: Jan 2006
Location: Mission Viejo, CA
Posts: 9,300
Quote:
Originally Posted by Tiresius View Post
FYI, running videoredo stream fix before encoding with ffmpeg did make the sync issue go away. Before running videoredo, I did test -async 100 and 4800 with ffmpeg, no help.
Odd that the issue didn't occur when using HB, Tivo Desktop +, or Pavtube Converter and did not occur when playing the two original .mpg files that I was testing with.
Yes, VRD fixes broken timestamps in the original mpeg files. ffmpeg is not good at dealing with broken timestamps. For HB if you double-click on the job in kmttg while it's running you will actually see some information spit out about timestamp correction that HB is doing, and it does so by modifying the audio stream. That is supposed to be what ffmpeg -async does as well but obviously that is broken in ffmpeg...

In any case, VRD is useful to have to precisely edit out commercials and note that you only really need the $50 VideoRedo Plus for QSFix, you don't need the $100 TVSuite version, so well worth it IMO.

P.S. At some point I need to get around modifying HB encodes to actually show % progress in kmttg - a relatively simple thing to do I never got around to (mostly because I never use HB).
__________________
Roamio Pro, Elite, Premiere
Cox - Motorola CableCards & TAs
Slingbox 350 via TiVo Mini & TiVo Stream for remote viewing

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.


To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
moyekj is offline   Reply With Quote
Old 08-05-2010, 05:42 AM   #2506
ferror
Registered User
 
Join Date: May 2005
Location: Austin, TX
Posts: 65
Quote:
Originally Posted by ThAbtO View Post
I have seen this issue under v0p7l under Win XP. I haven't seen it under v0p7j.
That is interesting that it also shows up in XP. I guess it isn't just Windows 7, but I do still believe it may have been a Windows update that started this. I have had no luck solving the issue, but it does appears to be a curl problem. I can also replicate the same behavior (stalled transfers) when running curl with the same parameters (copy/pasted from the kmttg log) directly at the command line outside of kmttg. I noticed there was a newer version of curl so I tried that, but it has no effect on the issue.

I have found one crude workaround that seems to help a small amount. If I add the parameters: "-y 60 -Y 100" to the curl command line, then curl will at least detect that the transfer has stalled and restart the download. Unfortunately, resuming a download (-C) does not seem to work with the TiVo. I guess the http service on the TiVo doesn't support resume. That said, this does at least seem to be able to kick the transfer and allow it to use the set retry count to get the whole file. It isn't 100%, but helps considerably. It can result in total download times of 3 or 4 times normal, however, because it gets on average 50% into the file and then stalls out. At this point, anything is better than literally having to babysit kmttg 24 hours a day to keep curl going.

To get kmttg using the above command line parameters, I did have to modify my local copy of kmttg by adding the following lines to src/com/tivo/kmttg/task/download.java beginning at line 99:

command.add("-y");
command.add("60");
command.add("-Y");
command.add("100");

Maybe it is time to take this issue over to the curl bug tracker and find out what they think.
ferror is offline   Reply With Quote
Old 08-05-2010, 08:23 AM   #2507
Network_Guy
Registered User
 
Join Date: Apr 2010
Posts: 5
Quote:
Originally Posted by moyekj View Post
Make sure service is setup to use same account you run the GUI in. See section on windows service in:
I change the properties so that kmttg would use the Administrator account on WHS and VideoReDo ran perfectly.

Thanks,
__________________
John
Network_Guy is offline   Reply With Quote
Old 08-05-2010, 10:38 AM   #2508
moyekj
Registered User
 
Join Date: Jan 2006
Location: Mission Viejo, CA
Posts: 9,300
Quote:
Originally Posted by ferror View Post
That is interesting that it also shows up in XP. I guess it isn't just Windows 7, but I do still believe it may have been a Windows update that started this. I have had no luck solving the issue, but it does appears to be a curl problem. I can also replicate the same behavior (stalled transfers) when running curl with the same parameters (copy/pasted from the kmttg log) directly at the command line outside of kmttg. I noticed there was a newer version of curl so I tried that, but it has no effect on the issue.

I have found one crude workaround that seems to help a small amount. If I add the parameters: "-y 60 -Y 100" to the curl command line, then curl will at least detect that the transfer has stalled and restart the download. Unfortunately, resuming a download (-C) does not seem to work with the TiVo. I guess the http service on the TiVo doesn't support resume. That said, this does at least seem to be able to kick the transfer and allow it to use the set retry count to get the whole file. It isn't 100%, but helps considerably. It can result in total download times of 3 or 4 times normal, however, because it gets on average 50% into the file and then stalls out. At this point, anything is better than literally having to babysit kmttg 24 hours a day to keep curl going.

To get kmttg using the above command line parameters, I did have to modify my local copy of kmttg by adding the following lines to src/com/tivo/kmttg/task/download.java beginning at line 99:

command.add("-y");
command.add("60");
command.add("-Y");
command.add("100");

Maybe it is time to take this issue over to the curl bug tracker and find out what they think.
That is odd. curl has been very reliable for me for downloads over the years (with and without using kmttg). It may be interesting experiment for a show that has this problem to try it directly via a web browser to see if there are any issues that way. If that proves more reliable then perhaps a module to bypass using curl for downloads in kmttg could be useful.
__________________
Roamio Pro, Elite, Premiere
Cox - Motorola CableCards & TAs
Slingbox 350 via TiVo Mini & TiVo Stream for remote viewing

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.


To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
moyekj is offline   Reply With Quote
Old 08-05-2010, 11:01 PM   #2509
marbordom
Registered User
 
Join Date: Sep 2007
Location: Bronx, NY
Posts: 27
Quote:
Originally Posted by moyekj View Post
That is odd. curl has been very reliable for me for downloads over the years (with and without using kmttg). It may be interesting experiment for a show that has this problem to try it directly via a web browser to see if there are any issues that way. If that proves more reliable then perhaps a module to bypass using curl for downloads in kmttg could be useful.
As I have experienced this I do not think that it is a curl issue per se.
Only running curl under my Win7 shows the problem. Curl 7.19.7 e.g under Mac OS downloads the entire show w/o stalling. Of course it could be a Windows plus curl issue instead of either or. Just for the fun of it I have installed kmttg v0p7j. See if that makes any difference (according to my own statements it should not) but hell It's Windows - everything is possible !

I found an 1.5 year old thread on curl which is pretty much what could be happening her:
http://curl.haxx.se/mail/tracker-2009-02/0022.html

Last edited by marbordom : 08-06-2010 at 01:49 AM. Reason: New info
marbordom is offline   Reply With Quote
Old 08-06-2010, 02:46 AM   #2510
moyekj
Registered User
 
Join Date: Jan 2006
Location: Mission Viejo, CA
Posts: 9,300
For those with windows having curl hanging issues perhaps try the latest 7.21.0 version which you can download from here to see if behavior is any better:
http://kmttg.googlecode.com/files/curl-7.21.0_win32.zip
Rename the current "curl" folder in kmttg installation to something else and then install this one as the new "curl" folder.
__________________
Roamio Pro, Elite, Premiere
Cox - Motorola CableCards & TAs
Slingbox 350 via TiVo Mini & TiVo Stream for remote viewing

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.


To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
moyekj is offline   Reply With Quote
Old 08-06-2010, 04:34 AM   #2511
ferror
Registered User
 
Join Date: May 2005
Location: Austin, TX
Posts: 65
Quote:
Originally Posted by marbordom View Post
As I have experienced this I do not think that it is a curl issue per se.
Only running curl under my Win7 shows the problem. Curl 7.19.7 e.g under Mac OS downloads the entire show w/o stalling. Of course it could be a Windows plus curl issue instead of either or. Just for the fun of it I have installed kmttg v0p7j. See if that makes any difference (according to my own statements it should not) but hell It's Windows - everything is possible !

I found an 1.5 year old thread on curl which is pretty much what could be happening her:
http://curl.haxx.se/mail/tracker-2009-02/0022.html
I was imprecise when I said it was a "curl problem," which I realize may have sounded unfair to the curl developers. Considering the fact that curl works as expected on other platforms, and it worked on my own system just a couple weeks ago and nothing else I know of has changed, it is far more likely that Microsoft broke something that affects curl in a recent patch. I have been working on problems like these for enough years to instinctively hop over that step, however, when it is an issue like this one. In a situation where it is a Microsoft mistake that breaks something Microsoft cares little about (curl), the burden to solve the problem will probably fall to the curl developers, unfortunately. Microsoft will not admit it is a bug and will call it a feature if the only impact is on things like curl. So, it is a "curl problem" in that the curl developers are the ones who will most likely end up solving it.

I have been running 7.21.0 on my system for a day now, and it is still exhibiting the same behavior. Maybe I'll look into doing a kmttg modification to have it download the files via a browser rather than curl and see what happens then, as moyekj suggested. That might make for some solid proof in a "bug" report and also serve as a better short term workaround.
ferror is offline   Reply With Quote
Old 08-06-2010, 09:41 AM   #2512
lew
Registered User
 
Join Date: Mar 2002
Posts: 3,272
Issues With Atomic Parsley

Not working. Last error Atomic Parsley failed exit code -1073741819 check command. The resulting mp4 files have issues. I can stream with streambaby. Push with streambaby and the tivo doesn't know the file has finished transferring. Eventually it stops and the transferred video vanishes. Use pytivo and it complains about the MOOV atom.

My intent is to encode mp4 files that will be streamed or pushed back to my tivo. I'm not even sure what Atomic Parsley is suppose to do. I thought it puts the metadata in the mp4 file for ipds. I thought pytivo still needed the .txt for metadata.
lew is offline   Reply With Quote
Old 08-06-2010, 02:51 PM   #2513
sirfergy
Registered User
 
Join Date: May 2002
Posts: 280
Is it possible when using VRD to convert a .tivo to a .wtv to also get all the show properties populated in the .wtv file?
sirfergy is offline   Reply With Quote
Old 08-06-2010, 03:58 PM   #2514
ThAbtO
TiVoholic by the bay
 
ThAbtO's Avatar
 
Join Date: Apr 2000
Location: SF Bay Area
Posts: 4,989
I reverted back to v0p7j and so far so good.
__________________
Series 2 (PLS, sold)
TiVo HD 1TB (157 HD Hrs, PLS, "652")
Roamio! Oh, wait, Its Juliet!
OTA! OTA! OTA!

~~~~~

The TiVo Apocalypse begins on Sat 2013 Feb 16 00:00 GMT!
ThAbtO is offline   Reply With Quote
Old 08-06-2010, 11:31 PM   #2515
wmcbrine
Resistance Useless
 
wmcbrine's Avatar
 
Join Date: Aug 2003
Posts: 9,156
Quote:
Originally Posted by lew View Post
I thought pytivo still needed the .txt for metadata.
Recentish versions of pyTivo can read metadata directly from some types of video files.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
wmcbrine is offline   Reply With Quote
Old 08-06-2010, 11:43 PM   #2516
marbordom
Registered User
 
Join Date: Sep 2007
Location: Bronx, NY
Posts: 27
stuck curl downloads

Quote:
Originally Posted by ferror View Post
I was imprecise when I said it was a "curl problem," which I realize may have sounded unfair to the curl developers. Considering the fact that curl works as expected on other platforms, and it worked on my own system just a couple weeks ago and nothing else I know of has changed, it is far more likely that Microsoft broke something that affects curl in a recent patch. I have been working on problems like these for enough years to instinctively hop over that step, however, when it is an issue like this one. In a situation where it is a Microsoft mistake that breaks something Microsoft cares little about (curl), the burden to solve the problem will probably fall to the curl developers, unfortunately. Microsoft will not admit it is a bug and will call it a feature if the only impact is on things like curl. So, it is a "curl problem" in that the curl developers are the ones who will most likely end up solving it.

I have been running 7.21.0 on my system for a day now, and it is still exhibiting the same behavior. Maybe I'll look into doing a kmttg modification to have it download the files via a browser rather than curl and see what happens then, as moyekj suggested. That might make for some solid proof in a "bug" report and also serve as a better short term workaround.
This is better than I could have written it. I totally agree. Windows systems are way to alive - they change every day even w/o updates. Things just grow or get corrupted- well. Just to let some users know:
1) I tried a system restore to a date prior of me seeing the curl problems
-> I had to fix installing kmttg as a service, re updated java, re-installed kmttg itself but nothing made curl work again
2) last week I did the latest curl upgrade but used the 64 bit version
-> no luck with that either
3) I used another Windows XP Pro desktop, installed kmttg latest version and in less than 24 hours it just downloaded about 30 shows, decoded and cut out commercials => So I'd say it is a Win7 problem even if MS does not agree although builds are depend. on cross/compilers and libs which might differ
Finally these timeouts issues reported with curl and Windows (not a curl problem itself) still make sense to me. If I'd be sure that the Acer Revo 3100 would just work fine (HDMI audio output etc.) under Linux I would go for that - but then comcut needs to run under some emu like wine ?? - Hmm, lots of work. Maybe I should at first upgrade the HDD im the Tivo ...

Anyway: If you find a fix I would like to know how I can hop onto that train. I have never compiled the kmttg sources nor modfied them but if that proves to be the "rord of the ling" be it and I will try.

Great forum by the way !
marbordom is offline   Reply With Quote
Old 08-06-2010, 11:48 PM   #2517
marbordom
Registered User
 
Join Date: Sep 2007
Location: Bronx, NY
Posts: 27
stuck curl downloads

Quote:
Originally Posted by moyekj View Post
For those with windows having curl hanging issues perhaps try the latest 7.21.0 version which you can download from here to see if behavior is any better:
http://kmttg.googlecode.com/files/curl-7.21.0_win32.zip
Rename the current "curl" folder in kmttg installation to something else and then install this one as the new "curl" folder.
Hi, yes that was one of my first ideas: Upgrade curl !
I used the 64 bit version first and now the link you posted here.
Unfort. both did not work on my Win 7. The very first download got stuck after 5 min. I bet a king of TCPIP analysis could find the problem.

Seems that my MS system is made for sadists .. self torture built in.
marbordom is offline   Reply With Quote
Old 08-07-2010, 02:13 AM   #2518
moyekj
Registered User
 
Join Date: Jan 2006
Location: Mission Viejo, CA
Posts: 9,300
Quote:
Originally Posted by marbordom View Post
Hi, yes that was one of my first ideas: Upgrade curl !
I used the 64 bit version first and now the link you posted here.
Unfort. both did not work on my Win 7. The very first download got stuck after 5 min. I bet a king of TCPIP analysis could find the problem.

Seems that my MS system is made for sadists .. self torture built in.
I do have a Win 7 machine to test on, though it's not one I normally use. How prevalent is this issue though? Will I have to download 20-30 different shows to get the issue? Haven't seen the issue yet on that machine.

ThAbtO, the fact that users can reproduce issue outside kmttg using curl seems to take kmttg out of equation, so switching versions is not likely a cure especially since it's same version of curl in both j & l versions anyway...

EDIT: I've now downloaded over 20 different programs from 2 different S3s using Win7 Toshiba laptop, with downloads concurrent and haven't yet run into this hang issue, so looks like I won't be able to reproduce this myself...
__________________
Roamio Pro, Elite, Premiere
Cox - Motorola CableCards & TAs
Slingbox 350 via TiVo Mini & TiVo Stream for remote viewing

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.


To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

Last edited by moyekj : 08-07-2010 at 02:54 AM.
moyekj is offline   Reply With Quote
Old 08-07-2010, 06:03 AM   #2519
marbordom
Registered User
 
Join Date: Sep 2007
Location: Bronx, NY
Posts: 27
stuck curl downloads

Quote:
Originally Posted by moyekj View Post
I do have a Win 7 machine to test on, though it's not one I normally use. How prevalent is this issue though? Will I have to download 20-30 different shows to get the issue? Haven't seen the issue yet on that machine.

ThAbtO, the fact that users can reproduce issue outside kmttg using curl seems to take kmttg out of equation, so switching versions is not likely a cure especially since it's same version of curl in both j & l versions anyway...

EDIT: I've now downloaded over 20 different programs from 2 different S3s using Win7 Toshiba laptop, with downloads concurrent and haven't yet run into this hang issue, so looks like I won't be able to reproduce this myself...
I believe I have to figure out a way how to produce a debug output from the curl executable via -v (verbose) and / or a TCP dump or whatever sniffer can be attached under Win 7. kmttg is at no fault here.
marbordom is offline   Reply With Quote
Old 08-07-2010, 09:56 AM   #2520
wireman121
Registered User
 
Join Date: Nov 2008
Posts: 101
Got a TiVo Premiere and set kmttg up to use it instead of my Tivo HD.... Also set it up to download in TS format instead of PS. It downloaded fine, but tivodecode is throwing an error now. see below:

Quote:
>> DECRYPTING C:\Users\Admin\Desktop\kmttg\temp\Warehouse 13 - 13.1_Fri_Aug_06.TiVo ...
"C:\Users\Admin\Desktop\kmttg\tivodecode\tivodecode.exe" --mak MAK --out "C:\Users\Admin\Desktop\kmttg\temp\Warehouse 13 - 13.1_Fri_Aug_06.mpg" "C:\Users\Admin\Desktop\kmttg\temp\Warehouse 13 - 13.1_Fri_Aug_06.TiVo"
tivodecode failed (exit code: 10 ) - check command: "C:\Users\Admin\Desktop\kmttg\tivodecode\tivodecode.exe" --mak MAK --out "C:\Users\Admin\Desktop\kmttg\temp\Warehouse 13 - 13.1_Fri_Aug_06.mpg" "C:\Users\Admin\Desktop\kmttg\temp\Warehouse 13 - 13.1_Fri_Aug_06.TiVo"
TiVo Private Data : Unmatched Stream ID: No error
ts_handle_tivo_private_data failed: No error
processing frame: No error
Encryption by QUALCOMM

wireman121 is offline   Reply With Quote
Reply
Forum Jump




Thread Tools


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Advertisements

TiVo Community
Powered by vBulletin® Version 3.6.8
Copyright ©2000 - 2014, Jelsoft Enterprises Ltd.
vBulletin Skins by: Relivo Media

(C) 2013 Magenium Solutions - All Rights Reserved. No information may be posted elsewhere without written permission.
TiVo® is a registered trademark of TiVo Inc. This site is not owned or operated by TiVo Inc.
All times are GMT -5. The time now is 04:45 AM.
OUR NETWORK: MyOpenRouter | TechLore | SansaCommunity | RoboCommunity | MediaSmart Home | Explore3DTV | Dijit Community | DVR Playground |