TiVo Community
TiVo Community
TiVo Community
Go Back   TiVo Community > Main TiVo Forums > TiVo Home Media Features & TiVoToGo
TiVo Community
Reply
Forum Jump
 
Thread Tools
Old 10-01-2010, 08:36 AM   #2701
larrs
Movie Fan-Addict
 
larrs's Avatar
 
Join Date: May 2005
Location: NOrthernVA
Posts: 930
Error Correction?

Would it be possible for kmttg to correct for errors in the recording when it downloads to the PC? From time to time (40%) I get partial recordings due to dropouts in the video/audio of the recorded program. Since kmttg reports the size of the file in the NPL, would it be possible to somehow stop this partial recording from happening or even happening in 2 (or more) parts?

It can really be a pain to find out where the error occurs, go to one Tivo to find that place in the recording, pause right after the error, go to another Tivo, transfer the recording to that Tivo from the paused point, wait for the transfer and then go back to kmttg to download the second section.

I am sure this is not a simple undertaking and I am not a programmer (and I did not stay in a Holoday Inn Express last night) so I do not know the effort involved. Just an inquiry...
__________________
Tivo Fanatic since '99!


(1) Elite
(3) Premieres
(1) HD
(1) Mini
I run
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
with
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
and
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
larrs is offline   Reply With Quote
Old 10-01-2010, 09:04 AM   #2702
moyekj
Registered User
 
Join Date: Jan 2006
Location: Mission Viejo, CA
Posts: 8,943
Quote:
Originally Posted by WrathWielder View Post
Strange! I was sure that was it - just a coincidence I guess
Or could it be that MY apostrophe FOLLOWED a space (%20') and yours was between 2 chars? Just thinking out loud

Can I ask what version of curl you are using?

I'm curious because here's what I just discovered...

Curl 7.20.1 is what I was using originally (full cygwin install), and it will not download the shows with the apostrophes.
I switched to curl 7.18.0 and it now works! They're transferring even as I speak

Haven't tried 7.16.3 (which I believe is the latest version available at xttp://code.google.com/p/kmttg/downloads/list where the latest kmttg is)

I guess I'll stick with 7.18.0 - not sure why I switched...I guess I fell into the "latest version MUST be better" mindset, but I do recall now reading something about how the full cygwin version doesn't have some kmttg "tweaks" of some kind that the other stripped down .DLL - only versions have (or something along those lines) Maybe that's the problem...?

Thanks!

-Greg
I'm using non-cygwin version 7.18.0. I also tried with non-cygwin version 7.20.1 and it worked. However when I switched to cygwin version 7.16.3 it did have the exit code 52 issue as you originally reported, so obviously something wrong with cygwin version. Java mode download worked fine with same file with apostrophe.
So I guess the lesson here is that cygwin versions MAY give you issues such as this so better off sticking with native windows versions.
__________________
Roamio Pro (GigE)
Elite (MoCA)
Premiere (MoCA adapter)
Cox - Motorola CableCards & TAs
Slingbox 350 via TiVo Mini & TiVo Stream for remote viewing

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
moyekj is offline   Reply With Quote
Old 10-01-2010, 09:15 AM   #2703
moyekj
Registered User
 
Join Date: Jan 2006
Location: Mission Viejo, CA
Posts: 8,943
Quote:
Originally Posted by larrs View Post
Would it be possible for kmttg to correct for errors in the recording when it downloads to the PC? From time to time (40%) I get partial recordings due to dropouts in the video/audio of the recorded program. Since kmttg reports the size of the file in the NPL, would it be possible to somehow stop this partial recording from happening or even happening in 2 (or more) parts?

It can really be a pain to find out where the error occurs, go to one Tivo to find that place in the recording, pause right after the error, go to another Tivo, transfer the recording to that Tivo from the paused point, wait for the transfer and then go back to kmttg to download the second section.

I am sure this is not a simple undertaking and I am not a programmer (and I did not stay in a Holoday Inn Express last night) so I do not know the effort involved. Just an inquiry...
Something automated I doubt could be implemented. I'm not even sure if downloads with a specified byte offset are possible from a TiVo web server though I haven't looked into that. That may be an interesting option to explore, but even that would have issues since when you download from a TiVo you are not downloading the original file stored on the TiVo - it's converting file on the fly which is the reason why glitches can make that fail in the first place. So because of that I think byte offset is not possible. A time offset would be the ideal solution but I doubt there's a way to specify a time offset for a TiVo download.
__________________
Roamio Pro (GigE)
Elite (MoCA)
Premiere (MoCA adapter)
Cox - Motorola CableCards & TAs
Slingbox 350 via TiVo Mini & TiVo Stream for remote viewing

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
moyekj is offline   Reply With Quote
Old 10-01-2010, 09:33 AM   #2704
txporter
One sec, almost done
 
Join Date: Sep 2006
Location: Austin, TX
Posts: 666
Quote:
Originally Posted by shelleye View Post
Ah, THANK you. I don't remember what I started with, probably normal, but if not I will just play with it and see how it turns out. This will at least help me get started, as I can map my GUI settings to the command line settings you suggested.
You will also need to open up a command prompt window and run 'HandBrakeCLI --preset-list' from the Handbrake directory to get the list of presets and the flags they set. The list on the website that I linked to you are not up-to-date but the command flags from there are fine.
__________________
Tivo Premiere 2TB WD20EARS (lifetime)
TivoHD 1TB WD10EACS + 1TB WD10EVCS Antec MX-1 (lifetime)
TivoHD 1TB WD10EACS (lifetime)
Series2 540 400GB Seagate DB35 (lifetime)
txporter is offline   Reply With Quote
Old 10-01-2010, 12:41 PM   #2705
wmcbrine
Resistance Useless
 
wmcbrine's Avatar
 
Join Date: Aug 2003
Posts: 8,947
Quote:
Originally Posted by moyekj View Post
I'm not even sure if downloads with a specified byte offset are possible from a TiVo web server though I haven't looked into that.
I don't believe they are, via TTG. I tried several ways to do it and got nowhere. They are of course possible (with time offset) via MRV, but I don't know of a non-TiVo implementation of that besides tivoserver, which AFAIK only works with hacked units that have had encryption disabled.

Interestingly, the TiVo itself will resume failed TTCB transfers using a byte offset, but the method it uses doesn't seem to work in the other direction.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
wmcbrine is offline   Reply With Quote
Old 10-01-2010, 01:11 PM   #2706
txporter
One sec, almost done
 
Join Date: Sep 2006
Location: Austin, TX
Posts: 666
Quote:
Originally Posted by shelleye View Post
Ah, THANK you. I don't remember what I started with, probably normal, but if not I will just play with it and see how it turns out. This will at least help me get started, as I can map my GUI settings to the command line settings you suggested.
Ok, I spent a little time today messing around with the profile I sent you. It isn't what you want. The presets set one of the anamorphic modes and it cannot be turned off. Here are a few other versions that I built for you. You can download them and remove the '.txt' and just drop them in your encode folder.

The first one is what you asked for. The second one includes detelecine which I prefer because it gets rid of the double frames that cause the slight jerks in high motion scenes. The third one includes detelecine and uses quality based encoding rather than average bitrate (your 2500kbps number). You really don't need anywhere near 2500kbps for SD video transcodes. I was working with a 2min sample of Rescue Me (from DVD). Here is an example of the size:
source - 2min Rescue Me = 106mb
shelleye profile = 38.3mb
shelleye2 profile = 31.3mb
shelleye3 profile = 16.4mb

Visually, I cannot distinguish between shelleye2 and shelleye3 encodes. I assume that you are using this profile to put onto an Ipod or something? Try an encode or two with the profiles and see what you like.

NOTE: This profile works well for 720x480 video (what you will get off of NTSC DVDs). Some of the recordings on Tivo are 544x480. Don't know if this profile will work well for that since the width and height are specified and 640>544.
Attached Files
File Type: txt hb_tivo_shelleye.enc.txt (602 Bytes, 11 views)
File Type: txt hb_tivo_shelleye2.enc.txt (606 Bytes, 14 views)
File Type: txt hb_tivo_shelleye3.enc.txt (606 Bytes, 10 views)
__________________
Tivo Premiere 2TB WD20EARS (lifetime)
TivoHD 1TB WD10EACS + 1TB WD10EVCS Antec MX-1 (lifetime)
TivoHD 1TB WD10EACS (lifetime)
Series2 540 400GB Seagate DB35 (lifetime)
txporter is offline   Reply With Quote
Old 10-02-2010, 09:18 PM   #2707
shelleye
Registered User
 
Join Date: Nov 2002
Posts: 39
Quote:
Originally Posted by txporter View Post
...Here are a few other versions that I built for you. You can download them and remove the '.txt' and just drop them in your encode folder....
Oh my gosh!! Thank you thank you thank you. I only came across this reply by accident, because I was just starting to try and build my own command line, and thought I would re-check the thread to confirm what you posted before. For some reason I wasn't getting thread updates via email. Anyway, I am so grateful, and really looking forward to trying these out. I'm actually using this encode for a Roku box, which I use to stream media and photos from a NAS. The Roku has a few very specific requirements, or else it chokes. My iPod touch, which I also use, is more forgiving, and seems to be able to use the same encodes. I can't wait to see if this works. Did I say thank you? Thank you!!!!
shelleye is offline   Reply With Quote
Old 10-03-2010, 03:08 PM   #2708
innocentfreak
Registered User
 
Join Date: Aug 2001
Location: Florida
Posts: 8,454
Do most of you use the original air date to keep the shows in order?

I am trying to find an easy way or tool that will auto convert a show with air date to one with the correct season and episode.

For example take Supernatural. If I transfer the episode from Friday, it will most likely transfer as Supernatural - 10/1/10 depending on your settings. I am just trying to find a way to convert to Supernatural - Two and a Half Men -S06E02.

I know there are renaming tools if I have the mpg file with just the show name and season and episode number, but didn't know if there was one for show and airdate.
__________________
1 - TiVo Roamio Pro
2 - TiVo Premiere XL

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.


To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
innocentfreak is offline   Reply With Quote
Old 10-03-2010, 06:29 PM   #2709
ThAbtO
TiVoholic by the bay
 
ThAbtO's Avatar
 
Join Date: Apr 2000
Location: SF Bay Area
Posts: 4,616
I miss having a estimated time remaining for my downloads on kmttg. Its been years since I had forgotten the formula to calculate. I wonder if it can be done for kmttg, even though its only an estimate.
__________________
Series 2 (PLS, sold)
TiVo HD 1TB (157 HD Hrs, PLS, "652")
Roamio! Oh, wait, Its Juliet!

~~~~~

The TiVo Apocalypse begins on Sat 2013 Feb 16 00:00 GMT!
ThAbtO is offline   Reply With Quote
Old 10-03-2010, 10:14 PM   #2710
shelleye
Registered User
 
Join Date: Nov 2002
Posts: 39
Quote:
Originally Posted by txporter View Post
...Here are a few other versions that I built for you. You can download them and remove the '.txt' and just drop them in your encode folder...The third one includes detelecine and uses quality based encoding rather than average bitrate (your 2500kbps number).
I have tested all three of the profiles, and you are correct, the third one works just as well as the first two, to my eye anyway, and is half the size. I'm frankly baffled: my file sizes are going from 2-4G as .mpg, to 500M as .m4v. Is this truly how much it compresses? I guess it must be, because I'm watching it. But, wow.

Anyway, I have not run into any problems with syncing or streaming, so it might make sense to standardize the third version as a Handbrake Roku streaming profile. It's working beautifully for me. Did I say thank you?
shelleye is offline   Reply With Quote
Old 10-04-2010, 10:51 AM   #2711
cweb
Registered User
 
Join Date: May 2004
Posts: 93
kmttg has a grude against Grey's Anatomy ...

kmttg works great with all my shows on all my Tivos, except for this season's Grey Anatomy. I have two episodes the kmttg refuses to download. The shows view as complete. I am able to transfer them to another Tivo with no problem. Kmttg won't even download the copies that successfully transferred to the other Tivo. I have reset and restarted the Tivo's with no success. The message is as follows:

Download failed to file: G:\TivoTemp\Greys Anatomy\Greys Anatomy 2010-09-30 Shock to the System.TiVo
Exit code: 52
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed

0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
curl: (52) Empty reply from server
Greys Anatomy 2010-09-30 Shock to the System.TiVo: Too many failed downloads, GIVING UP!!
cweb is offline   Reply With Quote
Old 10-04-2010, 11:56 AM   #2712
moyekj
Registered User
 
Join Date: Jan 2006
Location: Mission Viejo, CA
Posts: 8,943
Quote:
Originally Posted by cweb View Post
kmttg works great with all my shows on all my Tivos, except for this season's Grey Anatomy. I have two episodes the kmttg refuses to download. The shows view as complete. I am able to transfer them to another Tivo with no problem. Kmttg won't even download the copies that successfully transferred to the other Tivo. I have reset and restarted the Tivo's with no success. The message is as follows:

Download failed to file: G:\TivoTemp\Greys Anatomy\Greys Anatomy 2010-09-30 Shock to the System.TiVo
Exit code: 52
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed

0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
curl: (52) Empty reply from server
Greys Anatomy 2010-09-30 Shock to the System.TiVo: Too many failed downloads, GIVING UP!!
See a few posts up in this thread: The cygwin version of curl has a problem dealing with URLs with special characters such as single quotes (which above show will have). Fix is to either revert to default version of curl installed with kmttg or switch to Java downloads.
I'm going to hide the cygwin curl version download from kmttg downloads page since it should not be encouraged to use that version.
__________________
Roamio Pro (GigE)
Elite (MoCA)
Premiere (MoCA adapter)
Cox - Motorola CableCards & TAs
Slingbox 350 via TiVo Mini & TiVo Stream for remote viewing

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
moyekj is offline   Reply With Quote
Old 10-04-2010, 12:01 PM   #2713
txporter
One sec, almost done
 
Join Date: Sep 2006
Location: Austin, TX
Posts: 666
Quote:
Originally Posted by shelleye View Post
I have tested all three of the profiles, and you are correct, the third one works just as well as the first two, to my eye anyway, and is half the size. I'm frankly baffled: my file sizes are going from 2-4G as .mpg, to 500M as .m4v. Is this truly how much it compresses? I guess it must be, because I'm watching it. But, wow.

Anyway, I have not run into any problems with syncing or streaming, so it might make sense to standardize the third version as a Handbrake Roku streaming profile. It's working beautifully for me. Did I say thank you?
Can you send me a link to the Roku stream requirements? As far as I can tell, they should be able to support 720p or 1080i streams (depending on model). I don't see why you need to modify the resolution for SD streams at all.

Can you try another encode where you modify the 3rd profile and remove the '-w 640 -l 368' flags? This should transcode the video without resolution change. Also, do you have any HD video streams (1080i/720p) that you can re-encode and try? For HD, I would again remove the '-w 640 -l 368' flags and change the '-q 19.0' to '-q 21.0'.

I think we might simply be able to modify the profile(s) I made earlier for lew/richklein to simply encode with AAC audio rather than passing through AC3. I have attached two new profiles that are simply modifications of the earlier profiles with AAC audio instead. Can you test an encode with those to see if they work for you?
Attached Files
File Type: txt hb_roku_sd.enc.txt (529 Bytes, 6 views)
File Type: txt hb_roku_hd.enc.txt (529 Bytes, 6 views)
__________________
Tivo Premiere 2TB WD20EARS (lifetime)
TivoHD 1TB WD10EACS + 1TB WD10EVCS Antec MX-1 (lifetime)
TivoHD 1TB WD10EACS (lifetime)
Series2 540 400GB Seagate DB35 (lifetime)
txporter is offline   Reply With Quote
Old 10-04-2010, 12:03 PM   #2714
txporter
One sec, almost done
 
Join Date: Sep 2006
Location: Austin, TX
Posts: 666
Quote:
Originally Posted by txporter View Post
Forgot to add the large file flag to this encoding profile (-4), which will cause issues if the resulting mp4 file is larger than 4GB. Updated and attached.
One more update to this profile as well as including both SD/HD version. I am dropping the framerate flag that forces the stream to 23.976fps like the first one had. This should allow FILM, PAL and INTERLACED material to be handled properly.
Attached Files
File Type: txt hb_tivo_sd_crf.enc.txt (499 Bytes, 7 views)
File Type: txt hb_tivo_hd_crf.enc.txt (499 Bytes, 8 views)
__________________
Tivo Premiere 2TB WD20EARS (lifetime)
TivoHD 1TB WD10EACS + 1TB WD10EVCS Antec MX-1 (lifetime)
TivoHD 1TB WD10EACS (lifetime)
Series2 540 400GB Seagate DB35 (lifetime)
txporter is offline   Reply With Quote
Old 10-04-2010, 01:01 PM   #2715
shelleye
Registered User
 
Join Date: Nov 2002
Posts: 39
Once again, I almost failed to see your updates. I'm looking forward to trying them out. Here's a link to the roku forum discussion: http://forums.roku.com/viewtopic.php...ttings#p189257 (I hope I'm allowed to post that), and here is my cut and paste of the same post: "RockyFord wrote: I spent about 12 hours this past weekend trying to find the magic sauce for encoding videos in Handbrake. Here are my results: Premise: I have .mpg (full mpeg2 dvd rips) and .avi (mp4) with 5.1ac3 audio in most cases. The settings that work best for me and seem to reproduce the proper frame without wierd letterboxing or cropping:

Container:MP4 File, Large File Size and Web Optimized checked.

Picture:Anamorphic is set to None. Width is set to 640 (half of 1280), Height auto sets for aspect ratio (Using half width really seems to allow the codec to pack in the detail. The TV upscales the picture beautifully and my file sizes stay manageable. Cropping: Custom and I zero all values.

Video Filters: All off except for Decomb Default

Video: Video Codec: H.264(x264) Framerate:29.97 Avg. Bitrae:2500 or 3000 (Constant Quality doesn't seem to work well with roku because the bitrate may climb too high in spots)

Audio: Use only one track of audio, I found that when I had two tracks of audio that were different the results became unpredictable. I use the AC3 passthru (DTS) for the files that have it already inside and the AAC works well for the files that don't have 5.1."

To which somebody replies "You can actually drop the average bitrate to 1500 - 1600 without a loss of quality, this will make smaller files."

I follow all settings, except that I don't do custom cropping, since automatic cropping seems to do the same thing....?

EDIT: one note about frame rates: Roku seems to choke on anything but a framerate of 29.97, which I have confirmed by trying to use some old encodes. So that value probably can't be messed with. There seems to be some debate about AC3 vs. AAC audio (most say AC3, or two audio streams will confuse Roku, some think you can do AC3 passthrough), but since I don't have 5.1 surround sound I go with the sure choice.

I will wait to hear from you before I mess with the profiles you sent me, in case you want me to try something different based on these more experienced opinions. My plan, if this works, is to change my workflow completely, and use KTTMG to batch process all of my DVD rips. I will also post my rave review over on the Roku forums. Tivo and Roku are, in my opinion, a match made in heaven.

Last edited by shelleye : 10-04-2010 at 01:22 PM. Reason: Add a Note about Frame Rate
shelleye is offline   Reply With Quote
Old 10-04-2010, 01:38 PM   #2716
txporter
One sec, almost done
 
Join Date: Sep 2006
Location: Austin, TX
Posts: 666
Quote:
Originally Posted by shelleye View Post
Once again, I almost failed to see your updates. I'm looking forward to trying them out. Here's a link to the roku forum discussion: http://forums.roku.com/viewtopic.php...ttings#p189257 (I hope I'm allowed to post that), and here is my cut and paste of the same post: "RockyFord wrote: I spent about 12 hours this past weekend trying to find the magic sauce for encoding videos in Handbrake. Here are my results: Premise: I have .mpg (full mpeg2 dvd rips) and .avi (mp4) with 5.1ac3 audio in most cases. The settings that work best for me and seem to reproduce the proper frame without wierd letterboxing or cropping:

Container:MP4 File, Large File Size and Web Optimized checked.

Picture:Anamorphic is set to None. Width is set to 640 (half of 1280), Height auto sets for aspect ratio (Using half width really seems to allow the codec to pack in the detail. The TV upscales the picture beautifully and my file sizes stay manageable. Cropping: Custom and I zero all values.

Video Filters: All off except for Decomb Default

Video: Video Codec: H.264(x264) Framerate:29.97 Avg. Bitrae:2500 or 3000 (Constant Quality doesn't seem to work well with roku because the bitrate may climb too high in spots)

Audio: Use only one track of audio, I found that when I had two tracks of audio that were different the results became unpredictable. I use the AC3 passthru (DTS) for the files that have it already inside and the AAC works well for the files that don't have 5.1."

To which somebody replies "You can actually drop the average bitrate to 1500 - 1600 without a loss of quality, this will make smaller files."

I follow all settings, except that I don't do custom cropping, since automatic cropping seems to do the same thing....?

EDIT: one note about frame rates: Roku seems to choke on anything but a framerate of 29.97, which I have confirmed by trying to use some old encodes. So that value probably can't be messed with. There seems to be some debate about AC3 vs. AAC audio (most say AC3, or two audio streams will confuse Roku, some think you can do AC3 passthrough), but since I don't have 5.1 surround sound I go with the sure choice.

I will wait to hear from you before I mess with the profiles you sent me, in case you want me to try something different based on these more experienced opinions. My plan, if this works, is to change my workflow completely, and use KTTMG to batch process all of my DVD rips. I will also post my rave review over on the Roku forums. Tivo and Roku are, in my opinion, a match made in heaven.
Did you say that you used my 2nd and 3rd profiles already to encode some videos? Those are set to run de-telecine which will result in 23.976fps video (usually). If you got good results on the Roku with those, then it sounds like the framerate point may be incorrect. Please confirm. You can use MediaInfo or GSpot to confirm the framerate (among other things).

Also, it looks like the Roku will also accept AC3 audio, which means that you can probably use the tivo_sd/hd_crf profiles without any need for modification (this assumes that de-telecine and frame size are not a problem).

Finally, you can drop the -l 368 portion of the flags, but I think the aspect ratio will be off. I was getting a framesize of 640x432 without forcing the height to 368, which is why I did force it.
__________________
Tivo Premiere 2TB WD20EARS (lifetime)
TivoHD 1TB WD10EACS + 1TB WD10EVCS Antec MX-1 (lifetime)
TivoHD 1TB WD10EACS (lifetime)
Series2 540 400GB Seagate DB35 (lifetime)
txporter is offline   Reply With Quote
Old 10-04-2010, 01:58 PM   #2717
shelleye
Registered User
 
Join Date: Nov 2002
Posts: 39
I just went back and checked the encodes I did with your profile, and saw, to my shock, that half of them are showing up as 23.976 frame rates. So far I haven't had any difficulty playing them. But I know I (and others) had to re-encode multiple .m4v files that had a 23.976 frame rate. Most (but not all) of those files would freeze some time into streaming, and never recover. Once they were re-encoded at 29.97, they played fine.

In your opinion, as a person with no Roku, but obvious knowledge of Handbrake, what would be the best profile/profile settings for me to start with? The only thing I care about is that the stream not choke (which seems to mean, most of the time, 29.97), and that I preserve the original aspect ratio of the film.

(Can I ask you a question? Why would the Roku forum guy have set the width to 640 in the first place? He seemed to feel that it gave the best picture quality, but I see your point, that anything that starts out at 720 would do best if you just leave it alone. 640 seemed to be the magic number for him because it's half of 1280.)

I apologize for dragging you into what turned out to be a much longer conversation than I meant for it to be. Hopefully I will be on my way soon.
shelleye is offline   Reply With Quote
Old 10-04-2010, 04:02 PM   #2718
txporter
One sec, almost done
 
Join Date: Sep 2006
Location: Austin, TX
Posts: 666
Quote:
Originally Posted by shelleye View Post
I just went back and checked the encodes I did with your profile, and saw, to my shock, that half of them are showing up as 23.976 frame rates. So far I haven't had any difficulty playing them. But I know I (and others) had to re-encode multiple .m4v files that had a 23.976 frame rate. Most (but not all) of those files would freeze some time into streaming, and never recover. Once they were re-encoded at 29.97, they played fine.

In your opinion, as a person with no Roku, but obvious knowledge of Handbrake, what would be the best profile/profile settings for me to start with? The only thing I care about is that the stream not choke (which seems to mean, most of the time, 29.97), and that I preserve the original aspect ratio of the film.

(Can I ask you a question? Why would the Roku forum guy have set the width to 640 in the first place? He seemed to feel that it gave the best picture quality, but I see your point, that anything that starts out at 720 would do best if you just leave it alone. 640 seemed to be the magic number for him because it's half of 1280.)

I apologize for dragging you into what turned out to be a much longer conversation than I meant for it to be. Hopefully I will be on my way soon.
The 640 number looks to have come from an effort to minimize file size. He said he was using half the width of 1280 (720p video). Based on this page, it looks like all of the new Rokus will play 720p video and 2 of 3 will play 1080p. Based on that, I think there is zero reason to worry about framesize adjustments. I would just encode without either -w or -l flags meaning input resolution = output resolution. Most of the time, 1080p is shorthand for 1080p24 which is 23.976 fps. I think Roku intends to support 23.976fps framerates, so you should be ok. BUT that isn't to say that you won't see problems at 23.976fps. TivoHD has some playback issues with 23.976fps material that are not present at 25+ fps, so it can happen.

Personally, I would suggest using the hb_tivo_sd(hd)_crf profiles. That allows you to keep the surround sound AC3 audio if you can use it, and removes the telecine frames if they are present. The deeper I get into video editting/transcoding, the easier it is for me to see the subtle problems with video. I really hate the telecine judder. You will see this if you force FILM video to 29.97fps. Most everything that you watch nowadays in the US is FILM rate (TV shows, movies).

What I would do is create a short clip (maybe 2-5 mins) and encode it various ways and test them out on your Roku. Ideally, I would like to find a profile that works on both Tivo (probably Premiere since it has best h.264 support) and Roku and use that.

To start with, I would take a short clip and use the shelleye3 profile I created:
1. shelleye3
2. remove '-w 640 -l 368' = verify that standard SD resolution plays without a problem
3. same as 2 + replace '--aencoder faac --ab 160 --mixdown dpl12 --arate 48 --drc 0.0' with '-E ac3' = verify that AC3 audio works
4. same as 3 + remove '--detelecine' = compare 23.976fps video to 29.97fps video

If you don't see a problem with test #3, then you will be fine using the hb_tivo_sd(hd)_crf profiles I posted above.
__________________
Tivo Premiere 2TB WD20EARS (lifetime)
TivoHD 1TB WD10EACS + 1TB WD10EVCS Antec MX-1 (lifetime)
TivoHD 1TB WD10EACS (lifetime)
Series2 540 400GB Seagate DB35 (lifetime)
txporter is offline   Reply With Quote
Old 10-04-2010, 04:16 PM   #2719
shelleye
Registered User
 
Join Date: Nov 2002
Posts: 39
A succinct and clear troubleshooting path. I will do as you say and post my results, here and in the Roku forum, in hopes of helping others who are moving into this brave new world. (I spent some time searching that forum and the internet, thinking somebody MUST have come up with a best practices encode, but nobody has, yet....)
shelleye is offline   Reply With Quote
Old 10-04-2010, 05:07 PM   #2720
txporter
One sec, almost done
 
Join Date: Sep 2006
Location: Austin, TX
Posts: 666
Quote:
Originally Posted by shelleye View Post
A succinct and clear troubleshooting path. I will do as you say and post my results, here and in the Roku forum, in hopes of helping others who are moving into this brave new world. (I spent some time searching that forum and the internet, thinking somebody MUST have come up with a best practices encode, but nobody has, yet....)
I probably should have added a #5 and that is to try an encode using the hb_tivo_sd(hd)_crf profile. I forgot that there are actually some x264 setting differences between the Normal Profile in Handbrake and the High Profile which I use in hb_tivo_sd_crf profile. The ones that I created for you were based off of the Normal Profile.
__________________
Tivo Premiere 2TB WD20EARS (lifetime)
TivoHD 1TB WD10EACS + 1TB WD10EVCS Antec MX-1 (lifetime)
TivoHD 1TB WD10EACS (lifetime)
Series2 540 400GB Seagate DB35 (lifetime)
txporter is offline   Reply With Quote
Old 10-06-2010, 12:05 AM   #2721
moyekj
Registered User
 
Join Date: Jan 2006
Location: Mission Viejo, CA
Posts: 8,943
Quote:
Originally Posted by ThAbtO View Post
I miss having a estimated time remaining for my downloads on kmttg. Its been years since I had forgotten the formula to calculate. I wonder if it can be done for kmttg, even though its only an estimate.
The reason I never added this in the past is that TiVo does not give good indication of the file size to be downloaded to your PC (since it does conversion on the fly when using TTG it probably cannot estimate file size accurately enough to report it). Without knowing accurate file size it's impossible to give an accurate estimate of time remaining. You may have noticed for downloads the % complete never actually reaches 100% since the file size stored on TiVo is always greater than what actually gets downloaded via TTG.
In any case for next release I have added a configuration option that if enabled will show estimated time remaining instead of download bit rate which some may find more useful even though it's not very accurate (will never actually get down to zero).
__________________
Roamio Pro (GigE)
Elite (MoCA)
Premiere (MoCA adapter)
Cox - Motorola CableCards & TAs
Slingbox 350 via TiVo Mini & TiVo Stream for remote viewing

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
moyekj is offline   Reply With Quote
Old 10-06-2010, 09:07 AM   #2722
cweb
Registered User
 
Join Date: May 2004
Posts: 93
Quote:
Originally Posted by moyekj View Post
The cygwin version of curl has a problem dealing with URLs with special characters such as single quotes (which above show will have). Fix is to either revert to default version of curl installed with kmttg or switch to Java downloads.
I'm going to hide the cygwin curl version download from kmttg downloads page since it should not be encouraged to use that version.
Thanks moyekj. I thought about that issue but didn't see an apostrophe in the output so I didn't think it relevant. However, clearly "Grey's" does, so I went back to the regular curl and all is once again right with the world of kmttg. I'm not even sure why I went with the cygwin version in the first place.

Again, thanks.
cweb is offline   Reply With Quote
Old 10-07-2010, 04:51 PM   #2723
shelleye
Registered User
 
Join Date: Nov 2002
Posts: 39
Smile Roku profiles that worked for me...

Quote:
Originally Posted by txporter View Post
I probably should have added a #5 and that is to try an encode using the hb_tivo_sd(hd)_crf profile.
For those who are interested, and with thanks for those who have been helping me, here is what I ended up with:

1) you need to set your stream at 29.97 fps, or the roku stream will hang up and rebuffer, especially on content longer than one hour. 2) the Roku can’t process an encode with two audio tracks, so you need to set 1 audio track in Handbrake; although some people are able to successfully pass through AC3 content, faac is the most universally compatible format. 3) the Roku can’t (at least in my house) handle passthrough greater than the capacity of your Roku box; since my boxes are 720P (1280 x 720), I have to set the width at 1280 or less—when I did pass through encoding of hd content (1920 x 1080), the stream was noisy, and rebuffered.

After confirming these three rules, I played with different settings, and arrived at the following profiles, one for transcoding HDTV content, and one for standard definition DVDs, although they are basically the same except for the frame width:

HDTV Profile: Frame width 960, I let Handbrake determine height based on the original aspect ratio; anamorphic “none”; keep aspect ratio checked; decomb and detelecine video filters “default’ the rest off; fps 29.97; avg bitrate 2500; faac audio; audio bitrate 160. DVD Profile: the same except I set the frame width at 720, which is the original width of a standard dvd.

Notes: I tried various picture widths: 640, which is recommended on the Roksbox thread, as well as 720, and 940, and felt that 940 gave me by far the best results. I didn’t go any higher, because the highest Handbrake preset is 940, and I figure those guys must have some reason for keeping it at 940. Some people have said that lower bitrates (1500-1600) and/or using constant quality (RF 21) produce equivalent results with smaller file size, but I had some issues with buffering when I tried constant quality on some videos.

Based on advice I got here, I translated the above settings into two .txt files that seem to give me the same output as using the above settings in the Handbrake GUI. I am posting them here, in case they prove useful.

Thanks to all for all of your help.
Attached Files
File Type: txt hb_roku_720_Detelecine.enc.txt (600 Bytes, 40 views)
File Type: txt hb_roku_960_Detelecine.enc.txt (600 Bytes, 34 views)
shelleye is offline   Reply With Quote
Old 10-08-2010, 12:40 AM   #2724
txporter
One sec, almost done
 
Join Date: Sep 2006
Location: Austin, TX
Posts: 666
Quote:
Originally Posted by shelleye View Post
For those who are interested, and with thanks for those who have been helping me, here is what I ended up with:

1) you need to set your stream at 29.97 fps, or the roku stream will hang up and rebuffer, especially on content longer than one hour. 2) the Roku can’t process an encode with two audio tracks, so you need to set 1 audio track in Handbrake; although some people are able to successfully pass through AC3 content, faac is the most universally compatible format. 3) the Roku can’t (at least in my house) handle passthrough greater than the capacity of your Roku box; since my boxes are 720P (1280 x 720), I have to set the width at 1280 or less—when I did pass through encoding of hd content (1920 x 1080), the stream was noisy, and rebuffered.

After confirming these three rules, I played with different settings, and arrived at the following profiles, one for transcoding HDTV content, and one for standard definition DVDs, although they are basically the same except for the frame width:

HDTV Profile: Frame width 960, I let Handbrake determine height based on the original aspect ratio; anamorphic “none”; keep aspect ratio checked; decomb and detelecine video filters “default’ the rest off; fps 29.97; avg bitrate 2500; faac audio; audio bitrate 160. DVD Profile: the same except I set the frame width at 720, which is the original width of a standard dvd.

Notes: I tried various picture widths: 640, which is recommended on the Roksbox thread, as well as 720, and 940, and felt that 940 gave me by far the best results. I didn’t go any higher, because the highest Handbrake preset is 940, and I figure those guys must have some reason for keeping it at 940. Some people have said that lower bitrates (1500-1600) and/or using constant quality (RF 21) produce equivalent results with smaller file size, but I had some issues with buffering when I tried constant quality on some videos.

Based on advice I got here, I translated the above settings into two .txt files that seem to give me the same output as using the above settings in the Handbrake GUI. I am posting them here, in case they prove useful.

Thanks to all for all of your help.
Glad that you found some profiles that work for you!
__________________
Tivo Premiere 2TB WD20EARS (lifetime)
TivoHD 1TB WD10EACS + 1TB WD10EVCS Antec MX-1 (lifetime)
TivoHD 1TB WD10EACS (lifetime)
Series2 540 400GB Seagate DB35 (lifetime)
txporter is offline   Reply With Quote
Old 10-08-2010, 05:57 AM   #2725
ThAbtO
TiVoholic by the bay
 
ThAbtO's Avatar
 
Join Date: Apr 2000
Location: SF Bay Area
Posts: 4,616
Here is something I discovered:

Since I don't have TiVo Desktop installed any more, I have been getting errors when I tried to push .TiVo files from Kmttg. The solution was to decode them to .mpg and then push works without any problems.
__________________
Series 2 (PLS, sold)
TiVo HD 1TB (157 HD Hrs, PLS, "652")
Roamio! Oh, wait, Its Juliet!

~~~~~

The TiVo Apocalypse begins on Sat 2013 Feb 16 00:00 GMT!
ThAbtO is offline   Reply With Quote
Old 10-08-2010, 06:27 AM   #2726
shelleye
Registered User
 
Join Date: Nov 2002
Posts: 39
Quote:
Originally Posted by txporter View Post
Glad that you found some profiles that work for you!
Me too! (I considered titling my post "Obsessive Encoding Disorder".) Needless to say, I couldn't have done it without your help.
shelleye is offline   Reply With Quote
Old 10-08-2010, 08:47 AM   #2727
moyekj
Registered User
 
Join Date: Jan 2006
Location: Mission Viejo, CA
Posts: 8,943
Quote:
Originally Posted by ThAbtO View Post
Here is something I discovered:

Since I don't have TiVo Desktop installed any more, I have been getting errors when I tried to push .TiVo files from Kmttg. The solution was to decode them to .mpg and then push works without any problems.
You can push .TiVo files with pyTivo. You just have to configure pyTivo with path to tivodecode so pyTivo will decode on fly while pushing. See pyTivo thread:
http://pytivo.sourceforge.net/forum/...port-t831.html
__________________
Roamio Pro (GigE)
Elite (MoCA)
Premiere (MoCA adapter)
Cox - Motorola CableCards & TAs
Slingbox 350 via TiVo Mini & TiVo Stream for remote viewing

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
moyekj is offline   Reply With Quote
Old 10-13-2010, 05:54 PM   #2728
shiffrin
Registered User
 
Join Date: Aug 2000
Location: Lancaster, PA
Posts: 154
Is there a way to exclude certain files from being processed? I've read through the documentation and didn't see any way to specify this.

I record 'The Daily Show' and 'Stephen Colbert' but really don't need to back them up to my server. Any suggestions?
__________________
Barry
shiffrin is offline   Reply With Quote
Old 10-13-2010, 07:56 PM   #2729
moyekj
Registered User
 
Join Date: Jan 2006
Location: Mission Viejo, CA
Posts: 8,943
Quote:
Originally Posted by shiffrin View Post
Is there a way to exclude certain files from being processed? I've read through the documentation and didn't see any way to specify this.

I record 'The Daily Show' and 'Stephen Colbert' but really don't need to back them up to my server. Any suggestions?
It is possible though not obvious or pretty. Setup a "title" type auto transfer with the following text:
Code:
^((?!daily show|colbert).)*$
The above is a regex pattern that says to match everything except titles containing "daily show" and "colbert".

NOTE: You can enable "Dry Run Mode (test keywords only)" option under GLOBAL SETTINGS to try it out. Once enabled then OK the auto transfers form and then use Auto Transfers->Run Once in GUI. You will see in message window all the titles that are matched, which should exclude the daily show and colbert titles. Once satisfied it works then of course remember to turn off the Dry Run Mode.

P.S. I updated the auto_transfers Wiki page to include this example.
__________________
Roamio Pro (GigE)
Elite (MoCA)
Premiere (MoCA adapter)
Cox - Motorola CableCards & TAs
Slingbox 350 via TiVo Mini & TiVo Stream for remote viewing

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

Last edited by moyekj : 10-13-2010 at 08:27 PM.
moyekj is offline   Reply With Quote
Old 10-14-2010, 10:22 AM   #2730
shiffrin
Registered User
 
Join Date: Aug 2000
Location: Lancaster, PA
Posts: 154
Quote:
Originally Posted by moyekj View Post
It is possible though not obvious or pretty. Setup a "title" type auto transfer with the following text:
Code:
^((?!daily show|colbert).)*$
The above is a regex pattern that says to match everything except titles containing "daily show" and "colbert".

NOTE: You can enable "Dry Run Mode (test keywords only)" option under GLOBAL SETTINGS to try it out. Once enabled then OK the auto transfers form and then use Auto Transfers->Run Once in GUI. You will see in message window all the titles that are matched, which should exclude the daily show and colbert titles. Once satisfied it works then of course remember to turn off the Dry Run Mode.

P.S. I updated the auto_transfers Wiki page to include this example.
Thank you very much. That does exactly what I want and I learned a little bit about auto configure.
__________________
Barry
shiffrin is offline   Reply With Quote
Reply
Forum Jump




Thread Tools


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Advertisements

TiVo Community
Powered by vBulletin® Version 3.6.8
Copyright ©2000 - 2014, Jelsoft Enterprises Ltd.
vBulletin Skins by: Relivo Media

(C) 2013 Magenium Solutions - All Rights Reserved. No information may be posted elsewhere without written permission.
TiVo® is a registered trademark of TiVo Inc. This site is not owned or operated by TiVo Inc.
All times are GMT -5. The time now is 11:16 PM.
OUR NETWORK: MyOpenRouter | TechLore | SansaCommunity | RoboCommunity | MediaSmart Home | Explore3DTV | Dijit Community | DVR Playground |