pyTivo - Transcoding server

[Punker1234]

Originally Posted by lpwcomp

It is not that it is installed incorrectly, but your config file is wrong. "path = C:\Downloads\Tivo" does not belong in the "Server" section and the stuff you repeated under the "Tivo HD" section should only be in the "Server" section. You need to define at least one share. Your config file should look something like this:

[Server]
tivo_mak = 17
tivo_password = P
togo_path = C:\Downloads\Tivo
tivo_username = P
ffmpeg = C:\Pytivo\bin\ffmpeg.exe

[_tivo_SD]

[_tivo_HD]

[Downloads]
type = video
force_alpha = True
path = C:\Downloads\Tivo

The force_alpha = True is optional. BTW, this really has nothing to do with configuring a network.

You sir, are amazing. That seemed to do it, I now see the folder to push files to my Tivo. Thank you!

[wmcbrine]

Originally Posted by lrhorer

That's the entire thing? You don't have any shares defined. I'm not sure how pulls are working.

I assume he meant TiVo -> PC transfers. That wouldn't require a working share (just the togo_path and tivo_mak, which he had).

[lrhorer]

OK, yeah, I guess. Obviously one needn't define a share for TTG. When he said "pulls", I assumed he meant... well... pulls.

[lpwcomp]

Originally Posted by lrhorer

OK, yeah, I guess. Obviously one needn't define a share for TTG. When he said "pulls", I assumed he meant... well... pulls.

To be fair, if you bring up pyTivo in your browser via "http://localhost:9032/", it has "Pull from TiVos:".

[Hercules67]

Originally Posted by lpwcomp

To be fair, if you bring up pyTivo in your browser via "http://localhost:9032/", it has "Pull from TiVos:".

Believe me, when I learned to do that. my life changed...

(but you know what I mean).

[txporter]

Originally Posted by larrs

I'd like more people to verify or disprove this if possible. I have extensively tested it and it is there on all of my Tivo Premieres and the Elite. It runs from annoying to disruptive.

Mpeg2 at higher bitrates causes the most problems and affects even live TV which appears like it is losing frames. However, all mpeg2 videos affect it to some point. I used 1080i recordings from HDNet and other sources as well as DVD video to verify. MP4 does not exhibit the behavior for some reason.

I am using all hard wired connections through a gigabit router/switch.

Just wanted to write back that I have now seen this stuttering issue. I had a 720p H.264/MP4 that had some time stamp issue or glitch or something (didnt bother to debug) and it would only transfer the first 13 mins of the video. So I decided to just pull it and have my machine transcode it to MPEG2. I waited a few minutes for it to buffer, however, when I tried to watch the video, it was stuttering quite badly. I waited for it to completely transfer and it play back just fine. Weird.

[lpwcomp]

Any one have any suggestions on the best settings to use in VirtualDub when saving as avi that will result in a reasonably sized file while still having a decent re-transcode/transfer speed when being pulled to a TiVo 2?

[lrhorer]

I just switched over from Time Warner Cable to Grande, and they offer a "free" Premier with my level of service. I can transfer from the Premier just fine, and I can pull from the server just fine, but when I try to push from the server using the web utility I get:

ERROR:pyTivo.video.video:<error><code>authenticationFailed</code><text>AccountId provided/derived does not match AccountId looked up from bodyId</text></error>

Nothing transfers. I can still push to my other TiVos with no problems.

[txporter]

Originally Posted by lpwcomp

Any one have any suggestions on the best settings to use in VirtualDub when saving as avi that will result in a reasonably sized file while still having a decent re-transcode/transfer speed when being pulled to a TiVo 2?

Any reason that you want to use VirtualDub/MPEG4 pt.2? Tivo2 will need to be fed MPEG2, so whatever you transcode to (other than MPEG2) will need to be transcoded again to bring up to your Tivo. Is it just a desire to save space? Your best bet there would be to transcode to H.264/MP4 then. The transcode back will be somewhat more time consuming then XVID/AVI, but the file size will be a little smaller. And those files will be compatible with TivoHD/Premiere/Elite for pushing without the need for transcode.

For H.264/MP4, you can use something like kmttg and one of its encoding profiles or Handbrake or MeGUI or..., there are a LOT of options.

For XVID/AVI, I guess you will need to stick with VirtualDub. I have little/no experience with it. There are other programs that you can transcode to XVID/AVI but support for that codec/container is waning.

[lpwcomp]

Originally Posted by txporter

Any reason that you want to use VirtualDub/MPEG4 pt.2? Tivo2 will need to be fed MPEG2, so whatever you transcode to (other than MPEG2) will need to be transcoded again to bring up to your Tivo. Is it just a desire to save space? Your best bet there would be to transcode to H.264/MP4 then. The transcode back will be somewhat more time consuming then XVID/AVI, but the file size will be a little smaller. And those files will be compatible with TivoHD/Premiere/Elite for pushing without the need for transcode.

For H.264/MP4, you can use something like kmttg and one of its encoding profiles or Handbrake or MeGUI or..., there are a LOT of options.

For XVID/AVI, I guess you will need to stick with VirtualDub. I have little/no experience with it. There are other programs that you can transcode to XVID/AVI but support for that codec/container is waning.

I'm using vdub to edit and save because it's free and easy to use. If you know of another free tool or combination thereof that I could easily edit with and create a file that is fairly small but transcodes back at real time or better, I'd be happy to try that.

I am recording a weekday 1/2 hour show for a friend. I then have to transport them to her at some point and put them on her computer. She then downloads them to her TiVo 2 via pyTivo. The most recent "delivery" involved more than 40 files, so size is definitely an issue. But the transfer to her TiVo runs at about 9fps, thus takes over an hour for the 20min (edited) show.

I made some changes in the vdub setting which resulted in a significant reduction in file size and some in the time for the final transfer but I am looking for further reductions if possible, particularly in the transfer time w/o sacrificing file size.

[txporter]

Originally Posted by lpwcomp

I'm using vdub to edit and save because it's free and easy to use. If you know of another free tool or combination thereof that I could easily edit with and create a file that is fairly small but transcodes back at real time or better, I'd be happy to try that.

I am recording a weekday 1/2 hour show for a friend. I then have to transport them to her at some point and put them on her computer. She then downloads them to her TiVo 2 via pyTivo. The most recent "delivery" involved more than 40 files, so size is definitely an issue. But the transfer to her TiVo runs at about 9fps, thus takes over an hour for the 20min (edited) show.

I made some changes in the vdub setting which resulted in a significant reduction in file size and some in the time for the final transfer but I am looking for further reductions if possible, particularly in the transfer time w/o sacrificing file size.

Do you know what the processor is in your friends computer? Perhaps she needs to set up the -threads parameter for ffmpeg to utilize all cores when transcoding.

You could try using Avidemux instead of Virtualdub for editting and transcoding. It is also free and has more options for what formats to output to, I think. I don't really use either one though. I use Videoredo for editting (not free) and then avisynth+x264 for transcoding.

If your main concern is the speed at which things transfer to her Tivo2, your best bet would probably be to invest in VRD v3 (or v4 but you don't sound like you really need H.264 capability) and a large-ish external hard drive. Supplying her with MPEG2 files will eliminate her need to transcode which will greatly improve the transfer times.

[lpwcomp]

Originally Posted by txporter

Do you know what the processor is in your friends computer? Perhaps she needs to set up the -threads parameter for ffmpeg to utilize all cores when transcoding.

You could try using Avidemux instead of Virtualdub for editting and transcoding. It is also free and has more options for what formats to output to, I think. I don't really use either one though. I use Videoredo for editting (not free) and then avisynth+x264 for transcoding.

If your main concern is the speed at which things transfer to her Tivo2, your best bet would probably be to invest in VRD v3 (or v4 but you don't sound like you really need H.264 capability) and a large-ish external hard drive. Supplying her with MPEG2 files will eliminate her need to transcode which will greatly improve the transfer times.

Investing in much of anything at this time is not an option. I'm considering acquiring a 16GB thumb drive so I don't have to use any DVD RWs (always seem to have a couple of files per DVD that won't copy to her computer), but that's about it.

Her machine is a laptop running Vista. Don't know if it is dual core or not. The thing is, transcode/transfer of avis she downloads run at a reasonable speed. While I may not be able to get that kind of performance using free tools, I should be able to make it better than it is.

I'll take a look at avidemux and am also looking at projectx but for the near term I was asking if anyone has suggestions for optimum vdub settings.

[aaronwt]

A 16GB thumb drive is only $6 to $8 dollars now. I stopped using RWs to carry files on years ago since the capacity was either too small or it took too long to burn like with the RW BDs. Plus flash memory is so inexpensive now and keeps going lower in price.

[lrhorer]

Well, the push to the Premier started working. I guess it just took a while for the mind server to catch up. I'm not terribly impressed by the Premier now that I have one, any more than before, but I do have to admit its networking is very fast. I just transferred an h.264 file via put at more than 15x real time. It took barely 9 minutes to transfer a 1080i movie that was nearly 2 hours long. The average throughput was 93.99 Mbps. Another .mpg program transferred at a bit over 50 Mbps. How much longer this CATV company is going to set CCI=0x00 is anybody's guess, though.

[kevo777]

Originally Posted by lpwcomp

Any one have any suggestions on the best settings to use in VirtualDub when saving as avi that will result in a reasonably sized file while still having a decent re-transcode/transfer speed when being pulled to a TiVo 2?

You don't want to re-encode to AVI before pushing back to TiVo. TiVo won't read your AVI file. My advice is to stop using AVI. Stick with MP4, MPG, and even MKV.

txporter is right. Handbrake is probably easiest to use. MeGUI gives more options but requires AVISynth script as input. kmttg looks interesting. Haven't used it (yet). But remember, file format (the three letter extension like AVI, MP4, etc.) doesn't determine file size. The bitrates of the audio and video codec streams do, like H264, AAC, MPEG-2, and AC-3. AVI can't handle H264 and AAC very well (requires hacking if memory serves). But that's a whole other thread that I know nothing about.

[lpwcomp]

Originally Posted by aaronwt

A 16GB thumb drive is only $6 to $8 dollars now. I stopped using RWs to carry files on years ago since the capacity was either too small or it took too long to burn like with the RW BDs. Plus flash memory is so inexpensive now and keeps going lower in price.

I found 1 at $8 with shipping of $7.95. Cheapest is more like $9.99 + tax. Still fairly inexpensive but it's all relative. I have a very small income, even less disposable income. Spend $10 on one thing and I have to forgo something else.

The reason I am still using the DVD RWs is - I have them. I also have a 4GB and a 2GB thumb drive. I had another 2GB drive but the person for whom I am doing this, um, misplaced it. The two 2GB drives I bought years ago, DVD RWs even longer ago. The 4GB drive was free (from Micro Center).

[jcthorne]

If the end path is to a Tivo series 2 then you should be storing the video to mpg files ONLY. That way they can transfer without transcoding, they transfer as is and should be much faster than what you are doing now. The files will be a bit larger but that is what they are being converted to when sent to the Tivo series 2 anyway. Still should be under 1GB per half hour episide even for mpeg 2.

Use kmttg and just have it decrypt and store as mpg. No further processing required.

[lpwcomp]

Originally Posted by jcthorne

If the end path is to a Tivo series 2 then you should be storing the video to mpg files ONLY. That way they can transfer without transcoding, they transfer as is and should be much faster than what you are doing now. The files will be a bit larger but that is what they are being converted to when sent to the Tivo series 2 anyway. Still should be under 1GB per half hour episide even for mpeg 2.

Use kmttg and just have it decrypt and store as mpg. No further processing required.

I do not have the capacity to transport 30-40 mpg files (the most recent one was actually 51). She doesn't have the space to store them on her computer. There isn't time to download all of them to her TiVo while I am there.

I made some changes to the vdub settings and the file size is 220-240MB plus the transcode/transfer speed back to the TiVo was slightly increased. What I am asking is - are there any settings that I can use to keep or even reduce the file size further and speed up the final transcode/transfer.

Think of this as creating files intended for bittorrrent, except that instead of the internet, I am utilizing sneaker+MARTA net.

[txporter]

Originally Posted by lpwcomp

I do not have the capacity to transport 30-40 mpg files (the most recent one was actually 51). She doesn't have the space to store them on her computer. There isn't time to download all of them to her TiVo while I am there.

I made some changes to the vdub settings and the file size is 220-240MB plus the transcode/transfer speed back to the TiVo was slightly increased. What I am asking is - are there any settings that I can use to keep or even reduce the file size further and speed up the final transcode/transfer.

Think of this as creating files intended for bittorrrent, except that instead of the internet, I am utilizing sneaker+MARTA net.

Do you care about final video quality? In general, XVID to MPEG2 transcoding will take about the same time for a given video length regardless of the bitrate used for the file. If you want to speed up transcoding, the first thing to look at is whether her cpu is being fully utilized in the transcode. Is she using pytivo? Does she have the -threads parameter defined if she has a multi-core computer?

If you still cannot find a happy space with the files and computer that you have, you can always reduce the resolution of the files. It will make the quality worse when blown up for TV viewing, but it should produce smaller files and they should transcode more quickly.

[wmcbrine]

lpwcomp, does your friend have Internet access? If so, you can set up pyTivo on your end to push to her. It's not limited to the LAN, although you have to set some special options.

[lpwcomp]

Originally Posted by wmcbrine

lpwcomp, does your friend have Internet access? If so, you can set up pyTivo on your end to push to her. It's not limited to the LAN, although you have to set some special options.

Yes, she does.

I assume that I would create a section for her TiVo, with her ID, password, and MAK.

Ok. I googled "push to remote Tivo" and one of things that came up was this. So, for the externalurl entry, will a an IP address work? Also, does this only work for pushes or would my shares be available for her to pull?

OK.1 Set it up as documented and the push fails in pyTivo with the following in the pyTivo seesion:

INFO:pyTivo.video.video:[19/Jun/2012 23:16:37] Queued "F:\Video\Sue's AVIs\Copie
d\Jeopardy.20120510.avi" for Push to 1300000801E990C
INFO:pyTivo:127.0.0.1 [19/Jun/2012 23:16:37] "POST /TiVoConnect HTTP/1.1" 200 -
INFO:pyTivo:127.0.0.1 [19/Jun/2012 23:16:37] "GET /favicon.ico HTTP/1.1" 200 -
INFO:pyTivo:127.0.0.1 [19/Jun/2012 23:16:43] "GET /TiVoConnect?Command=QueryCont
ainer&Container=TiVoToGo/Sue%27s%20AVIs/Copied&Format=text/html HTTP/1.1" 200 -
INFO:pyTivo:127.0.0.1 [19/Jun/2012 23:16:43] "GET /main.css HTTP/1.1" 200 -
INFO:pyTivo:127.0.0.1 [19/Jun/2012 23:16:43] "GET /favicon.ico HTTP/1.1" 200 -
ERROR:pyTivo.video.video:<error><code>authenticationFailed</code><text>AccountId
provided/derived does not match AccountId looked up from bodyId</text></error>

OK.2 Found that problem. A blank at the end of her TSN in the pyTivo conf file.

Now I have:

INFO:pyTivo:<my public ip address> [19/Jun/2012 23:36:12] code 404, message Not Found
INFO:pyTivo:<my public ip address> [19/Jun/2012 23:36:12] "GET /Sue's%20AVIs/Copied/Jeopard
y.20120510.avi?Format=video%2Fmpeg HTTP/1.1" 404 -
INFO:pyTivo:<my public ip address> [19/Jun/2012 23:36:49] code 404, message Not Found
INFO:pyTivo:<my public ip address> [19/Jun/2012 23:36:49] "GET /Sue's%20AVIs/Copied/Jeopard
y.20120510.avi?Format=video%2Fmpeg HTTP/1.1" 404 -

[wmcbrine]

There's a spot in the external URL handling where it looks like it loses a level. I've known about this for some time, but never had anyone to test with, so I left it alone. Can I ask, what is the path for the share used in this case? Is it "F:\Video", or "F:\Video\Sue's AVIs"? And what is the share name?

I think you should be able to make pulls work as well. First, you'd have to set up pyTivo on port 80. Then, use the "Manually Add a Server" function on the remote TiVo to specify the external IP of the pyTivo server. But again, I've never actually been able to test this.

[wmcbrine]

Originally Posted by lpwcomp

Does pyTivo validate that the requesting TiVo is either local or explicitly defined in the config file?

It does if you add the "allowedips" keyword in the Server section:

allowedips = 127.0.0.1 192.168.1.

Otherwise, it's open.

[wmcbrine]

Originally Posted by wmcbrine

There's a spot in the external URL handling where it looks like it loses a level.

OK, I have a patch for this in my repos now. Please try it and let me know if it works.

[lpwcomp]

Originally Posted by wmcbrine

OK, I have a patch for this in my repos now. Please try it and let me know if it works.

That seems to have fixed it. It is transferring even as I type. Slowly(5fps), but it is going. Thanks for the quick fix! Hopefully it will be in good shape. Otherwise, she may want to kill me when I tell her about my "oops".

Well, it is supposedly finished but I'm a bit trepidatious about it. Way too soon and it didn't end cleanly. Do you want me to post the pyTivo output, after suitable editing?

It may be a while before I try to test remote pulls. I was playing around with it this afternoon and my internet connection went completely wonky. I eventually had to reset the u-verse gateway to factory settings.

[wmcbrine]

Well, I don't know what "didn't end cleanly" means, so yeah, I guess so. But I doubt there's anything further I can do. You could retry it, I guess.

[lpwcomp]

By not cleanly, I mean that there were lines like this:

INFO:pyTivo.video.transcode:[Errno 10053] An established connection was aborted
by the software in your host machine

and

ERROR:pyTivo:Exception during request from ('99.112.4.99', 3130)

The latter folllowed by a traceback. If this is just a function of having debug enabled, then sorry. Even if it isn't, it may just be network problems, in which case there's nothing much either one of us can do. I did also send an mpg created via a decode of a TiVo 2 recording. Completed with no errors, as you can see from the last few lines of the file.

Here's the output:

DEBUG:pyTivo.video.transcode:CACHE HIT! F:\Video\Sue's AVIs\Copied\Jeopardy.2012
0515.avi
DEBUG:pyTivo.video.transcode:audio_lang: None
DEBUG:pyTivo.video.transcode:selected audio stream: 0.1
DEBUG:pyTivo.video.transcode:transcoding to tivo model 130 using ffmpeg command:

DEBUG:pyTivo.video.transcode:C:\pyTivo\bin\old_ffmpeg.exe -i F:\Video\Sue's AVIs
\Copied\Jeopardy.20120515.avi -vcodec mpeg2video -r 29.97 -b 4096k -maxrate 3000
0k -bufsize 1024k -aspect 4:3 -s 544x360 -padtop 60 -padbottom 60 -ab 448k -ar 4
8000 -acodec copy -copyts -map 0.0 -map 0.1 -f vob -
FFmpeg version SVN-r21659-rdian06-1.02-win-x86_32, Copyright (c) 2000-2010 Fabri
ce Bellard, et al.
  built on Aug 24 2010 20:46:16 with gcc 4.4.0
  configuration: --enable-memalign-hack --disable-debug --enable-hardcoded-table
s --enable-runtime-cpudetect --enable-static --disable-shared --disable-ffserver
 --disable-ffplay --enable-gpl --enable-pthreads --enable-libmp3lame --enable-li
bvorbis --enable-libtheora --enable-libspeex --enable-libgsm --enable-libx264 --
enable-libschroedinger --enable-libfaad --enable-libxvid --disable-decoder=aac -
-enable-avisynth --enable-postproc --enable-avfilter --enable-avfilter-lavf
  libavutil     50. 8. 0 / 50. 8. 0
  libavcodec    52.52. 0 / 52.52. 0
  libavformat   52.50. 0 / 52.50. 0
  libavdevice   52. 2. 0 / 52. 2. 0
  libavfilter    1.17. 0 /  1.17. 0
  libswscale     0.10. 0 /  0.10. 0
  libpostproc   51. 2. 0 / 51. 2. 0
Input #0, avi, from 'F:\Video\Sue's AVIs\Copied\Jeopardy.20120515.avi':
  Duration: 00:19:19.45, start: 0.000000, bitrate: 2040 kb/s
    Stream #0.0: Video: mpeg4, yuv420p, 1920x1080 [PAR 1:1 DAR 16:9], 29.97 tbr,
 29.97 tbn, 29.97 tbc
    Stream #0.1: Audio: ac3, 48000 Hz, 5.1, s16, 384 kb/s
Output #0, vob, to 'pipe:':
    Stream #0.0: Video: mpeg2video, yuv420p, 544x480 [PAR 20:17 DAR 4:3], q=2-31
, 4096 kb/s, 90k tbn, 29.97 tbc
    Stream #0.1: Audio: ac3, 48000 Hz, 5.1, 384 kb/s
Stream mapping:
  Stream #0.0 -> #0.0
  Stream #0.1 -> #0.1
Press [q] to stop encoding
INFO:pyTivo:127.0.0.1 [20/Jun/2012 23:38:21] "GET /main.css HTTP/1.1" 200 -
INFO:pyTivo:127.0.0.1 [20/Jun/2012 23:38:21] "GET /plugins/settings/settings.js
HTTP/1.1" 200 -
INFO:pyTivo:127.0.0.1 [20/Jun/2012 23:38:21] "GET /plugins/settings/settings.css
 HTTP/1.1" 200 -
INFO:pyTivo:127.0.0.1 [20/Jun/2012 23:38:21] "GET /favicon.ico HTTP/1.1" 200 -
INFO:pyTivo.video.transcode:[Errno 10053] An established connection was aborted
by the software in your host machine
INFO:pyTivo.video.video:[Errno 10053] An established connection was aborted by t
he software in your host machine
INFO:pyTivo.video.video:[20/Jun/2012 23:40:48] Done sending "F:\Video\Sue's AVIs
\Copied\Jeopardy.20120515.avi" to 99.112.4.99, 11534336 bytes, 0.26 Mb/s
ERROR:pyTivo:Exception during request from ('99.112.4.99', 3130)
Traceback (most recent call last):
  File "C:\Python27\lib\SocketServer.py", line 582, in process_request_thread
    self.finish_request(request, client_address)
  File "C:\Python27\lib\SocketServer.py", line 323, in finish_request
    self.RequestHandlerClass(request, client_address, self)
  File "C:\pyTivo\httpserver.py", line 85, in __init__
    client_address, server)
  File "C:\Python27\lib\SocketServer.py", line 641, in __init__
    self.finish()
  File "C:\Python27\lib\SocketServer.py", line 694, in finish
    self.wfile.flush()
  File "C:\Python27\lib\socket.py", line 303, in flush
    self._sock.sendall(view[write_offset:write_offset+buffer_size])
error: [Errno 10053] An established connection was aborted by the software in yo
ur host machine
DEBUG:pyTivo.video.transcode:CACHE HIT! F:\Video\Sue's AVIs\Copied\Jeopardy.2012
0515.avi
DEBUG:pyTivo.video.transcode:TRANSCODE=YES, vCodec mpeg4 not compatible, F:\Vide
o\Sue's AVIs\Copied\Jeopardy.20120515.avi
INFO:pyTivo:99.112.4.99 [20/Jun/2012 23:41:36] "GET /TiVoToGo/Sue's%20AVIs/Copie
d/Jeopardy.20120515.avi?Format=video%2Fmpeg HTTP/1.1" 206 -
INFO:pyTivo.video.video:[20/Jun/2012 23:41:36] Start sending "F:\Video\Sue's AVI
s\Copied\Jeopardy.20120515.avi" to 99.112.4.99
DEBUG:pyTivo.video.video:"F:\Video\Sue's AVIs\Copied\Jeopardy.20120515.avi" is n
ot tivo compatible
INFO:pyTivo.video.transcode:[Errno 10054] An existing connection was forcibly cl
osed by the remote host
INFO:pyTivo.video.video:[Errno 10054] An existing connection was forcibly closed
 by the remote host
INFO:pyTivo.video.video:[20/Jun/2012 23:41:43] Done sending "F:\Video\Sue's AVIs
\Copied\Jeopardy.20120515.avi" to 99.112.4.99, 0 bytes, 0.00 Mb/s
ERROR:pyTivo:Exception during request from ('99.112.4.99', 3134)
Traceback (most recent call last):
  File "C:\Python27\lib\SocketServer.py", line 582, in process_request_thread
    self.finish_request(request, client_address)
  File "C:\Python27\lib\SocketServer.py", line 323, in finish_request
    self.RequestHandlerClass(request, client_address, self)
  File "C:\pyTivo\httpserver.py", line 85, in __init__
    client_address, server)
  File "C:\Python27\lib\SocketServer.py", line 641, in __init__
    self.finish()
  File "C:\Python27\lib\SocketServer.py", line 694, in finish
    self.wfile.flush()
  File "C:\Python27\lib\socket.py", line 303, in flush
    self._sock.sendall(view[write_offset:write_offset+buffer_size])
error: [Errno 10054] An existing connection was forcibly closed by the remote ho
st
DEBUG:pyTivo.video.transcode:CACHE HIT! F:\Video\Sue's AVIs\Copied\Jeopardy.2012
0515.avi
DEBUG:pyTivo.video.transcode:TRANSCODE=YES, vCodec mpeg4 not compatible, F:\Vide
o\Sue's AVIs\Copied\Jeopardy.20120515.avi
INFO:pyTivo:99.112.4.99 [20/Jun/2012 23:42:13] "GET /TiVoToGo/Sue's%20AVIs/Copie
d/Jeopardy.20120515.avi?Format=video%2Fmpeg HTTP/1.1" 206 -
INFO:pyTivo.video.video:[20/Jun/2012 23:42:13] Start sending "F:\Video\Sue's AVI
s\Copied\Jeopardy.20120515.avi" to 99.112.4.99
DEBUG:pyTivo.video.video:"F:\Video\Sue's AVIs\Copied\Jeopardy.20120515.avi" is n
ot tivo compatible
INFO:pyTivo:192.168.1.103 [20/Jun/2012 23:44:15] "GET /TiVoConnect?Command=Query
Container&Container=%2F HTTP/1.0" 200 -
INFO:pyTivo:127.0.0.1 [20/Jun/2012 23:45:49] "GET /favicon.ico HTTP/1.1" 200 -
INFO:pyTivo:127.0.0.1 [20/Jun/2012 23:45:54] "GET /TiVoConnect?Command=QueryCont
ainer&Container=GVideo&Format=text/html HTTP/1.1" 200 -
INFO:pyTivo:127.0.0.1 [20/Jun/2012 23:45:54] "GET /main.css HTTP/1.1" 200 -
INFO:pyTivo:127.0.0.1 [20/Jun/2012 23:45:54] "GET /folder.png HTTP/1.1" 200 -
INFO:pyTivo:127.0.0.1 [20/Jun/2012 23:45:54] "GET /favicon.ico HTTP/1.1" 200 -
INFO:pyTivo:127.0.0.1 [20/Jun/2012 23:45:56] "GET /TiVoConnect?Command=QueryCont
ainer&Container=GVideo/kmttgmpegs&Format=text/html HTTP/1.1" 200 -
INFO:pyTivo:127.0.0.1 [20/Jun/2012 23:45:56] "GET /TiVoConnect?Command=QueryCont
ainer&Container=GVideo/kmttgmpegs&Format=text/html HTTP/1.1" 200 -
INFO:pyTivo:127.0.0.1 [20/Jun/2012 23:45:56] "GET /main.css HTTP/1.1" 200 -
INFO:pyTivo:127.0.0.1 [20/Jun/2012 23:45:57] "GET /favicon.ico HTTP/1.1" 200 -
INFO:pyTivo:127.0.0.1 [20/Jun/2012 23:46:04] "GET /favicon.ico HTTP/1.1" 200 -
INFO:pyTivo:127.0.0.1 [20/Jun/2012 23:46:48] "GET /TiVoConnect?Command=QueryCont
ainer&Container=GVideo/kmttgmpegs&Format=text/html HTTP/1.1" 200 -
INFO:pyTivo:127.0.0.1 [20/Jun/2012 23:46:48] "GET /main.css HTTP/1.1" 200 -
INFO:pyTivo:127.0.0.1 [20/Jun/2012 23:46:48] "GET /favicon.ico HTTP/1.1" 200 -
INFO:pyTivo:127.0.0.1 [20/Jun/2012 23:47:02] "GET /favicon.ico HTTP/1.1" 200 -
INFO:pyTivo:127.0.0.1 [20/Jun/2012 23:50:20] "GET /TiVoConnect?Command=QueryCont
ainer&Container=GVideo/kmttgmpegs&Format=text/html HTTP/1.1" 200 -
INFO:pyTivo:127.0.0.1 [20/Jun/2012 23:50:20] "GET /main.css HTTP/1.1" 200 -
INFO:pyTivo:127.0.0.1 [20/Jun/2012 23:50:20] "GET /favicon.ico HTTP/1.1" 200 -
INFO:pyTivo:127.0.0.1 [20/Jun/2012 23:51:23] "GET /favicon.ico HTTP/1.1" 200 -
INFO:pyTivo:127.0.0.1 [20/Jun/2012 23:51:35] "GET /TiVoConnect?Command=QueryCont
ainer&Container=GVideo/kmttgmpegs&Format=text/html HTTP/1.1" 200 -
INFO:pyTivo:127.0.0.1 [20/Jun/2012 23:51:36] "GET /main.css HTTP/1.1" 200 -
INFO:pyTivo:127.0.0.1 [20/Jun/2012 23:51:36] "GET /favicon.ico HTTP/1.1" 200 -
INFO:pyTivo.video.video:[20/Jun/2012 23:53:18] Queued "G:\\kmttgmpegs\Jeopardy!.
20120620.mpg" for Push to 99.112.4.99
INFO:pyTivo:127.0.0.1 [20/Jun/2012 23:53:18] "POST /TiVoConnect HTTP/1.1" 200 -
INFO:pyTivo:127.0.0.1 [20/Jun/2012 23:53:18] "GET /favicon.ico HTTP/1.1" 200 -
DEBUG:pyTivo.video.transcode:starting ffmpeg, will wait 10 seconds for it to com
plete
INFO:pyTivo:127.0.0.1 [20/Jun/2012 23:53:23] "GET /TiVoConnect?Command=QueryCont
ainer&Container=GVideo/kmttgmpegs&Format=text/html HTTP/1.1" 200 -
INFO:pyTivo:127.0.0.1 [20/Jun/2012 23:53:23] "GET /main.css HTTP/1.1" 200 -
DEBUG:pyTivo.video.transcode:ffmpeg output=FFmpeg version SVN-r21659-rdian06-1.0
2-win-x86_32, Copyright (c) 2000-2010 Fabrice Bellard, et al.
  built on Aug 24 2010 20:46:16 with gcc 4.4.0
  configuration: --enable-memalign-hack --disable-debug --enable-hardcoded-table
s --enable-runtime-cpudetect --enable-static --disable-shared --disable-ffserver
 --disable-ffplay --enable-gpl --enable-pthreads --enable-libmp3lame --enable-li
bvorbis --enable-libtheora --enable-libspeex --enable-libgsm --enable-libx264 --
enable-libschroedinger --enable-libfaad --enable-libxvid --disable-decoder=aac -
-enable-avisynth --enable-postproc --enable-avfilter --enable-avfilter-lavf
  libavutil     50. 8. 0 / 50. 8. 0
  libavcodec    52.52. 0 / 52.52. 0
  libavformat   52.50. 0 / 52.50. 0
  libavdevice   52. 2. 0 / 52. 2. 0
  libavfilter    1.17. 0 /  1.17. 0
  libswscale     0.10. 0 /  0.10. 0
  libpostproc   51. 2. 0 / 51. 2. 0
[mpeg @ 0x186dd10]max_analyze_duration reached

Seems stream 1 codec frame rate differs from container frame rate: 59.94 (60000/
1001) -> 29.97 (60000/2002)
Input #0, mpeg, from 'G:\\kmttgmpegs\Jeopardy!.20120620.mpg':
  Duration: 00:31:00.56, start: 0.982278, bitrate: 1722 kb/s
    Stream #0.0[0x1c0]: Audio: mp2, 48000 Hz, 2 channels, s16, 192 kb/s
    Stream #0.1[0x1e0]: Video: mpeg2video, yuv420p, 352x480 [PAR 20:11 DAR 4:3],
 1447 kb/s, 29.97 fps, 29.97 tbr, 90k tbn, 59.94 tbc
At least one output file must be specified

DEBUG:pyTivo.video.transcode:aFreq=48000; aCh=2; container=mpeg; kbps=1722; mapA
udio=[('0.0', '[0x1c0] mp2, 48000 Hz, 2 channels, s16, 192 kb/s\r')]; vHeight=48
0; vCodec=mpeg2video; Supported=True; aKbps=192; par=None; millisecs=1860560; vF
ps=29.97; par2=1.81818181818; par1=20:11; mapVideo=0.1; vWidth=352; dar1=4:3; ra
wmeta={}; aCodec=mp2
DEBUG:pyTivo.video.transcode:CACHE HIT! G:\\kmttgmpegs\Jeopardy!.20120620.mpg
DEBUG:pyTivo.video.transcode:CACHE HIT! G:\\kmttgmpegs\Jeopardy!.20120620.mpg
DEBUG:pyTivo.video.transcode:CACHE HIT! G:\\kmttgmpegs\Jeopardy!.20120620.mpg
DEBUG:pyTivo.video.transcode:TRANSCODE=NO, all compatible, G:\\kmttgmpegs\Jeopar
dy!.20120620.mpg
INFO:pyTivo:127.0.0.1 [20/Jun/2012 23:53:23] "GET /favicon.ico HTTP/1.1" 200 -

<pcBodyList><isBottom>true</isBottom><isTop>true</isTop><pcBody><bucketNumber>-1
</bucketNumber><levelOfDetail>low</levelOfDetail><name>pyTivo</name><pcBodyId>ti
vo:pc.1002175891</pcBodyId><type>pcBody</type></pcBody></pcBodyList>g
DEBUG:pyTivo.mind:bodyOfferModify&bodyId=tsn:1300000801E990C= 3430.8kbps
{'subtitle': '2012-06-20', 'description': '', 'pcBodyId': 'tivo:pc.1002175891',
'publishDate': '2012-06-21 03:5324', 'partnerId': 'tivo:pt.3187', 'duration': 18
60, 'size': 400612715, 'title': 'Jeopardy!', 'url': 'http://99.116.217.37:9032/G
Video/kmttgmpegs/Jeopardy%21.20120620.mpg?Format=video/mpeg', 'bodyId': 'tsn:130
0000801E990C', 'source': 'SH002348', 'state': 'complete', 'encodingType': 'mpeg2
ProgramStream', 'tvRating': 'nr'}

<bodyOffer><bodyId>tsn:1300000801E990C</bodyId><bodyOfferId>tivo:bo.15000081</bo
dyOfferId><createDate>2012-06-21 03:53:48</createDate><description /><duration>1
860</duration><encodingType>mpeg2ProgramStream</encodingType><levelOfDetail>high
</levelOfDetail><offerId>tivo:of.bs.15000081</offerId><partnerId>tivo:pt.3187</p
artnerId><pcBodyId>tivo:pc.1002175891</pcBodyId><publishDate>2012-06-24 19:44:00
</publishDate><size>400612715</size><source>SH002348</source><state>complete</st
ate><subtitle>2012-06-20</subtitle><title>Jeopardy!</title><tvRating>nr</tvRatin
g><updateDate>2012-06-21 03:53:48</updateDate><url>http://99.116.217.37:9032/GVi
deo/kmttgmpegs/Jeopardy%21.20120620.mpg?Format=video/mpeg</url></bodyOffer>g
DEBUG:pyTivo.mind:subscribe&bodyId=tsn:1300000801E990C48 brt= 3426.5kbps
{'uiType': 'cds', 'idSetSource': {'contentId': 'tivo:ct.bs.15000081', 'type': 's
ingleOfferSource', 'offerId': 'tivo:of.bs.15000081'}, 'bodyId': 'tsn:1300000801E
990C', 'title': 'pcBodySubscription'}

<subscribeResult><subscription><autoRecord>true</autoRecord><bodyGeneratesCandid
ates>false</bodyGeneratesCandidates><bodyId>tsn:1300000801E990C</bodyId><hdOnly>
false</hdOnly><idSetSource><contentId>tivo:ct.bs.15000081</contentId><offerId>ti
vo:of.bs.15000081</offerId><type>singleOfferSource</type></idSetSource><isAdult>
false</isAdult><isForKids>false</isForKids><levelOfDetail>high</levelOfDetail><s
howStatus>rerunsAllowed</showStatus><subscriptionId>tivo:sb.15000091</subscripti
onId><title>pcBodySubscription</title><type>subscription</type><uiType>cds</uiTy
pe></subscription></subscribeResult>g
INFO:pyTivo:192.168.1.103 [21/Jun/2012 00:21:55] "GET /TiVoConnect?Command=Query
Container&Container=%2F HTTP/1.0" 200 -
INFO:pyTivo.video.transcode:[Errno 10054] An existing connection was forcibly cl
osed by the remote host
INFO:pyTivo.video.video:[Errno 10054] An existing connection was forcibly closed
 by the remote host
INFO:pyTivo.video.video:[21/Jun/2012 00:47:40] Done sending "F:\Video\Sue's AVIs
\Copied\Jeopardy.20120515.avi" to 99.112.4.99, 257949696 bytes, 0.50 Mb/s
ERROR:pyTivo:Exception during request from ('99.112.4.99', 3135)
Traceback (most recent call last):
  File "C:\Python27\lib\SocketServer.py", line 582, in process_request_thread
    self.finish_request(request, client_address)
  File "C:\Python27\lib\SocketServer.py", line 323, in finish_request
    self.RequestHandlerClass(request, client_address, self)
  File "C:\pyTivo\httpserver.py", line 85, in __init__
    client_address, server)
  File "C:\Python27\lib\SocketServer.py", line 641, in __init__
    self.finish()
  File "C:\Python27\lib\SocketServer.py", line 694, in finish
    self.wfile.flush()
  File "C:\Python27\lib\socket.py", line 303, in flush
    self._sock.sendall(view[write_offset:write_offset+buffer_size])
error: [Errno 10054] An existing connection was forcibly closed by the remote ho
st
DEBUG:pyTivo.video.transcode:starting ffmpeg, will wait 10 seconds for it to com
plete
DEBUG:pyTivo.video.transcode:ffmpeg output=FFmpeg version SVN-r21659-rdian06-1.0
2-win-x86_32, Copyright (c) 2000-2010 Fabrice Bellard, et al.
  built on Aug 24 2010 20:46:16 with gcc 4.4.0
  configuration: --enable-memalign-hack --disable-debug --enable-hardcoded-table
s --enable-runtime-cpudetect --enable-static --disable-shared --disable-ffserver
 --disable-ffplay --enable-gpl --enable-pthreads --enable-libmp3lame --enable-li
bvorbis --enable-libtheora --enable-libspeex --enable-libgsm --enable-libx264 --
enable-libschroedinger --enable-libfaad --enable-libxvid --disable-decoder=aac -
-enable-avisynth --enable-postproc --enable-avfilter --enable-avfilter-lavf
  libavutil     50. 8. 0 / 50. 8. 0
  libavcodec    52.52. 0 / 52.52. 0
  libavformat   52.50. 0 / 52.50. 0
  libavdevice   52. 2. 0 / 52. 2. 0
  libavfilter    1.17. 0 /  1.17. 0
  libswscale     0.10. 0 /  0.10. 0
  libpostproc   51. 2. 0 / 51. 2. 0
[mpeg @ 0x186dd10]max_analyze_duration reached

Seems stream 1 codec frame rate differs from container frame rate: 59.94 (60000/
1001) -> 29.97 (60000/2002)
Input #0, mpeg, from 'G:\kmttgmpegs\Jeopardy!.20120620.mpg':
  Duration: 00:31:00.56, start: 0.982278, bitrate: 1722 kb/s
    Stream #0.0[0x1c0]: Audio: mp2, 48000 Hz, 2 channels, s16, 192 kb/s
    Stream #0.1[0x1e0]: Video: mpeg2video, yuv420p, 352x480 [PAR 20:11 DAR 4:3],
 1447 kb/s, 29.97 fps, 29.97 tbr, 90k tbn, 59.94 tbc
At least one output file must be specified

DEBUG:pyTivo.video.transcode:aFreq=48000; aCh=2; container=mpeg; kbps=1722; mapA
udio=[('0.0', '[0x1c0] mp2, 48000 Hz, 2 channels, s16, 192 kb/s\r')]; vHeight=48
0; vCodec=mpeg2video; Supported=True; aKbps=192; par=None; millisecs=1860560; vF
ps=29.97; par2=1.81818181818; par1=20:11; mapVideo=0.1; vWidth=352; dar1=4:3; ra
wmeta={}; aCodec=mp2
DEBUG:pyTivo.video.transcode:TRANSCODE=NO, all compatible, G:\kmttgmpegs\Jeopard
y!.20120620.mpg
INFO:pyTivo:99.112.4.99 [21/Jun/2012 00:47:53] "GET /GVideo/kmttgmpegs/Jeopardy!
.20120620.mpg?Format=video%2Fmpeg HTTP/1.1" 200 -
INFO:pyTivo.video.video:[21/Jun/2012 00:47:53] Start sending "G:\kmttgmpegs\Jeop
ardy!.20120620.mpg" to 99.112.4.99
DEBUG:pyTivo.video.video:"G:\kmttgmpegs\Jeopardy!.20120620.mpg" is tivo compatib
le
DEBUG:pyTivo.video.transcode:killing pid=2932
INFO:pyTivo.video.video:[21/Jun/2012 01:27:58] Done sending "G:\kmttgmpegs\Jeopa
rdy!.20120620.mpg" to 99.112.4.99, 400612715 bytes, 1.27 Mb/s

[wsware]

***********
Repost from http://pytivo.sourceforge.net/forum/...ork-t2248.html
Please comment there if you would like to play with my changes and give feedback.
***********

https://github.com/wsware/pytivo

I have a fork that is updated with all wmcbrine's changes and some of my own. Feel free to include any changes in other forks and/or make suggestions on what can be changed to make it more acceptable. I hope wmcbrine does not cringe too badly.

Update .tmpl files to use tabs instead of spaces for formatting. Saved a few KB in my tests so it seems to be worth it.

Support movie.nfo files. Support metadata to change folder display names. Requires change to plugin to actually query for directories. Right now only video.py has been changed to use it.

Updated get_files() in plugin.py to be common for video.py, photo.py, and
music.py. This includes updates to sorting what I think matches the spec better.

Add new options that effect get_files()

- hide_empty = True
(Hides empty folders, Use Max file date/time for folder, folders with a single file will display the file instead of the folder)

- force_recurse = True
(Use for a share you want to always be recursive. Like for example you keep movies in their own folder.)

- use_mdate = True (Use Modify Date instead of CreateDate when sorting
on date. You will need to set this to keep default video behavior)

- force_sort = Title
(Custom sort overide. For example instead of force_alpha use force_sort=Type,Title You can also specify multilevel like force_sort=Title:!CaptureDate to have the first folder lever be a title sort and the second and rest be CaptureDate sorted. As many levels as you want are supported. Supported options are Type, Title, CaptureDate, LastChangeDate, and Random. Use ! to reverse the sort order)

The video.py also will cache metadata now. I didn't put an option for this.

Known Bugs:
- recursive playlists are broken.
- video metadata does not detect changes unless files are removed,
added, or the folder date/time is updated.

-wsware

[lpwcomp]

Push to a remote TiVo works fine on an mpg file. I have changed things so any future pushes will be from a file originally recorded on a TiVo 2 so that no transcoding is required. Any suggestions on the settings for the transcode of my existing files to mpg using Videora Tivo Converter (seems to work best) so that no pyTivo transcode will be necessary? Original source is a Premiere recording from an HD channel. Edited and converted to avi using VirtualDub. They are 16x9.

[markmarz]

Thanks to wmcbrine, lrhorer & lpwcomp for their help in my configuration of pyTivo. This wraps up a discussion started in the kmttg thread about how to use pyTivo as an alternative for my requirement.

What I wanted to do was initiate pulls with pyTivo from my TivoHD down to a local directory, which happens to also be a share, on my debian server; we'll call that share VideoWork. Also wanted to continue using vidmgr to push from another share, call it Videos, to my TivoHD. Idea was VideoWork would be for videos which needed editing and would eventually reside on Videos.

Did that by changing pyTivo.conf [Server] section to point to the pull share:

[Server]
tivo_password = *****
tivo_mak = ****
ffmpeg = /usr/bin/ffmpeg
tivodecode = /usr/local/bin/tivodecode
tdcat = /usr/local/bin/tdcat
togo_path = /mnt/samba/VideoWork
tivo_username = ******@gmail.com
port = 9032

And left the section for Vidmgr as is, to point to the 'production' videos intended for push to the TivoHD:

[Tivo server]
type = video
path = /mnt/samba/Videos

Seems obvious now, but I didn't know that multiple shares could be specified for pull & push or whatever purpose.

Thanks!