New program for 1 step TTG downloads, decryption, encoding - kmttg

[DougD]

After changing the custom command I was able to get the script to run by clicking on start job then discovered that the default directory is where kmttg is started from. Guess I should have expected this. Anyway I changed the script so I could pass in the directory to store the cover jpg and it now runs with the entry:
/usr/local/bin/getcover.py [metaFile] "/home/tivo/covers/"
I also realized for the auto transfers I was selecting the custom entry but had been clicking OK instead of first clicking on the update button.

[danterner]

Originally Posted by DougD

After changing the custom command I was able to get the script to run by clicking on start job then discovered that the default directory is where kmttg is started from. Guess I should have expected this. Anyway I changed the script so I could pass in the directory to store the cover jpg and it now runs with the entry:
/usr/local/bin/getcover.py [metaFile] "/home/tivo/covers/"
I also realized for the auto transfers I was selecting the custom entry but had been clicking OK instead of first clicking on the update button.

I've been struggling to figure out how to incorporate custom covers, so far without success. I'm encouraged to see you've figured it out. If you could give any more detail, I'd be thrilled. I'm relatively computer literate but I don't know coding. I assume your getcover.py is a script file that adds the cover step to Atomic Parsley or something along those lines? Would you mind elaborating on what it does/says, or even providing an example of the file itself?

[zabolots]

Originally Posted by moyekj

Now I remember why I stopped trying to use recent versions of ffmpeg. Looks like the developers make no effort to be backwards compatible. Aside from command line options being different (options that worked fine in previous builds no longer work) looks like ac3 audio in mp4 container seems to be broken (using -acodec copy for ac3 audio for mp4 container fails) when I tried a very recent build I downloaded from the web site I provided a link to above. Not worth the hassle for me to try and get things working with newer builds... If you don't care about ac3 in mp4 you may be OK though when using aac codec you have to add "-strict experimental" and instead of using -b option it now has to be -b:v

I grabbed a newer version and noticed the same thing. Why on earth they would completely change the command line arguments without supporting backwards compatibility for basic arguments (i.e. -b now -b:v -ab now -b:a) is beyond me. I went back to the older build as well.

I'm sure somebody out there has time to go through the hassle of converting all the encode scripts but I sure don't

[Iluvatar]

Originally Posted by zabolots

I grabbed a newer version and noticed the same thing. Why on earth they would completely change the command line arguments without supporting backwards compatibility for basic arguments (i.e. -b now -b:v -ab now -b:a) is beyond me. I went back to the older build as well.

I'm sure somebody out there has time to go through the hassle of converting all the encode scripts but I sure don't

The commands were deprecated with the FFmpeg 0.9 api change. They may finally have been removed on recent Git HEAD revisions but the old commands are still perfectly useable on the latest FFmpeg stable release, 0.10.2 albeit with warnings that you are using deprecated commands.

[ThAbtO]

When I have 'Remove .TiVo files after Decrypt', MetaData and Decrypt are selected, I get .TiVo.txt and .mpg.txt files.

Shouldn't the "Remove .TiVo files" also remove the .TiVo.txt file as well?

Also, when I remove the job for the metadata on .Tivo.txt, KMTTG also removes the subsequent QSFix job.

[DougD]

Attached are the files I have started using for cover art. I modified the open source scripts created for mythtv to work with tivo metafiles. I then went on line and signed up for keys at the two web sites so we can use the files for the tivo community. At this point I need to put in a plug for the web sites. The art for movies is courtesy of www.themoviedb.org. The art for TV shows is from www.thetvdb.com both depend on user support. I have attached the files to this post. Put the getcovers.py, getcover.py, ttvdb.py and tmdb.py files on your path. Put the two folders in your python path. Oh, I forgot you will need to download and install python. Also you need to download and install fuzzy logic for selecting the best match from http://github.com/seatgeek/fuzzywuzzy.
To test if it works for movies enter
tmdb.py -M Terminator
Then test the shows portion with
ttvdb.py -D "Pan Am" 1 1
once you get this to work try entering
getcover.py "xyz" /file/to/store/covers/
where xyz is the name of one of your movie metafiles and /file/to/store/covers/ is the location to put the jpg files

this is the command to add as a custom command to kmttg.

Once this works you can get the covers for all shows on the computer by entering
cd /
getcovers.py "/folder_for/covers/"

This is all I know and I'm hoping some one else can pick this up and fix it up a bit. You'll have to get some of the Python experts to help if you need more.

[Hercules67]

Originally Posted by moyekj

Very recent builds can be found here for example:
http://ffmpeg.zeranoe.com/builds/
Of course there's no guarantee that any of the existing encoding profiles will work with newest builds and something you'll have to experiment with. Quite frankly I don't encode to other formats anymore (since series 4 units can easily handle mpeg2 HD transfers faster than real time and every device I use for watching can handle mpeg2 playback) so don't pay attention to profiles and ffmpeg builds anymore, but of course it's pretty easy to update profiles yourself to have them work however you want.

For some of us who still use AVI and MKV (along with mpeg2), the newer builds of ffmpeg are problematic also.

I tried them once and was disappointed.

What you, wmcbrine and other developers have done in using STABLE versions of ffmpeg that are also backwards compatible have allowed people like me to utilize programs like KMTTG and pyTiVo at the same time.

[wmcbrine]

I don't distribute any version of ffmpeg myself, and I don't endorse one version or build over another. But yes, the lack of backward compatibility is annoying.

[Hercules67]

Originally Posted by wmcbrine

I don't distribute any version of ffmpeg myself, and I don't endorse one version or build over another. But yes, the lack of backward compatibility is annoying.

Oh, I know that, I was just relating it to the ffmpeg that's in your pyTiVo branch <aka, fork>.

Sorry for the confusion.

Before KMTTG, I used to try changing TiVo files manually and sending them back with pyTivo. That's when I tried the newest ffmpeg. That was a disaster. I'll never repeat that mistake. I actually had to reload my OS to get its tendrils out of my system.

[wmcbrine]

But there is no ffmpeg in my fork. That's what I'm saying.

I don't think any version of ffmpeg is going to insinuate itself into your system. You make it sound like TiVo Desktop or something.

[moyekj]

Originally Posted by ThAbtO

When I have 'Remove .TiVo files after Decrypt', MetaData and Decrypt are selected, I get .TiVo.txt and .mpg.txt files.

Shouldn't the "Remove .TiVo files" also remove the .TiVo.txt file as well?

Also, when I remove the job for the metadata on .Tivo.txt, KMTTG also removes the subsequent QSFix job.

You must have metadata=all set under config->Program Options. Change metadata=last and only the last file in the set of tasks will be metadata file. i.e. In that case when metadata & decrypt are selected only .mpg.txt should be created.

[Hercules67]

Originally Posted by wmcbrine

But there is no ffmpeg in my fork. That's what I'm saying.

I don't think any version of ffmpeg is going to insinuate itself into your system. You make it sound like TiVo Desktop or something.

Hmm, then where did I get the ffmpeg that pyTivo uses.... never-mind.

I am confused.

Back to your regularly scheduled programming.

[lpwcomp]

Originally Posted by Hercules67

Hmm, then where did I get the ffmpeg that pyTivo uses.... never-mind.

I am confused.

Back to your regularly scheduled programming.

Although you can get the "recommended" version of ffmpeg from http://pytivo.sourceforge.net/forum/download.php?id=323, it is not actually part of the pyTivo package.

[nahtanoj1]

Does anyone know if there is an application for the mac that could be used to sync the files downloaded and processed by kmttg into the iTunes folder that auto imports the files into iTunes. (it's in Users/yourusername/Music/iTunes/iTunes Music/Automatically Add to iTunes/) My experience has been that if I select this folder in the kmttg config, iTunes gets confused˙because it sees the files before the complete processing is done by kmttg.

[DougD]

Originally Posted by nahtanoj1

Does anyone know if there is an application for the mac that could be used to sync the files downloaded and processed by kmttg into the iTunes folder that auto imports the files into iTunes. (it's in Users/yourusername/Music/iTunes/iTunes Music/Automatically Add to iTunes/) My experience has been that if I select this folder in the kmttg config, iTunes gets confused˙because it sees the files before the complete processing is done by kmttg.

Have you tried having kmttg download to a different directory and then have a custom command such as:
move /kmttg/downloads/*.* Users/yourusername/.../Automatically Add to iTunes/.

[nahtanoj1]

Originally Posted by DougD

Have you tried having kmttg download to a different directory and then have a custom command such as:
move /kmttg/downloads/*.* Users/yourusername/.../Automatically Add to iTunes/.

I have not and will set that up as a cron job for early in the morning. Thanks.

[nahtanoj1]

Fairly new to kmttg and have a few problems I'm working through and would appreciate any help y'all could provide.

1. Every few days on my new premier (dual tuner running version 20.2-01-2-746) kmttg is unable to download files from the premier (I get the message ERROR: <h2>Server Busy</h2>) and after I reboot the premier it works again. Is this a known problem with this version of Tivo code or is there something I have enabled that might be causing this?

2. I also am getting audio problems where in most .mp4 files I can hear the audio in the left speaker but clicking or static in the right one and quicktime crashes after just a few moments of playing the files. I'm using ff_h264_high_rate and at this point have yet to be able to use any of my transferred files since the audio problem is so pervasive.

3. Considering the issue above I would like to try moving my auto transfers to a different encoding profile but when I choose one under configure, auto transfers menu and click OK it does not seem to take my change. Must I delete the auto transfer and make a new one?

Thanks for all of your help.

[danterner]

Originally Posted by DougD

Attached are the files I have started using for cover art. I modified the open source scripts created for mythtv to work with tivo metafiles. I then went on line and signed up for keys at the two web sites so we can use the files for the tivo community. At this point I need to put in a plug for the web sites. The art for movies is courtesy of www.themoviedb.org. The art for TV shows is from www.thetvdb.com both depend on user support. I have attached the files to this post. Put the getcovers.py, getcover.py, ttvdb.py and tmdb.py files on your path. Put the two folders in your python path. Oh, I forgot you will need to download and install python. Also you need to download and install fuzzy logic for selecting the best match from http://github.com/seatgeek/fuzzywuzzy.
To test if it works for movies enter
tmdb.py -M Terminator
Then test the shows portion with
ttvdb.py -D "Pan Am" 1 1
once you get this to work try entering
getcover.py "xyz" /file/to/store/covers/
where xyz is the name of one of your movie metafiles and /file/to/store/covers/ is the location to put the jpg files

this is the command to add as a custom command to kmttg.

Once this works you can get the covers for all shows on the computer by entering
cd /
getcovers.py "/folder_for/covers/"

This is all I know and I'm hoping some one else can pick this up and fix it up a bit. You'll have to get some of the Python experts to help if you need more.

Thanks so much for posting these instructions and the files. I don't have it figured out quite yet (I'm stuck on figuring out how to install fuzzywuzzy - not knowing Python at all is certainly hampering my progress), but I haven't given up and I'm encouraged that you've figured it out; at least I know that what I've been striving for is possible.

[moyekj]

Originally Posted by nahtanoj1

Fairly new to kmttg and have a few problems I'm working through and would appreciate any help y'all could provide.

1. Every few days on my new premier (dual tuner running version 20.2-01-2-746) kmttg is unable to download files from the premier (I get the message ERROR: <h2>Server Busy</h2>) and after I reboot the premier it works again. Is this a known problem with this version of Tivo code or is there something I have enabled that might be causing this?

2. I also am getting audio problems where in most .mp4 files I can hear the audio in the left speaker but clicking or static in the right one and quicktime crashes after just a few moments of playing the files. I'm using ff_h264_high_rate and at this point have yet to be able to use any of my transferred files since the audio problem is so pervasive.

3. Considering the issue above I would like to try moving my auto transfers to a different encoding profile but when I choose one under configure, auto transfers menu and click OK it does not seem to take my change. Must I delete the auto transfer and make a new one?

Thanks for all of your help.

1. Make sure you don't have TiVo Desktop or some other program trying to download from your Premiere while kmttg is running. TiVo web server only likes to serve up 1 file at a time and gets in a bad state if that is violated which only a reboot fixes.
2. That encoding profile you are using keeps AC3 audio in mp4 container which few players can handle. Try VLC VideoLan player for that.
3. You are probably not updating it by clicking on UPDATE button after changing settings. In auto transfers window click on auto transfer in the top table, then adjust Encoding Name, then click on UPDATE button and then OK the window to save changes.

[nahtanoj1]

Originally Posted by moyekj

1. Make sure you don't have TiVo Desktop or some other program trying to download from your Premiere while kmttg is running. TiVo web server only likes to serve up 1 file at a time and gets in a bad state if that is violated which only a reboot fixes.
2. That encoding profile you are using keeps AC3 audio in mp4 container which few players can handle. Try VLC VideoLan player for that.
3. You are probably not updating it by clicking on UPDATE button after changing settings. In auto transfers window click on auto transfer in the top table, then adjust Encoding Name, then click on UPDATE button and then OK the window to save changes.

1. Can streaming between two tivo's be the process trying to download that would hose up downloads for kmttg until I reboot?
2. I have switched to AppleTV with handbrake and will see how that goes.
3. I should have figured that one out. Thanks.

[moyekj]

Originally Posted by nahtanoj1

1. Can streaming between two tivo's be the process trying to download that would hose up downloads for kmttg until I reboot?

Don't think so, but I haven't tried so maybe.

[txporter]

Originally Posted by nahtanoj1

1. Can streaming between two tivo's be the process trying to download that would hose up downloads for kmttg until I reboot?

I haven't done this on my Premiere, but the few times I tried it on my TivoHDs, the Tivo didn't seem to like both downloading shows to my computer and transferring Tivo to Tivo. From what I remember, the transfer speeds would drop to a crawl or something like that. I haven't done both simultaneously since then so I am not sure if it has been addressed at all.

[nahtanoj1]

Originally Posted by txporter

I haven't done this on my Premiere, but the few times I tried it on my TivoHDs, the Tivo didn't seem to like both downloading shows to my computer and transferring Tivo to Tivo. From what I remember, the transfer speeds would drop to a crawl or something like that. I haven't done both simultaneously since then so I am not sure if it has been addressed at all.

It was not a problem of the download creeping - it just plain broke the ability for a download to happen and only after a reboot would it work again. kmttg was able to get the now playing list etc but not to download the file. Next time it happens I'll check to see if the streaming/transferring capability between premier sis also broken before I reboot.

[moyekj]

Originally Posted by nahtanoj1

It was not a problem of the download creeping - it just plain broke the ability for a download to happen and only after a reboot would it work again. kmttg was able to get the now playing list etc but not to download the file. Next time it happens I'll check to see if the streaming/transferring capability between premier sis also broken before I reboot.

The "Server Busy" problem is strictly TTG related and has never affected MRV/MRS for me. Part of the problem is when transferring to PC it is a lot more CPU intensive (decrypt, demux, remux, encrypt again) compared to MRV/MRS.

[DougD]

I have the getcover.py running on my Linux box but I believe the steps I used for installing python on my windows machine were from the website:
http://www.ehow.com/how_2116627_inst...n-windows.html

and to install fuzzywuzzy on my linux box I used :
git clone git://github.com/seatgeek/fuzzywuzzy.git fuzzywuzzy
cd fuzzywuzzy
python setup.py install

[lpwcomp]

This question applies equally to pyTivo and probably TD but this thread was currently easier to get to.

Is there some limitation to the .tivo file format that prevents the channel information from being written to it?

[chrispitude]

We recently bought a refurbished 10' Toshiba Thrive tablet to play videos for our 1-year-old son during an upcoming trip. I found kmttg today - absolutely fantastic! This is exactly what I've been looking for. Very cool.

[chrispitude]

Originally Posted by Iluvatar

The commands were deprecated with the FFmpeg 0.9 api change. They may finally have been removed on recent Git HEAD revisions but the old commands are still perfectly useable on the latest FFmpeg stable release, 0.10.2 albeit with warnings that you are using deprecated commands.

I also tried the latest ffmpeg, adding/modifying the options as previously noted. File size and visual quality seemed identical, but it was twice as slow (13fps versus 26fps with the ffmpeg 'packaged' with kmttg). Normally I like to be using the latest and greatest, but this time I'll stick with the speed.

[bwall23]

Originally Posted by lpwcomp

This question applies equally to pyTivo and probably TD but this thread was currently easier to get to.

Is there some limitation to the .tivo file format that prevents the channel information from being written to it?

If you mean the CHANNEL Number (displayMajorNumber) and CHANNEL Name (callsign) it was recorded from, I don't think so as this is what I have from a recent recording on my Premiere that I transferred using kmttg with metadata checked.

title : American Icon: Muscle Car
seriesTitle : American Icon: Muscle Car
description : Detroit continues to produce powerful vehicles until the 1970s gas crisis and government regulations bring an end to the muscle-car era. 
time : 2012-04-18T01:00:00Z
isEpisode : true
iso_duration : PT30M
originalAirDate : 2012-04-17T00:00:00Z
episodeTitle : End of an Era
isEpisodic : true
showingBits : 4098
tvRating : x3
episodeNumber : 013
displayMajorNumber : 754
callsign : VEL
seriesId : SH01470291
vProgramGenre : Auto

But, you are correct in that this info gets pulled from the TiVo when kmttg transfers (TTG) the .TiVo file to the PC. The actual .TiVo file on the PC does not contain the channel info in either xml chunk 1 or 2.

[bwall23]

Originally Posted by moyekj

v0p8r version released. Contains new authentication code for iPad/RPC remote and some user-supplied enhancements related to auto transfers and 1 bug fix.
Consult release_notes Wiki for details.

Awesome. Thanks so much for the work you put into this indispensable app!