New program for 1 step TTG downloads, decryption, encoding - kmttg

[moyekj]

Originally Posted by lrhorer

Hey moyekj,

I just noticed something. Running a previous version of kmttg under Linux, the CPU usage was very low, except when it was running a demux/decrypt or comskip operation. I recently upgraded to the most recent version of kmttg, and now whenever kmttg is running, java pegs both CPU meters. Do you have any idea what might be the issue? I cannot categorically state it has happened ever since the upgrade, but the upgrade was done only a few days ago, and I noticed the pegged CPUs just the day before yesterday. Looking at it last night and today, top shows java eating up more than 130% of a full CPU load, and the usage meters drop right off when I stop kmttg.

Not sure, but obviously that's not normal. The whole program runs a master loop with msecs between operations thus keeping CPU consumption to a minimum for Java stuff. Perhaps in your upgrade you upgraded Java version to 7 or something newer than you had before? Also you should try both in GUI and background/batch modes to see if there is any difference.

[range rat]

Hi,

My computer was merrily grinding away at its tasks when it had a hiccup and shut down (I know why; it's old). Restarting kmttg let it resume where it had left off (I had "Automatically restore job queue between sessions" on) and it continues, writing over the last interrupted outputs as expected. However, I can't find the job queue displayed anywhere; it used to be in the middle listbox showing status. Any idea how to bring that up -- I like watching the colored bar get bigger as it goes?



Thanks,

Jon

[lpwcomp]

2 related RFEs.

1. Add "pyTivo Push destination" to specific Auto-transfer settings.

2. Add support for push to remote TiVos.

Plus a question: does the communication interface enable the creation of a manual recording?

[range rat]

Originally Posted by range rat

Hi,

My computer was merrily grinding away at its tasks when it had a hiccup and shut down (I know why; it's old). Restarting kmttg let it resume where it had left off (I had "Automatically restore job queue between sessions" on) and it continues, writing over the last interrupted outputs as expected. However, I can't find the job queue displayed anywhere; it used to be in the middle listbox showing status. Any idea how to bring that up -- I like watching the colored bar get bigger as it goes?



Thanks,

Jon

And another question: If I quit the app while it's working on something, will it resume where it left off in the output files, or will it just restart that task again?

[ThAbtO]

Originally Posted by range rat

And another question: If I quit the app while it's working on something, will it resume where it left off in the output files, or will it just restart that task again?

Auto-Resume is not supported on the Tivo, it would just start over again.

An alternative is to use the 'Transfer from paused point' option, but you would have separate files, and duplicate filenames, and if you have overwrite files on, with overwrite off, it would not transfer at all.

I have used the 'paused point' transfer method, and simply used the commercial break, to find and join the files using VideoReDo.

[lrhorer]

Originally Posted by moyekj

Not sure, but obviously that's not normal. The whole program runs a master loop with msecs between operations thus keeping CPU consumption to a minimum for Java stuff. Perhaps in your upgrade you upgraded Java version to 7 or something newer than you had before?

Nope. The only thing I upgraded ws kmttg. I downloaded the newest version.

RAID-Server:~# java -version
java version "1.6.0_18"
OpenJDK Runtime Environment (IcedTea6 1.8.3) (6b18-1.8.3-2)
OpenJDK 64-Bit Server VM (build 16.0-b13, mixed mode)

Originally Posted by moyekj

Also you should try both in GUI and background/batch modes to see if there is any difference.

You mean the -a and -b switch? They don't run, but then I don't have any batches or automatic transfers set up:

RAID-Server:~# kmttg -a
RAID-Server:~# ERROR: Address already in use
STARTING AUTO TRANSFERS
ERROR: No auto keywords setup
ERROR: No keywords defined in /usr/share/kmttg/auto.ini... aborting
EXITING BATCH MODE
SHUTTING DOWN
RAID-Server:~# kmttg -b
RAID-Server:~# ERROR: Address already in use
STARTING BATCH MODE SINGLE LOOP TRANSFERS
ERROR: No auto keywords setup
ERROR: No keywords defined in /usr/share/kmttg/auto.ini... aborting
EXITING BATCH MODE
SHUTTING DOWN

The "Address already in use" messages are odd, though.

[moyekj]

I run kmttg on a Linux system with CentOS 5.4 (Kernel Version 2.6.18-164.el5) and monitor using htop and java CPU is 0% when just sitting in GUI doing nothing.

/usr/bin/java -version
java version "1.6.0"
OpenJDK Runtime Environment (build 1.6.0-b09)
OpenJDK 64-Bit Server VM (build 1.6.0-b09, mixed mode)

Don't know if it has anything to do with problem but perhaps try turning off "Look for Tivos on network" under config-Tivos tab to see if that changes anything.

[moyekj]

Originally Posted by lpwcomp

does the communication interface enable the creation of a manual recording?

Not as far as I can tell.

[lrhorer]

Originally Posted by moyekj

I run kmttg on a Linux system with CentOS 5.4 (Kernel Version 2.6.18-164.el5) and monitor using htop and java CPU is 0% when just sitting in GUI doing nothing.

Yeah, it definitely should be, or close to it.

Originally Posted by moyekj

Don't know if it has anything to do with problem but perhaps try turning off "Look for Tivos on network" under config-Tivos tab to see if that changes anything.

I had already tried that. Something in Java must have gotten mucked up, although how I have no idea, because Galleon has the same trouble, and kmttg started acting oddly. I'll have to take the time to purge Java later. For the time being I am running kmttg on another platform.

[range rat]

Originally Posted by ThAbtO

Auto-Resume is not supported on the Tivo, it would just start over again.

An alternative is to use the 'Transfer from paused point' option, but you would have separate files, and duplicate filenames, and if you have overwrite files on, with overwrite off, it would not transfer at all.

I have used the 'paused point' transfer method, and simply used the commercial break, to find and join the files using VideoReDo.

Do you have an alternative to VideoReDo to join files? Can Handbrake do that?

Also, I'm finding ffmpeg is failing with large files, on the order of processing a 11, 795,000 K TiVo file. Is that a known problem, or is it unique to me?

Thanks for your continued help,

Jon

[ThAbtO]

Originally Posted by range rat

Do you have an alternative to VideoReDo to join files? Can Handbrake do that?

Also, I'm finding ffmpeg is failing with large files, on the order of processing a 11, 795,000 K TiVo file. Is that a known problem, or is it unique to me?

Thanks for your continued help,

Jon

Handbrake and ffmpeg does not do joining, just converting. I use VideoReDo as it can edit commercials as well as join multiple files into one in the order I want.

[wmcbrine]

Originally Posted by range rat

Also, I'm finding ffmpeg is failing with large files, on the order of processing a 11, 795,000 K TiVo file. Is that a known problem, or is it unique to me?

Just you. I doubt it's the size per se, probably glitches in those specific files?

[mreaves53]

Does anyone have a profile for a Toshiba Thrive?

Thanks

[moyekj]

Recently with new Elite I used tivo.com to copy over all season passes from a Premiere that is being retired. I use tivo.com because the RPC method only works for programs that currently have guide data and I have a bunch of season passes that don't have guide data right now. However I've discovered that any season pass that was created from tivo.com cannot be deleted properly using RPC remote. The RPC call actually returns success for deletion but it actually doesn't. Deleting from TiVo itself does work. Deleting season passes that were created on TiVo or via RPC work fine, it's just the tivo.com created ones that won't delete.

[Hercules67]

Does anyone know how to BRAKE a video file into 2 (like a premiere episode of #1 and #2 since they are titled separately)?

Do the VideoRedo forums talk about that?

Thank you if you can point me to the right place in advance.

[ThAbtO]

Originally Posted by Hercules67

Does anyone know how to BRAKE a video file into 2 (like a premiere episode of #1 and #2 since they are titled separately)?

Do the VideoRedo forums talk about that?

Thank you if you can point me to the right place in advance.

Using VideoReDo, its simple. Just like when editing commercials out. You highlight the section you do not want, and remove (temporarily), save as a new .mpg file. Next do the same thing but after removing your delete marks, you mark and remove the other portion to save as another .mpg file.

[caddyroger]

I tried using different version of Kmttg with this problem. It take any where from 30 to 45 seconds to list the programs. At the very top it flash about every 10 second until the page loads. What could be the problem?

[lrhorer]

I have two issues I've just come across. I upgraded to the latest release of kmttg a few weeks ago, and it seems to me the refresh behavior has changed. Previously, when one clicked on the refresh tab for a TiVo, the program listing for that TiVo would go blank until the new listing was obtained. Now the old listing stays in place until the new listing is retrieved and output. I can see an argument for the new method, but having used it for a couple of weeks, I really find the old behavior to be more of an advantage. Is there any way to have the new software revert to the old behavior?

The second is related to automated downloads. I don't very often transfer series to the server, so I have not made any use of the automated download feature until this time. I recently switched to a new CATV company, however, and there are a few new channels which happen to have a handful of series I am transferring using kmttg. I do not see a way, however, to get kmttg to transfer the content to anything but the default kmttg directory. That drive cannot hold the content, and in any case I want the output to go to the server, not a local workstation drive. Is there any way to tell kmttg to save the downloads to another directory, in this case specifically a network share?

[lrhorer]

Originally Posted by caddyroger

I tried using different version of Kmttg with this problem. It take any where from 30 to 45 seconds to list the programs. At the very top it flash about every 10 second until the page loads. What could be the problem?

You mean to display the contents of a TiVo? If the Tivo has very much on it in the way of content, that does not sound excessive, to me.

[moyekj]

Originally Posted by lrhorer

The second is related to automated downloads. I don't very often transfer series to the server, so I have not made any use of the automated download feature until this time. I recently switched to a new CATV company, however, and there are a few new channels which happen to have a handful of series I am transferring using kmttg. I do not see a way, however, to get kmttg to transfer the content to anything but the default kmttg directory. That drive cannot hold the content, and in any case I want the output to go to the server, not a local workstation drive. Is there any way to tell kmttg to save the downloads to another directory, in this case specifically a network share?

".TiVo Output Dir" under config-File Settings defines the dir for downloaded .TiVo files. If using Windows kmttg service note that there can be issues with Windows service not being able to access network share. When kmttg can't access the specified dir it will default to writing to install dir. To access network share for windows service:
1. Make sure kmttg service runs using your normal login name instead of Windows default service
2. Specify network shares using \\host\path\to\dir syntax

If using windows service I would recommend getting things working using GUI first (Auto Transfers-Run Once in GUI or Auto Transfers-Loop in GUI) before using the service mode which can be a pain.

For Linux it's a lot simpler generally. As long as kmttg can read/write to specified dir it should take what you setup in config.

For your other query about not emptying list on new NPL query I got several complaints about old behavior, especially for people with a lot of entries where it can take several minutes get the list. There is no option for 1 way or the other right now.

[caddyroger]

Originally Posted by lrhorer

You mean to display the contents of a TiVo? If the Tivo has very much on it in the way of content, that does not sound excessive, to me.

It is at the very top. it reads playlist: 0.00.00 kmttg.
You might right I have several hundred programs in the play list. I was wanting to make sure.
Thanks

[Hercules67]

Originally Posted by ThAbtO

Using VideoReDo, its simple. Just like when editing commercials out. You highlight the section you do not want, and remove (temporarily), save as a new .mpg file. Next do the same thing but after removing your delete marks, you mark and remove the other portion to save as another .mpg file.

I thought it could be done, I just never tried... Maybe I need to give it a chance and see what kind of results I get.

Thanks.

[lpwcomp]

I have determined that, if you have an external TiVo defined in pyTivo and everything else setup for push to external TiVo, you can add it to kmttg using the TSN (dashes removed) as the name and anything in the IP address field. It can then be set as the Push destination and the Push will succeed. Including (I hope) auto pushes.

If you have "Start NPL jobs when starting kmttg GUI" enabled, you will get an error when first starting up since it can't access the remote TiVo but just ignore it.

[Phantom Gremlin]

Originally Posted by range rat

Also, I'm finding ffmpeg is failing with large files, on the order of processing a 11, 795,000 K TiVo file. Is that a known problem, or is it unique to me?

Originally Posted by wmcbrine

Just you. I doubt it's the size per se, probably glitches in those specific files?

Something else to check for:

Not sure how you're invoking ffmpeg. Directly (I've never used it directly) or as a side effect of HandBrake?

If using HandBrake, be sure to have "Large file size" checkbox set in the GUI, otherwise you will definitely have problems with output files larger than 4 GB. You would think that HandBrake would output an error/warning if this checkbox wasn't set and it created a large file, but it doesn't warn. It just silently produces a corrupt file. (And I don't care if it puts an assert error in the logs, creating a greater than 4 GB file with 32-bit offset atoms is a known failure, they *shouldn't* allow that file to remain).

Perhaps there's a similar switch for invoking ffmpeg directly.

[lpwcomp]

Small problem with kmttg. For the duration of Olympic coverage, locally Jeopardy! is being shown on a different channel from the normal one, which is the local NBC affiliate. kmttg will not let me create a Season Pass for the "new" channel and issues a message that reads

Existing SP with same title found, not scheduling: Jeopardy!

[minimeh]

Using the TiVo GUI itself, I had set up a SP for the summer Olympics on the local NBC affiliate. Then I sought out the listing on CNBC using the guide. From there I took the normal steps to set up a SP on that channel. In the process of setting up options, I became aware that I was actually working with the original SP, not creating a new one on a different channel. Assuming some operator error, I started all over again and sure enough, I could only modify the original SP on the NBC channel, not create a new SP on the CNBC channel, even though I was starting the SP creation from the CNBC listing in the guide.

So, I'm thinking what you saw was a reflection of a limitation in TiVo, not an issue with kmttg.

[cherry ghost]

Originally Posted by minimeh

Using the TiVo GUI itself, I had set up a SP for the summer Olympics on the local NBC affiliate. Then I sought out the listing on CNBC using the guide. From there I took the normal steps to set up a SP on that channel. In the process of setting up options, I became aware that I was actually working with the original SP, not creating a new one on a different channel. Assuming some operator error, I started all over again and sure enough, I could only modify the original SP on the NBC channel, not create a new SP on the CNBC channel, even though I was starting the SP creation from the CNBC listing in the guide.

So, I'm thinking what you saw was a reflection of a limitation in TiVo, not an issue with kmttg.

There are three options under Season Pass Options

Modify
Cancel
Get Another

You want to use Get Another and then select the proper channel.

[minimeh]

I did not notice "Get Another". So, operator error indeed.

I'll check that tonight when I get home. Thanks!

[lpwcomp]

Originally Posted by minimeh

Using the TiVo GUI itself, I had set up a SP for the summer Olympics on the local NBC affiliate. Then I sought out the listing on CNBC using the guide. From there I took the normal steps to set up a SP on that channel. In the process of setting up options, I became aware that I was actually working with the original SP, not creating a new one on a different channel. Assuming some operator error, I started all over again and sure enough, I could only modify the original SP on the NBC channel, not create a new SP on the CNBC channel, even though I was starting the SP creation from the CNBC listing in the guide.

So, I'm thinking what you saw was a reflection of a limitation in TiVo, not an issue with kmttg.

Definitely not a problem with the TiVo. I had no problem creating the SP from the TiVo. There was also no problem when I used tivo.com to do pretty much the exact same thing on a TiVo 2.

Originally Posted by cherry ghost

There are three options under Season Pass Options

Modify
Cancel
Get Another

You want to use Get Another and then select the proper channel.

And that is just when using the HDUI. The SDUI doesn't have that. If you are using the SDUI, the only time you get presented with the "Modify" option is if you have selected an episode on the same channel as the SP. There is no "Get Another". The SDUI doesn't even recognize that you have an existing SP for a program if it is on a different channel.

[moyekj]

Originally Posted by lpwcomp

Small problem with kmttg. For the duration of Olympic coverage, locally Jeopardy! is being shown on a different channel from the normal one, which is the local NBC affiliate. kmttg will not let me create a Season Pass for the "new" channel and issues a message that reads

I'll have to amend the code to check channel name in addition to title for season pass scheduling in next release.