TiVo-VideoReDo-AutoProcessor Program [Text View] - Page 2

dlfl

08-07-2008, 07:02 PM

...... Is it supposed to close the program, or stop processing when the timer elapses? What if there are no more videos for it to work on? Also what happens (both before and after the timer elapses) if a new TiVo file gets transferred? .....

Yes, the program should just end and disappear when it shuts down. It puts an autoshutdown message in the log file so you know it ended that way.

If a video is being processed when it reaches the time limit it should finish processing that video (complete through post-processing and clean up) but should then shut down rather than starting to process another video.

Files being transferred should make no difference and should not be interfered with by the shutdown.

Let me know if it doesn't behave this way.

blah238

08-07-2008, 08:57 PM

Appears to be working fine, other than that I forgot to close Media Center before heading to bed so when the scheduled task ran at 2AM TVAP got stuck on the first ad-scan (due to the aforementioned conflict between VRD and Media Center) and didn't finish it til I checked it in the morning.

May just write an AHK script to window or close Media Center if it's running and then run TVAP.

blah238

08-08-2008, 02:06 AM

One little quibble, the tray icon for TVAP does not remove itself when it shuts itself down. Other than that, looks like everything is peachy. Here are my scripts in case anyone is interested:

Post-processing batch file that moves the TVAP output to your Recorded TV folder, AFTER TVAP has written metadata to the file. Writes results to the TVAP log. Change the target and logfile lines as needed.
@ECHO OFF
setlocal
set srcfile="%~1.dvr-ms"
set retrycount=0
set target="G:\Recorded TV\"
set logfile="C:\Program Files (x86)\TVAP\TiVoVRDAutoProcessLog.txt"
echo Attempting to move %srcfile% to %target%

:TRANSFER
move %srcfile% %target%2>errortemp.txt
echo %errorlevel%
if %errorlevel% NEQ 0 (GOTO RETRY) else (GOTO SUCCESS)

:RETRY
FOR /F "delims=" %%R IN (errortemp.txt) DO SET result=%%R
del errortemp.txt
if %retrycount% GTR 0 echo Retry #%retrycount%...
echo Error: %result%
if %retrycount% GEQ 3 GOTO FAIL
set /a retrycount = retrycount + 1
PING 1.1.1.1 -n 1 -w 5000 >NUL
GOTO TRANSFER

:FAIL
echo %date% %time% File move for %srcfile% failed after 3 retries with error: %result%
echo %date% %time% File move for %srcfile% failed after 3 retries with error: %result%>>%logfile%
GOTO EOF

:SUCCESS
del errortemp.txt
echo %date% %time% File move for %srcfile% successful
echo %date% %time% File move for %srcfile% successful>>%logfile%
GOTO EOF

:EOF

And here's the AHK script for dealing with Media Center if it's running while TVAP is set to run. Paste into a file ending with .ahk. You'll need AutoHotkey (http://www.autohotkey.com/) installed to run it. You can set this as your Task Scheduler target. Change the RunWait line near the bottom if necessary.

; ehshell.exe is the name of Windows Media Center
Process, Exist, ehshell.exe
; Process sets ErrorLevel to the ProcessID (PID) of ehshell.exe
WMCPid = %ErrorLevel%

; If Media Center is running...
If WMCPid > 0
{
; ... checks to see if Media Center is in full-screen, and if so, unmaximizes the window
WinGetPos, , , Width, Height, ahk_pid %WMCPid%
If (Width = A_ScreenWidth And Height = A_ScreenHeight)
{
Remax = 1
WinActivate, ahk_pid %WMCPid%
Send !{Enter}
}
}

; Runs TVAP, waits for it to close, and restores Media Center to full-screen if it was originally
; Change the path and options if necessary
RunWait, C:\Program Files (x86)\TVAP\TiVo-VideoReDo-AutoProcessor.exe -hotStart -shutdown:300, C:\Program Files (x86)\TVAP\
If Remax = 1
{
WinActivate, ahk_pid %WMCPid%
Send !{Enter}
}
ExitApp ;Done

dlfl

08-08-2008, 08:03 AM

One little quibble, the tray icon for TVAP does not remove itself when it shuts itself down. Other than that, looks like everything is peachy. Here are my scripts in case anyone is interested:
...........

Thanks for posting the scripts. Glad it's working for you.

I've noticed the lingering-tray-icon effect on a number of programs. Usually if you pass or hover the mouse pointer over the icon it disappears. If this doesn't work, check task manager to see if there is a TVAP process actually still running. (Hopefully not!) I suspect this is a Windows quirk but maybe there's something that could be put in the program to force its removal.

blah238

08-08-2008, 08:35 AM

It's just a graphical glitch. There's actually an AHK script that looks for and cleans up orphaned tray icons, however I think there must be a way for programs to clean up after themselves.

Maybe this AHK script will give you some clues.

SetTimer, TrayIcons, 500
^!a::msgbox % TrayIcons()

TrayIcons:
TrayIcons()
Return

TrayIcons(sExeName = "")
{
DetectHiddenWindows, On
idxTB := GetTrayBar()
WinGet, pidTaskbar, PID, ahk_class Shell_TrayWnd

hProc := DllCall("OpenProcess", "Uint", 0x38, "int", 0, "Uint", pidTaskbar)
pRB := DllCall("VirtualAllocEx", "Uint", hProc, "Uint", 0, "Uint", 20, "Uint", 0x1000, "Uint", 0x4)

VarSetCapacity(btn, 20)
VarSetCapacity(nfo, 24)

SendMessage, 0x418, 0, 0, ToolbarWindow32%idxTB%, ahk_class Shell_TrayWnd ; TB_BUTTONCOUNT
max = %errorlevel%

Loop, %max%
{
i := max - A_index
SendMessage, 0x417, i, pRB, ToolbarWindow32%idxTB%, ahk_class Shell_TrayWnd ; TB_GETBUTTON

DllCall("ReadProcessMemory", "Uint", hProc, "Uint", pRB, "Uint", &btn, "Uint", 20, "Uint", 0)

dwData := NumGet(btn,12)

DllCall("ReadProcessMemory", "Uint", hProc, "Uint", dwData, "Uint", &nfo, "Uint", 24, "Uint", 0)

hWnd := NumGet(nfo, 0)

WinGet, pid, PID, ahk_id %hWnd%

ifwinnotexist, ahk_id %hWnd%
{
idx := i+1
;MsgBox, 4, , Delete tray icon %idx%?
;IfMsgBox Yes
deletetrayicon(idx)
}

tmp = index=%a_index%, i=%i%, pid=%pid%`n
strayicons .= tmp

}

DllCall("VirtualFreeEx", "Uint", hProc, "Uint", pRB, "Uint", 0, "Uint", 0x8000)
DllCall("CloseHandle", "Uint", hProc)

Return sTrayIcons
}

DeleteTrayIcon(idx)
{
idxTB := GetTrayBar()
SendMessage, 0x416, idx - 1, 0, ToolbarWindow32%idxTB%, ahk_class Shell_TrayWnd ; TB_DELETEBUTTON
SendMessage, 0x1A, 0, 0, , ahk_class Shell_TrayWnd
}

GetTrayBar()
{
WinGet, ControlList, ControlList, ahk_class Shell_TrayWnd
RegExMatch(ControlList, "(?<=ToolbarWindow32)\d+(?!.*ToolbarWindow32)", nTB)

Loop, %nTB%
{
ControlGet, hWnd, hWnd,, ToolbarWindow32%A_Index%, ahk_class Shell_TrayWnd
hParent := DllCall("GetParent", "Uint", hWnd)
WinGetClass, sClass, ahk_id %hParent%
If (sClass <> "SysPager")
Continue
idxTB := A_Index
Break
}

Return idxTB
}

Not sure what TVAP is written in but there is probably a way to do something similar in it.

dlfl

08-10-2008, 06:05 PM

10 August 2008 Ver. 0.68
- Fixed: Tray Notify Icon remained after auto-shutdown.
- If your TVAPpostProcess or TVAPcleanUp batch file writes text lines to a file named TVAPlog.txt located in the folder containing the batch script, these text lines will be added to the TVAP log display and log file AFTER the batch completes. TVAP will prepend "BATCH MSG: " before each log line. TVAP attempts to delete the file after it has read it. If it can't (perhaps due to some permission problem) it adds a log message to that effect.

Here is an example of how to write a TVAP log line from your batch files:
set localDir=I:\videos\adscan\
echo Your text message line >> "%localDir%TVAPlog.txt"

localDir should be the folder containing the batch file and be sure to include the final '\' at the end.

You can echo as many lines as you choose (but they are only added to the TVAP log after your batch file completes).

blah238

08-11-2008, 07:16 PM

Works great! No problems to report. For the batch messages, I like that it puts the timestamp on it for you.

What was the key to making the tray icon disappear?

Now about that "recorded date/time" field... have not gotten a response on the VRD forums yet. What is different about this field versus any other metadata in a dvr-ms?

dlfl

08-11-2008, 08:12 PM

......What was the key to making the tray icon disappear?

Now about that "recorded date/time" field... have not gotten a response on the VRD forums yet. What is different about this field versus any other metadata in a dvr-ms?
A single statement "disposing" the notifyIcon object just before TVAP kills itself was needed. This doesn't seem to be needed (happens automatically) when the program is terminated normally by the user. It's a C# program.

I don't know what's different about the recorded date/time field. All I know is if TVAP sets it there is no error but it just doesn't take in files written by VRD while all the other tags do take. I have successfully set this tag in files that did not come out of VRD.

dlfl

09-06-2008, 09:39 PM

6 September 2008 Ver. 0.69
- If you click the "Run VideoReDo" button for a file with status AWAITING CUTS (i.e., one for which AdScan without autocuts has been run, and it is waiting for you to do manual cuts), the project (.vprj) file will be loaded into VideoReDo.

dlfl

10-22-2008, 08:43 PM

I got this question in a pm but am posting it and my answer here:

.... What I would prefer is just to have your software move the .tivo recording off the TiVo box, convert to dvr-ms format, and copy to my Vista Media Center storage location on my Windows Home Server box. Then I can use the excellent DVRMSToolkit add-on and view shows with commercial skip. I move mainly movies from TiVo so I am not concerned by the length of time to process.

So, is there a way to set up TVAP to skip the Video-Re-Do portion- just move show off, convert to dvr-ms format, and store on Windows Home server?

Note that TVAP doesn't "move .tivo files off the TiVo box" -- that must be done by other means, such as TiVo Desktop or TivoPlaylist.

Just set TVAP up to do only the QSF, select the DVR-MS output type, and set the QSF destination folder where you want it to go. You will basically just be using VideoReDo as a file converter, although you also get the benefit of the "clean up" that QSF may do, and TVAP will poke metadata in the output file too.

Of course for this to work TVAP must be able to see your Vista Media Center storage location as a folder. Not sure if there are any complications regarding that.

dlfl

11-16-2008, 12:43 AM

If you are interested in having automated MPEG4 conversion built into TVAP, instead of requiring a user-defined post process batch file as is currently done, please chime in here.

A recently released Source Forge project called fflib.net (http://http://www.intuitive.sk/fflib/post/fflib-net-released.aspx)makes it relatively easy to add this capability to TVAP.

The advantage would be simplicity. However if you are already using the post process batch method there will be no advantage. In fact the price for simplicity is limited configurability. You will not have all the parameters and options for fine tuning conversions that you have when using HandBrake in a post process batch.

fflib.net is somewhat of a black box. There is almost no documentation. However in my initial testing it has converted to .mp4 with H264 video and AAC audio, .avi with MPEG4 video and mp3 audio, and FLV. You can set the video size and video- and audio-bitrates --- or you can let them default to automatic settings which seem halfway reasonable at least.

In one test I converted an hour long .mpg, which was generated by VideoReDo performing a QSF on a .tivo file. The output file was a .avi and I sent it back to my TiVo via pyTivo. It was quite acceptable.

I don't know if the .mp4's it produces are iPod compatible. If someone will tell me the video format and bitrates I will convert a small .mp4 and get it to them for test on their iPod.

My current thought is to have this capability as an automatic option in TVAP. If the fflib.net DLL file is installed in the run-time directory, TVAP will enable the option. The current post process batch capability would still be there in either case. I would add a button to pop up a configuration page where you would select video size, file fomat and bitrates, or defaults.

Let me know if you're interested.

jrusch

12-11-2008, 10:21 PM

I am new to Tivo and new to trying to use this software. I need help. When I try and use this software, 0 byte files are created.

This is from the log file:
12/11/2008 10:08:35 PM Started QSF, input: GaryUnmarried
12/11/2008 10:08:37 PM VideoReDo said: INFO: VideoReDo version 3. 1. 5. 564 - Jul 5 2008
12/11/2008 10:08:42 PM VideoReDo completed QSF, creating: D:\Export\GaryUnmarried_QSF.mpg
12/11/2008 10:08:42 PM Started Ad Scan/auto-cuts, input: GaryUnmarried
12/11/2008 10:08:44 PM VideoReDo said: INFO: VideoReDo version 3. 1. 5. 564 - Jul 5 2008
12/11/2008 10:08:45 PM VideoReDo said: INFO: Failed file open: D:\Export\GaryUnmarried_QSF.mpg. Will retry
12/11/2008 10:08:49 PM VideoReDo said: INFO: Failed file open twice: D:\Export\GaryUnmarried_QSF.mpg. Will retry
12/11/2008 10:08:59 PM VideoReDo said: ERROR: Unable to open file/project: D:\Export\GaryUnmarried_QSF.mpg

dlfl

12-12-2008, 11:19 PM

jrusch:

I think your problem is a bad version (564) of TVSuite. Install the latest revision and try again. http://www.videoredo.net/msgBoard/showthread.php?t=6961

From the changelog for TVSuite version 566:
[Fix] COM: FileOpenBatch and FileOpenBatchPIDs don't work starting with Build 564

COM: FileOpenBatch is what TVAP uses for QSF. According to your log excerpt the QSF only took 7 seconds which seems suspiciously short.

dlfl

12-31-2008, 10:31 PM

Tiny change: The title item in the pyTivo metadata file no longer incorporates the episode # and episode name (for series).

Remember to uninstall the previous version.

msmart

01-03-2009, 11:08 PM

dlfl

01-04-2009, 11:47 AM

Speaking of metadata files...

I'm trying to figure out how to take the metadata text files created by TVAP and import them into an Excel file. Each line (without the header (before the ":")) to a column. Has anyone done this?

It would be nice to have the information contained in the metadata files in one file.

Oooh..... Feature Request... append the metadata information for a show directly into an Excel file on the next available row as TVAP processes each show.
I know how to do this but I see it as risky because of complications due to possible variations in OS and version of Office installed.

I thought about an option to output a single line (per video) text file with delimited fields that would be easy to import into Excel with "Text-to-data". However this, (and the direct Excel write), has the issue of what do you do with multiple-entry fields such as vActor etc.? I guess you could assign a certain number of fields, i.e., four actor fields, and just take the first four(?).

There are some other design questions to be addressed if this goes forward, but first is a text file for import of interest to you?

msmart

01-04-2009, 08:19 PM

Ah yes, the vActor and version dilemmas, understood.

I really only need three fields; description, seriesTitle, and episodeTitle. I copy those fields into an Excel spreadsheet to create a list of shows/movies that I've burned to DVD. I also copy the data into an application I use (Epson Print CD) to print the title and description directly onto printable DVD media.

I know this can be done with an Excel VB script but I'm not that good at it. I would be most appreciative if I could impose upon you to write one for me. It would open each of the metadata files in a directory and place the three fields into separate columns. I'm on Windows XP SP2 using Excel 2003.

If you were to add such a feature, I agree, use the first four actors and leave it at that. As for the pipe between first and last names, write it as is and leave it up to us to use find/replace to change it to a space or comma in Excel.

dlfl

01-04-2009, 11:30 PM

Could you go for a C# program that does what you want? (TVAP is a C# program BTW.) If so, do you need to maintain more than one xl file? And do you want it to always process all files in a selected directory or select one or more files in a file browser? Should it create a new xl file each run, or add to an existing file? In the latter case it has to have logic to prevent duplicates.

The simplest case is there is only one xl file in a fixed location and it is completely recreated on each run using all metadata files in one folder. Many variations are possible but the programming gets more complex.

Fortunately we have the same OS and version of Office.

msmart

01-05-2009, 12:45 AM

A C# program would be great.

If so, do you need to maintain more than one xl file?No.

And do you want it to always process all files in a selected directory or select one or more files in a file browser?All files. Once processed, I will move the files to a different folder.

Should it create a new xl file each run, or add to an existing file? In the latter case it has to have logic to prevent duplicates.A new one each time. I can copy its contents to a different "master" file.

The simplest case is there is only one xl file in a fixed location and it is completely recreated on each run using all metadata files in one folder. Many variations are possible but the programming gets more complex.Keep it simple, all files in folder to a new xl file each time the program is run.

Me thanks you in advance.

wgw

01-06-2009, 10:57 PM

dlfl

01-07-2009, 08:12 PM

dlfl,

Would you you be able to add partCount and PartIndex to your metadata extracts? I does not get transferred to the Tivo, but it is viewable on the Info screen. Here is a sample from TiVoVideoDetails. I've added the fields to my pytivo git branch.

<partCount>2</partCount>
<partIndex>1</partIndex>
What are these? I don't see anything with those names in the TivoDecode XML data that TVAP reads from TiVo files via TivoDecode.dll. (I also don't see them in the pyTivo Wiki metadata page.)

wgw

01-07-2009, 08:38 PM

They only appear when it's a multi part episode or series. When present, text like "Part Index 1 of 2", "Part Index 2 of 2" will appear on the info detail screen. For example, Man vs Wild - Siberia, airing this saturday on Discovery is part 1 of a 2 part episode. And "Land of Ice" airing Jan 19 is part 2.

I still need to add them to the wiki, as well as my other templates.

dlfl

01-07-2009, 09:23 PM

OK, I'll record the Man vs. Wild so I can have a sample to test the XML parsing with. If it's in the XML string it should be no problem to add it to the metadata files. I assume the format would be:

partCount : 2
partIndex : 1

Correct? I also assume that either both items should be present or neither of them, correct?

wgw

01-07-2009, 09:48 PM

dlfl

01-10-2009, 10:36 PM

pyTivo metadata output file now includes partCount and partIndex items if they are both present in the TiVo file metadata. This adds two items to the XML data file for each video, but there should be no complications. TVAP will create default values (empty strings) if the data isn't in the XML file, rather than failing due to missing data.

PyTivoMetaGen has been similarly modified.

Be sure to uninstall previous versions.

dlfl

01-25-2009, 01:15 AM

If QSF is your entire VRD processing chain (i.e., no AdScan) and the "_QSF" in the output file name is undesirable, see this post on the VideoReDo forum (http://www.videoredo.net/msgBoard/showpost.php?p=45401&postcount=105).

This should work even if you are using a TVAPpostProcess batch file, since it is performed later in the TVAPcleanUp batch file. It should be fairly obvious how to extend it to rename whatever new video file (e.g., .mp4) is created by your TVAPpostProcess script.

dlfl

02-04-2009, 04:34 PM

If you use HB 0.9.3 you might be interested in this post in another thread. (http://www.tivocommunity.com/tivo-vb/showthread.php?p=7045095#post7045095)

dlfl

02-07-2009, 08:42 PM

7 February 2009 Ver. 0.72
- Added HandBrake stall detection for TVAPpostProcess scripts. If the script runs HandBrake, TVAP checks every 5 minutes to see if HandBrake used less than 10% of CPU time over 5 minutes. If so it kills HandBrake. A descriptive log message is written.

HandBrake completed an encode but didn't terminate the other day. Per the HandBrake forum such stalls occasionally happen to others, also. If you have several videos waiting to be processed, they are blocked since the TVAP post process never ends. This should prevent this.

If you suspect a problem due to this new feature please let me know -- and revert to Ver. 0.71, which is still on the download site.

CanMan00

03-14-2009, 01:53 AM

Hey dlfl, I'm interested in seeing your HB post-processing scripts! I don't have 10 posts yet so I can't see any links in your signature.

I love the internet... Every time I think to myself, "Damn, this task I'm trying to do is a hassle. I wish I could make it easier..." I end up stumbling across a solution that someone much smarter than me has already been able to figure out.

First I found VideoReDo, then your TVAP program. Then I wrote my own PowerShell script to do some magic with the HandBrakeCLI afterwards and it looks like you may have already solved my problems there too. Thanks for writing it and sharing it with the rest of us!

msmart

03-14-2009, 11:28 AM

I don't want to steal dlfl's thunder but I'll offer up mine so you can compare after he posts. My output is for iPod. I use the smaller resolution and a lower bitrate to make smaller filesizes but the picture quality is still good IMO.

The Handbrake version I've been using is a development version, newer than 0.9.2 but before 0.9.3 became final. I saw on the Handbrake forum that 0.9.3 introduced some undesirable side effects (won't go into them here you can visit their forum and make up your own mind). The svn1477 version seemed, to me, a little better than 0.9.2 so I've stuck with it.

TVAPpostProcess.bat
@echo off
setlocal

rem all folder path values should end with the '\' character

rem folder containing hbcli.exe (Handbrake installation folder)
set HBFolder=C:\Program Files\Handbrake_svn1477\

rem folder containing this batch file and .mpg video input file
set localDir=G:\VideoReDo AdScan\

rem destination folder for encoded output video
set outdir=L:\iPod Ready Video\

set mpgName="%localDir%%~1.mpg"
set m4vName="%outDir%%~1.m4v"
if not exist %mpgName% goto done2
if exist %m4vName% del %m4vName%

"%HBFolder%HandBrakeCLI.exe" -i %mpgName% -o %m4vName% -e x264b30 -E faac -w 320 -b 384 -r25 -x keyint=300:keyint-min=30:bframes=0:cabac=0:ref=1:vbv-maxrate=384:vbv-bufsize=2000:analyse=all:me=umh:subme=6:no-fast-pskip=1 -B 160 -R 48

rem next line creates a log file of processed videos, if you uncomment it
echo %m4vName% >> "%outdir%HandbrakeBatchLog_svn1477.txt"

rem rename and copy pyTivo metadata file (if present) to output folder
rem if not exist "%localDir%%~1.mpg.txt" goto done2
rem set metafile="%outdir%%~1.m4v.txt"
rem copy "%localDir%%~1.mpg.txt" %metafile%
:done2
rem pause

Then there is the cleanup batch file which runs right after Post Process:

TVAPcleanUp.bat
rem @echo off
setlocal
set localDir=G:\VideoReDo AdScan\

set mpgName="%localDir%%~1.mpg"
set MetaDataName="%localDir%%~1.mpg.txt"

copy %MetaDataName% "M:\TiVo Edited Movies\Show Descriptions\%~1.mpg.txt"
del "%~1.mpg.txt"
del "%~1.vprj"

rem pause

Obviously you'll need to edit it to conform to your directory structure.

TVAP is a great tool, isn't it!! :up:

ADDED: CanMan, I just saw your post in the other thread, since you have 1080 files, my HB settings may not help you. But what you can do is use the HB GUI and get your settings the way you want them then there is a tab that creates a CLI string which can be copied to the batch file.

dlfl

03-14-2009, 11:52 AM

No thunder to steal, msmart! Your batch files are as good as any using HB. All you have to do is set up the folders per the comments and modify the HandBrakeCLI arguments for your desired encoding.

I would say use msmart's script(s) and post problems here so we can help you out. There are aspect ratio quirks for TiVo files with HB 0.9.3 that caused me problems autocropping and encoding to 640x480 (4:3) or 640x360 (16:9), etc. and I can supply more info and links if you have that kind of problem. HB 0.9.2 didn't have these issues, but I don't want to be stuck in the past.

msmart, is the version of HB you use still downloadable from their site?

msmart

03-14-2009, 03:43 PM

msmart, is the version of HB you use still downloadable from their site? It doesn't appear so, NO (http://handbrake.fr/?article=snapshot). 1477 was 0.9.2 Snapshot Build 2. I tried build 3 but didn't like it so went back to 2. However, it looks like 1477 already had the aspect ratio problem per THIS (http://forum.handbrake.fr/viewtopic.php?f=6&t=7236&p=40657&hilit=svn1477#p40657) thread.

So it would appear that 0.9.2 is your best bet with 1080 video for now. I saw your posts on the HB forum, looks like you're working on them.:cool:

CanMan00

03-16-2009, 04:10 AM

Thanks guys! This will save me a lot of time by mooching off your work rather than trying to figure out how to automate it all from scratch. I appreciate it!

I'm not 100% sure yet, but I think the autocropping might be part of the problem that the PS3 is choking on. I got one 1080i video from TBS HD to work. For some reason the Tivo grabs the file as 1920x1088. When I set HandBrake to crop it to 1920x1080 the PS3 was able to play it. But I was also messing around with some of the x264 settings at the same time. I need to go back and use a little scientific method to narrow it down to make sure that's what the problem was.

But, that was just one show from one channel. It still choked on some shows originally shot in SD that were played on Showtime HD. Those had some kind of strange 1580x1080 resolution (I don't remember exactly what the resolution was other than something silly like that).

I'd appreciate any links you've found that would help explain exactly what the problem is and how I can work around it.

goodtrips

03-21-2009, 08:53 AM

Hey dlfl, haven't posted in a while so hope all is good.

Unfortunately i've had a recurrence of an old issue and haven't had any luck fixing it. qsf starts, but can't seem to find the file. The progress bar stays blank, and I get the following windows notification about 10 seconds after starting:

VideoREDo - TVSuite
Mpeg stream error: Video program stream not found.

When I click OK, it then tries to do ad scan, but of course chokes because there's no QSF file. I've downloaded the latest version (72) with no luck. It's almost as if TVAP doesn't have write access to the target directory. Nothing changed from a set-up standpoint, but I've noticed that the properties for that target folder have Read Only selected (green box). I've tried to change this but it doesn't seem to stick; to my knowledge, though, the folder has always been set this way.

Here is a log file snippet that is indicative of the failure:

3/21/2009 8:09:58 AM Started QSF, input: The Daily Show With Jon Stewart (Recorded Mar 16, 2009, COMEDY)
3/21/2009 8:10:01 AM VideoReDo said: INFO: VideoReDo version 3. 1. 5. 564 - Aug 5 2008
3/21/2009 8:10:32 AM VideoReDo completed QSF, creating: C:\Documents and Settings\goodtrips\My Documents\TiVo\TiVo Dumps\The Daily Show With Jon Stewart (Recorded Mar 16, 2009, COMEDY)_QSF.mpg
3/21/2009 8:10:32 AM Started Ad Scan/auto-cuts, input: The Daily Show With Jon Stewart (Recorded Mar 16, 2009, COMEDY)
3/21/2009 8:10:54 AM Ad Scan canceled: Input file not found: C:\Documents and Settings\goodtrips\My Documents\TiVo\TiVo Dumps\The Daily Show With Jon Stewart (Recorded Mar 16, 2009, COMEDY)_QSF.mpg

Any thoughts?

dlfl

03-21-2009, 11:07 AM

goodtrips,

My immediate thought is I see you're using a rather old version of TVSuite. Unless you have some objection, I would suggest upgrading to the latest version (572). I've been using 568 recently.

Will the problem tivo file open and QSF "manually" using the TVSuite program?

Also, uninstall and re-install TVAP and reboot your PC, just as precautions.

Diagnostic questions:
1. Is the TiVo file that QSF is failing to find just finishing up being transferred or copied to the TiVo transfer folder?

2. Is the TiVo file on your HD (e.g., C: )?

If the file is being copied by Windows, or another program or script, rather than transferred by TivoDesktop, Windows sets the file size to the total size immediately at the start of the copy, so TVAP has to use special logic to be sure it waits for the copy to be complete before it launches a QSF (or Adscan). Without going into the gory details, if the copy takes longer than 60 sec per GB of file size, the kind of problem you are seeing could occur. (QSF is being attempted on a file that is not complete.) This would be most likely if you are copying to or from a USB HD or a network drive. Transfers via Desktop do not have this issue -- they increment the file size gradually during the transfer and TVAP can just check that the file size has not increased over a certain time period to determine the transfer has ended.

goodtrips

03-21-2009, 01:04 PM

thanks dlfl. couple of things:

My immediate thought is I see you're using a rather old version of TVSuite. Unless you have some objection, I would suggest upgrading to the latest version (572). I've been using 568 recently.

I looked for an update today, but it looks like the version I'm using (564) is the most recent release, at least per their website. Is there a link to beta releases available?

Diagnostic questions:
1. Is the TiVo file that QSF is failing to find just finishing up being transferred or copied to the TiVo transfer folder?)
Yes, everything has completely transferred. At this point, I'm working with a week's worth of files that are stacking up. :)

2. Is the TiVo file on your HD (e.g., C: )?
Yes, everything is located locally on my C: drive

I had one other thought: I received a notification from TiVo Desktop to upgrade to a newer version and declined the update. Files have been continuing to transfer successfully from the TiVoHD to the computer (as far as I can tell), so not sure if that is a valid data point or not. Just seems odd that everything would work for 6+ months and then stop.

dlfl

03-21-2009, 01:51 PM

goodtrips,

For TVSuite updates go to their Forum in the TVSuite Beta section for the link.

I just duplicated your problem and concluded the time I'm allowing for file copies was not enough in some cases. However, if all your tivo files have already been in place for some time, this would not explain your problem.

I've come up with a better method for checking copy completions and hope you (and any one else who volunteers) will test it. It's on the TVAP download site, the file with "test" in its name. This is just the TVAP executable file, not an installer package. Just move or rename your current executable to save it, and sub the test version, renamed without the "test" in the name.

Also, can you watch a tivo file in Windows Explorer while DeskTop is transferring it? Keep clicking View->Refresh and observe the file size. Does it start small and grow (like mine does) or does it jump immediately to the full file length at the start of transfer? It's possible later versions of Desktop or different versions of Windows have different behavior.

However, as I said, this change should make no difference if you are having problems with tivo files that have been in place for a while, rather than just finishing being transferred or copied. I hope maybe updating your TVS version will help in that case.

Another thought: If desktop is still running (even though it transferred your tivo file long ago) and is buggy enough, it might still be telling Windows that it is "using" the tivo file. This will prevent another program from opening it. Do you leave Desktop running all the time?

goodtrips

03-21-2009, 05:06 PM

So a couple of updates:

Updated VideoReDo to 572 and tested out your test exe file. Still no luck unfortunately.

I believe TiVo Desktop runs as a background service, so that is always running. I do have to open the application from time to time, and might leave it open for a day or two, but close it with no effect. I do notice when I restart that one of the TiVo services always needs to be forced closed before the machine will reboot (don't remember which one).

I'm not sure what other application other than Desktop could be using that file, but that made me think of another potential data point: I do "share" a few of the directories in the My Documents parent directory, but have never had an issue in the past. I've read that this could have some wonky effect on directory permissions (and potentially the read-only behavior I mentioned earlier).

I'm working from memory, but I'm fairly confident you can see the file size increase in explorer as it is being transferred.

dlfl

03-21-2009, 05:54 PM

Do the problem files process OK if you open them in TVSuite?

There are problems with QSF if the video dimensions change within a file but I know your are quite familiar with that issue from reviewing your posts in the TVAP thread of the VRD forum. I don't think it generates the messages you are getting.

dlfl

03-21-2009, 06:11 PM

Another long shot:

Maybe the total path name of the tivo file is too long for the VRD COM interface(?) Try renaming the file to just "test.tivo". (Stop TVAP processing, transfer the file then rename and restart TVAP processing.)

goodtrips

03-22-2009, 09:42 AM

OK, I think there's been some progress, but very strange behvaior.

I tried renaming the file to video.TiVo. I started TVAP and dragged the file into the source folder. The QSF process started (with progress bar) and completed successfully. Ad Scan started, but then choked because of the resolution issue (my filters in the QSF.vbs file are based off of file name).

But... changed the file name to Colbert.TiVo (to match the filter). That file failed on QSF as everything has been.

Changed the file name to the lowercase colbert.TiVo (and seemed to work), but my QSF filter must be case sensitive, because it failed again on the resolution change.

Changed the QSF filter to lowercase "colbert", tested lowercase colbert.TiVo, failed on QSF again.

Changed the QSF filter to uppercase "Colbert", tested lowercase clbert.TiVo, QSF worked, failed on ad scan resolution.

From what I can tell, my QSF.vbs file is at least partially responsible for breaking the process. Here is what it looks like:

percentComplete=0.0
set Args = Wscript.Arguments
'Wcript to perform QSF
rem Set VideoReDo = WScript.CreateObject( "VideoReDo.Application" )
set VideoReDoSilent = WScript.CreateObject( "VideoReDo.VideoReDoSilent" )
set VideoReDo = VideoReDoSilent.VRDInterface

rem Wscript.echo( VideoReDo.VersionNumber)
VideoReDo.SetQuietMode( true ) ' Save without any display
wscript.stdout.writeline("INFO: VideoReDo version " & VideoReDo.VersionNumber)

openFlag = VideoReDo.FileOpenBatch( args(0) )
if openFlag = false then
wscript.stdout.WriteLine( "ERROR: VideoReDo failed to open file/project: " & Args(0) )
Wscript.quit 1
end if
if instr(Args(0), "Daily Show") > 0 then
VideoReDo.SetFilterDimensions 704, 480
elseif instr(Args(0), "Colbert") > 0 then
VideoReDo.SetFilterDimensions 704, 480
end if

dim filesys
Set filesys=CreateObject("Scripting.FileSystemObject")

rem Wscript.echo( "fps = "& VideoReDo.GetFrameRate() & ", Duration = " &
VideoReDo.GetProgramDuration())

if NOT VideoReDo.FileSaveAsEx (Args(1), Args(2)) = 0 then
While( VideoReDo.IsOutputInProgress() )
on error resume next
percentComplete = CInt(VideoReDo.OutputPercentComplete)
if NOT err.number = 0 then
percentComplete = 0
end if
on error goto 0
Wscript.StdOut.WriteLine(percentComplete)
Wscript.Sleep 2000
If filesys.FileExists(".\stopper.txt") Then
wscript.stdout.WriteLine("Aborted QSF: " & Args(0) )
wscript.quit 3
end if
Wend
else
wscript.stdout.WriteLine("ERROR: VideoReDo failed to save file: " & Args(1) )
Wscript.quit 2
end if

VideoReDo.Close()
Wscript.quit 0

dlfl

03-22-2009, 12:14 PM

Hmmm... Kind of confusing results.

Are you using the "test" version of TVAP? If you are copying files into the tivo transfer folder, from a folder on the same drive, while TVAP is processing, you should be using that version. (That is the case were all released versions may not allow enough time for the copy.)

Are your dimension-change errors always occuring during AdScan, not during QSF? (I would think they should occur during QSF.) OR, maybe QSF is just producing an empty file because nothing in the video matches the filter dimensions, and then AdScan fails because of trying to load an empty file (??). If you uncheck Delete QSF you should be able to check that easily.

Are your QSF failures always the same failed-to-open message?

Yes the string comparisons you're using in QSF.vbs are case sensitive. There are VBScript string functions that could convert both strings to upper or lower case before comparison, but I don't remember them right now.

I don't remember whether I tested this back when, but maybe the filter dimension statements should go before the VideoReDo.FileOpenBatch statement(?).

Eventually, if we have to, we will set up a test case outside TVAP where we just call the QSF.vbs or AdScan.vbs with test arguments. Then we can post the test case on the VRD forum and ask for help. I can help do this.

I don't know when VRD is ever going to add a COM function to pre-scan a video and find the dominant video dimensions, (or return a list of video dimensions), which would allow TVAP to automate filter setting.

goodtrips

03-23-2009, 09:59 PM

So I think I've managed to pair this down a little:

I'm using two file types:
A) a file with a QSF filter set (for the resolution issue)
B) a file that does not have a resolution issue and no filter in QSF

First Test:
I disabled QSF and tested both A&B. Both files fail with the following error:
VideoReDo said: INFO: Failed file open: [location/file name]. Will rety.
It then attempts two more times (fails both) and moves on the to next file.

Second Test:
Re-enabled QSF. File type A (with filter).
QSF begins, error window quickly pops up: Mpeg stream error: Video Program Stream Not Found

Third Test:
QSF Enabled. File type B (without filter)
QSF begins, progress bar in TVAP works and completes.
Strangely, just started working. Was getting the same error in first test above, though.

Of course, the thing that is really confusing is that everything (including the filters) worked for about 6 months without a hiccup.

dlfl

03-23-2009, 11:17 PM

I'm still curious: Do these files open and process manually in VRD ?

Do they play in WMP? Both VRD and WMP use the Direct Show codecs installed with TiVoDesktop to input the TiVo files.

goodtrips

03-23-2009, 11:29 PM

Yes on both counts -- they open and play fine in WMP and opening them manually in VideoReDo has no issues. I've been adding new files to my test group every day, and they all exhibit the same behavior from TVAP.

dlfl

03-24-2009, 02:23 PM

All I can suggest at the moment is uninstall both VRD and TVAP and reboot, maybe a couple of times. Then re-install. Just desperation moves, actually.

Also, you could try an older version of TVAP. The last two versions are on the download site. Can you relate when the trouble started to TVAP version numbers?

goodtrips

03-24-2009, 04:09 PM

sadly, i've uninstalled tvap & videoredo, cleaned up the registry (cc cleaner), reinstalled, changed target directories, multiple restarts... still no dice.

short of doing a complete wipe and reinstalling xp, i'm coming to terms with the fact that i'm out of luck. thanks for all your help, though, dlfl!

dlfl

04-05-2009, 09:28 AM

jimbob111

04-06-2009, 07:00 AM

dlfl

04-06-2009, 08:28 AM

mewbie question. does this app allow videos of the same name, i.e. TV Shows back to the tivohd in a folder for convenient filing/storage after the shows have been edited and transferred back to the tivohd? thanks!
TVAP doesn't send or receive files to/from your TiVo. I see you've already posted in the StreamBaby thread. Your question might also be appropriate in the kmttg (http://www.tivocommunity.com/tivo-vb/showthread.php?t=387725) and pyTivo (http://www.tivocommunity.com/tivo-vb/showthread.php?t=328459) threads.

dlfl

04-08-2009, 10:37 PM

As illustrated in this post on the VRD forums (http://www.videoredo.net/msgBoard/showpost.php?p=47553&postcount=2)(free program) comskip is viewed as an attractive alternative to VRD AdScan for detecting commercials.

If there is user interest I will look into adding a comskip option to TVAP.
OK, that idea is dropped due to underwhelming user interest!

So time for a new one! How about (optional) automatic pushing of videos back to your TiVo after TVAP finishes processing them?

This idea was inspired by a recent post by cadmium, (http://www.tivocommunity.com/tivo-vb/showthread.php?p=7189460#post7189460) who was kind enough to share a code snippet showing how to do it. It relies on pyTivo to do the pushing -- all TVAP has to do is send an HTTP command to pyTiVo.

A possible feature would be for TVAP to queue up pending pushes and only command the pushes when (1) TVAP is not processing any videos and (2) pyTivo is running This feature could be of value if you're concerned about the processor loading of simultaneous TVAP-controlled encoding and pyTivo pushing (which also may involve encoding).

I usually transfer my encoded .mp4 files back to the tivo to check how they look on the TV, although their intended purpose is archiving.

I don't expect much user interest in this but .... surprise me!

lrhorer

05-23-2009, 01:36 PM

This program has the basic mechanics of just what I want, but doesn't seem to quite fit the bill. I avoid using TiVo Desktop as much as possible, and none of the (very large number of) files I want to process are .TiVo files. What I want to do is auto-select .ts files from a specific directory and run the VRD Ad Detective on them automatically, saving the .vprj file for later manual inspection of the cuts before final processing. Is there any possibility the ability to handle other file types than just .TiVo files could be incorporated?

lrhorer

05-23-2009, 01:42 PM

So time for a new one! How about (optional) automatic pushing of videos back to your TiVo after TVAP finishes processing them?
I don't think this is possible. Nothing I have read suggests TTGB transfers can be initiated from the PC side at this time. I would love to be proved wrong on this.

I don't expect much user interest in this but .... surprise me!
Oh, I would definitely be interested, if it's possible, but I don't believe either the HMO or HME interfaces allow for PC side initiated PC => TiVo transfers.

dlfl

05-23-2009, 07:24 PM

Irhorer,

As stated in my previous post:

It relies on pyTivo to do the pushing -- all TVAP has to do is send an HTTP command to pyTiVo.

pyTivo, at least wmcbrine's version, has been pushing videos back to TiVo for months now. However, due to underwhelming interest (including not much on my part actually) the TVAP-push idea has been abandoned.

There has been some interest from time to time in having TVAP work on input files other than TiVo. Don't know if I will ever get around to making such a program -- it's not just a trivial mod of TVAP and I don't have a personal need for it -- not yet at least.

Right now, I think DirMon is the way to automate this. It will monitor folders and you should be able to have it launch a batch or script file that would run VideoReDo via its COM interface, which is what TVAP does.

lrhorer

05-24-2009, 04:59 PM

That's lrhorer, if you please, not irhorer.

OK, I misread wmcbrine's post talking about the inability to push .tivo files, taking it to mean no files could be pushed to the TiVo. That .mpg files can be pushed is really good news, as that is all with which I am dealing.

As to the other, it looks to me like DirMon is a windows application. I don't need a Windows application if pyTiVo has an interface for transferring files to the TiVo. Worst case I can use Expect to pass the info to pyTivo via http.

smithcferg

05-26-2009, 01:18 PM

Hi, great program.

Is there a way you could include closed caption decoding into the pipeline?

Perhaps incorporate t2sami.exe? or tivodecode? Would be great for my spouse and other hearing impaired would be grateful too.

Thanks for all your hard work on this!

Craig

dlfl

05-26-2009, 07:59 PM

.......Is there a way you could include closed caption decoding into the pipeline?.........
I think so. I'm assuming you just want TVAP to create a .srt file as part of the workflow -- is that correct? It looks like this can then be used with StreamBaby to provide CC's. I'm just now graduating to HD TiVo so will be able to test this with StreamBaby soon. This will work if you use a TVAP post-process file to transcode the TiVo/Mpeg2 to an MPEG4 format.

If you just use VideoReDo (e.g., via TVAP) to create an edited mpeg2 file (.mpg) or TiVo (.tivo) file, the CC info is still embedded and correctly edited in the stream and will display if you transfer it back with pyTiVo.

Actually the creation of the .srt (or SAMI) file would be quite easy using the (user supplied) TVAPpostProcess batch file capability built into TVAP already. You would just install T2SAMI and then a line or two in the post-process script file would run its extraction command-line program on the mpeg2 file that resulted from the TVAP/VideoReDo work flow.

Just FYI, CC will work in VLC media player with either type caption file extracted from the mpeg2 file output from VideoReDo when you play the .mp4 file transcoded from this file (e.g., with HandBrake using a TVAPpostprocess batch file). I tested this with a movie that had been heavily edited to remove commercials. The CC's stayed in sync throughout.

My current thinking is that running the CC extraction from the post-process file is so easy that integrating it into TVAP may not be worth the trouble. If anyone is interested I'll be glad to provide instructions and a sample script file for this -- or if someone beats me to it, please post here for everyone.

EDIT: Well I went ahead and did it. Just install T2Sami in its default location then here is what you put in your TVAPpostProcess.cmd file:

@echo off
setlocal

rem all folder path values should end with the '\' character

rem folder containing this batch file and .mpg video input file
set localDir=I:\videos\adscan\

rem destination folder for transcoded output video
set outDir=J:\Videos\mp4transcodes\

set mpgName="%localDir%%~1.mpg"
if not exist %mpgName% goto done2

rem Generate CC file with T2Sami
set t2samiFolder=C:\Program Files\T2Sami\
"%t2samiFolder%t2extract.exe" -f srt %mpgName%
if not exist "%localDir%%~1.srt" goto doneCC
set ccFile="%outDir%%~1.srt"
copy "%localDir%%~1.srt" %ccFile%
del "%localDir%%~1.srt"
:doneCC

rem transcoding commands here

:done2
Most of the lines were required because I couldn't get the -p (output path) option of t2extract.exe to work so I could specify my transcoded file folder as the place for it to put the .srt file.

If you want a SAMI formatted CC file, just remove the "-f srt" option and change ".srt" to ".smi" everywhere.

Of course you have to substitute folder names appropriate to your system.

jmemmott

05-27-2009, 05:58 PM

Most of the lines were required because I couldn't get the -p (output path) option of t2extract.exe to work so I could specify my transcoded file folder as the place for it to put the .srt file.

I checked out the version that is up there now and there is a problem with the separator between the directory and filename when you use the -p option. If you are in a hurry, you can use Unix style forward slashes and it will work :

"C:\Program Files\T2Sami\t2extract.exe" -f srt -p "D:/My Video/" -f srt "E:\Tivo\Sanctuary - Revelations.mpg"

creates "D:\My Video\Sanctuary - Revelations.srt"

Otherwise, I am currently regression testing a new release that adds support for DVD subtitle streams => .srt and/or closed captions. Should be available in a couple of days. It will have a fix for this in it as well.

dlfl

05-29-2009, 07:13 PM

I think so. I'm assuming you just want TVAP to create a .srt file as part of the workflow -- is that correct? It looks like this can then be used with StreamBaby to provide CC's. I'm just now graduating to HD TiVo so will be able to test this with StreamBaby soon. This will work if you use a TVAP post-process file to transcode the TiVo/Mpeg2 to an MPEG4 format.
........
Just FYI, CC will work in VLC media player with either type caption file extracted from the mpeg2 file output from VideoReDo when you play the .mp4 file transcoded from this file (e.g., with HandBrake using a TVAPpostprocess batch file). I tested this with a movie that had been heavily edited to remove commercials. The CC's stayed in sync throughout.
..........

Follow up: I've now tested this with StreamBaby on my new TiVo HD. Worked great!

dlfl

05-31-2009, 07:14 PM

I checked out the version that is up there now and there is a problem with the separator between the directory and filename when you use the -p option. .... I am currently regression testing a new release that adds support for DVD subtitle streams => .srt and/or closed captions. Should be available in a couple of days. It will have a fix for this in it as well.
Just tested the t2sami release dated 5/28 with the added DVD subtitle support -- but doesn't look like it fixed the -p separator issue (?).

jmemmott

05-31-2009, 08:54 PM

Just tested the t2sami release dated 5/28 with the added DVD subtitle support -- but doesn't look like it fixed the -p separator issue (?).

Could you give the exact command line you are using. I just ran the following against the current release :

"C:\Program Files\T2Sami\t2extract.exe" -f srt -p "D:\My Video" "E:\Tivo\Sanctuary - Revelations.mpg"

and it created a 75KB captioning file :

D:\My Video\Sanctuary - Revelations.srt

as expected. Something not so obvious seems to be happening.

dlfl

05-31-2009, 11:28 PM

Could you give the exact command line you are using. I just ran the following against the current release :

"C:\Program Files\T2Sami\t2extract.exe" -f srt -p "D:\My Video" "E:\Tivo\Sanctuary - Revelations.mpg"
.......
Try adding a final '\' at the end of your output path. When I removed that it ran OK.

goodtrips

06-02-2009, 07:56 AM

If there is user interest I will look into adding a comskip option to TVAP.

OK, I'll bite. An unfrotunately delayed bite, however.

Recently I've been using a completely custom batch file (scheduled) to run through all the tasks once a TiVo file has been downloaded (Tivo File > VRD QSF > Comskip > VRD VPrj Cut > Handbrake > AtomicParsley for meta data > iTunes. Upgraded to the Windows 7 beta and have been nothing but issues with the Task Scheduler, though, and am looking at TVAP as a possible solution once again.

Having used both the commercial cutters in VRD and Comskip, in my opinion Comskip consistently does a more thorough and accurate job. Not perfect, but a significant improvement over VRD imo.

I know you're only getting one vote, but here's hoping :)

dlfl

06-02-2009, 08:38 AM

goodtrips,

I thought you were unable to use TVAP because of mysterious file open problems, which to my knowledge were never resolved. Have you run TVAP on Windows 7 ? Would hate to add Comskip just to find you couldn't use TVAP anyway, since you appear to be part of a very small minority interested in using comskip.

If I did add it, I hope I can count on you for some help regarding installation, configuration and command line arguments, since I've never used comskip myself. One question is whether comskip should be distributed via the TVAP installer or just installed separately.

dlfl

06-06-2009, 12:21 AM

ComSkip commercial detection may be sustituted for VideoReDo Ad Detective by checking "Use ComSkip Ad Scans" in Default Settings. The "Do Ad Scan" check boxes in Default Settings and in "Settings For Selected File" determine whether commercial detection (of any type) will be done. ComSkip will be used only if
1. The output type is MPEG2.
2. A QSF is performed. (ComSkip cannot use a .TiVo file as input.)
3. ComSkip.exe and a valid ComSkip.ini file are present in the ComSkip subfolder of the TVAP installation folder. The TVAP installer places these files there although it will not uninstall or overwrite an existing ComSkip.ini file.

If the conditions to use ComSkip are not met, Ad Scans will default to using VideoReDo Ad Detective as before.

More details may be found in the TVAPreadme.txt file, in particular the "Things To Know" section, item 20.

The ComSkip.ini file can of course be customized as desired. Users are referred to the ComSkip web sites ( http://www.comskip.org/ and http://www.kaashoek.com/comskip/ ) for additional ComSkip information.

My experience with ComSkip has been just what it took to get it integrated into TVAP. So I hope I haven't done anything too ridiculous. It seemed to work fine in my (limited) testing with the default ini file.

Post any problems or suggestions and, as always, the previous version is available on the download site.

Icarus

06-10-2009, 10:08 PM

Hi,

I'm just getting started with tvap, using video-redo to do the cuts, and save a project file, then manual review/save.

The first couple of files, I had it save the file as mpg, and did the cuts using the mpg file, but I think the resulting file (trimmed to ipod touch resolution using handbrake) didn't have the meta data. I see some text files in the directory I set up for the vprj files, but I had no idea what to do with them to get the meta data back in the final file.

So, this time around, I'm giving it a try saving the intermediate files as tivo files, and the plan is to use my modified ttg+ h.264 profile to do the final conversion to mp4, which, I believe should retain all the meta data for itunes. Is that correct? I think I will have to exit tvap, move the files back to the tivo dir, and then run ttg's gui to do the final conversions. Is there a better way to do this? I like the output files I got from handbrake, as they were better optimized for the ipod touch, but I don't like the loss of the meta data because itunes doesn't recognize it as a tv show and doesn't categorize the file properly.

I'm also wondering what tvap is waiting for now with all those files in the "waiting for cuts" state. How do I get rid of that? Cleaning up the directories? What does it intend to do? I do have it set to delete the original tivo file and intermediate qsf file. Does it want to delete the qsf file? Is that it? Where am I supposed to save the cut output to so it recognizes that I'm done?

Is there a better way for me to automate the final steps of converting the cut output to an mp4 with meta data suitable for my ipod touch than what I'm doing? All my files are HD, so they are huge until they are downsized in my final conversion process. TTG with my modified H.264 profile gets an hour down to about .5G. handbrake with it's better optimized settings is about 1/2 that size, and the 16:9 output seems to fully fill the touch's screen.

You know what would be really nice here? If I could do the final down-rez in video-redo and save it as mp4 right there. I wish they supported that, with profiles built-in for the popular players, like the ipod touch, etc, as with handbrake.

Thanks,
David

dlfl

06-10-2009, 11:36 PM

Hi,

I'm just getting started with tvap, using video-redo to do the cuts, and save a project file, then manual review/save.
.............
I'm also wondering what tvap is waiting for now with all those files in the "waiting for cuts" state. How do I get rid of that? Cleaning up the directories? What does it intend to do?........
Is there a better way for me to automate the final steps of converting the cut output to an mp4 with meta data suitable for my ipod touch than what I'm doing?.......
Sorry the TVAPreadme.txt isn't very clear on this: The files in the AWAITING CUTS status are waiting for you to load the .vprj file in VideoReDo, and review/modify the cuts.

1. Select the file that is AWAITING CUTS in TVAP.
2. Stop TVAP processing (click Stop Processing button).
3. Click the Run VideoReDo button. This will load the project file into VRD so you can do your review and modify the cuts if necessary.
4. Save the project file from VRD (which will be offered on the file menu, including the project name) and quit VRD. Note: You must save the project file even if you don't modify the cuts. This updates the timestamp on the file so TVAP knows you have reviewed it.
5. Start Processing in TVAP (Click the Start Processing Button). TVAP will now command VRD to save the file to your Ad Scan destination folder with the cuts defined in the project file. If you have a TVAPPostProcess.cmd file in that folder it will then run that script file on the video, perhaps doing a HandBrake encoding.

You can do multiple files in steps 3 and 4. You don't have to just do one at a time.

TVAP just creates pyTivo metadata files in the final destination folder. These are text files named <video>.mpg.txt and HandBrake cannot use them. I don't know how you would get this metadata into the .mp4 files, although there may be a way to do it. I don't think HandBrake itself can do it.

If you check Delete Tivos and Delete QSF in the settings, you should not have to delete any intermediate files.

If you want to accept the automatic commercial cuts done by Ad Detective or ComSkip, just check Auto Cut after Ad Scans in the settings. Then you will never see the AWAITING CUTS status.

There is no reason to use TiVo output type for your purposes, as far as I understand it.

Hope this helps.

Icarus

06-10-2009, 11:49 PM

dlfl

06-11-2009, 12:23 AM

aha, just save the project file. I was saving the entire output when I told tvap to run videoredo. ok thanks for that. that makes sense now that you explained it.

so, it doesn't make sense that I lost the metadata before the way I did it? Basically I was doing it manually, I guess, and not letting tvap do the entire thing. I guess I will try it again.

In order to used handbrake, I need one of it's supported file types output. The selections in tvap that seem to make sense to me are tivo and mpg, but of course handbrake doesn't take tivo input. So I should be using MPEG2 as the output in tvap, right? And if I do it right, it should keep the metadata all the way through the process, right?

Thanks for all this and the help.

-David
Glad things are starting to make sense!

Yes, mpeg2 is the output type you want for input to HandBrake.

Yes, TVAP will keep the pyTivo metadata file all the way through -- it will be in your Ad Scan destination folder along with the final version of the .mpg output file.

Here is a link where you can download an example TVAPPostProcess.cmd file (http://www.mediafire.com/download.php?8wf9tdbtfmq)for HandBrake encoding. It may be a little out of date and you will have to tune the HandBrake options to suit your purpose. Don't hesitate to ask for help.

Icarus

06-11-2009, 01:47 AM

Thanks, I will take a look at the file.

I'm still confused, because I'm not understanding what I need to do to keep all the metadata (program information) right in the encoded file. It's included in the .tivo file, and when I've done the process by hand without using tvap or videoredo, the metadata ends up included in the mp4 file and itunes can read it and classifies the show properly with the show title, episode name and synopsis. It doesn't come from a separate file, at least as I understand it.

I'm not using pytivo, but if I were, I'm sure those files might be useful. I want to make sure the metadata stays right in the encoded file and isn't somehow stripped from it when I process it.

-David

Icarus

06-11-2009, 02:10 AM

Let me try doing it the "right way" and see if I get the results I want. I will report back.

Thanks again.

-David

Icarus

06-11-2009, 03:13 AM

ok, so in this thread, around posts #23 - #27, it says that vrd maintains tivo meta data, but if I use vrd to save as mpg, it's all lost, I guess. In that case, all you get is the filename.

http://www.tivocommunity.com/tivo-vb/showthread.php?t=330218

Somehow using ttg+ to convert the tivo to h.264, it isn't lost, I think. Looks like I have to do that. What a pain. Or I live without the metadata for now, and get all these uncategorized videos on my ipod touch.

ok, I really want vrd to output h.264 with profiles for the output resolution. That would really handle everything I need, assuming it can manage to insert the meta data properly in the h.264 file, like ttg+ conversion to h.264 does. Then once they do that, you can integrate those choices into tvap. :)

In that case, I think the steps in tvap might be something like:

1. vrd qsf output to .tivo
2. vrd ad-detect, create project file.
3. wait for manual project file update
4. vrd apply cuts from project file and output to h.264 (mp4) with resolution profile.
5. clean up.

An optimization would be to do the h.264 and down-res conversion in step 1, because the ad-detect and rest of the processes would be much faster with the much smaller files.

-David

Icarus

06-11-2009, 04:27 AM

meta data in an mp4 file. File was run through tvap, keeping the file in .tivo format. Then copied the cut .tivo file back to the tivo dir, and used ttg+ to convert to h.264 (modified profile for ipod touch.) The meta data is there in the h.264 file (mp4) as shown in the quicktime player:

http://lh5.ggpht.com/_27er8ut4Pow/SjDNA3StTsI/AAAAAAAADUI/QgmQ_R8yC2U/s800/mp4-meta-data.jpg

dlfl

06-11-2009, 10:32 AM

11 June 2009 Ver. 0.74
- Fix: For some large files, when using ComSkip without autocuts (manual review mode) autocut would be performed, i.e., skipping the "AWAITING CUTS" manual review.

This was caused by an arcane .vprj timestamp issue. The fix requires that at least 30 seconds elapse between when TVAP creates the project file and when you save that file from VideoReDo after reviewing cuts. Seems unlikely
anyone would beat that time but if you do, TVAP simply still thinks the video is awaiting cuts. (Obvious workaround, don't be so lightning fast in doing your manual cuts.)

This version also did a very minor polish on the TVAPReadMe.txt file.

dlfl

06-11-2009, 10:49 AM

Icarus,

Take a look at this post in the kmttg thread (http://www.tivocommunity.com/tivo-vb/showthread.php?p=7235689#post7235689).

Looks to me like there is a windows executable for Atomic Parsley that can read the pyTivo metadata file and put the metadata into a .mp4 file (?). At least that is what the post says kmttg is doing.

If this is true, it should be easy to do this in a TVAPpostProcess.cmd file. It may be that Atomic Parsley can't directly read the pyTivo file and kmttg is reading it and feeding the data into AP. Requires some investigation -- but seems interesting!

dlfl

06-11-2009, 12:07 PM

........Looks to me like there is a windows executable for Atomic Parsley that can read the pyTivo metadata file and put the metadata into a .mp4 file (?). At least that is what the post says kmttg is doing.

If this is true, it should be easy to do this in a TVAPpostProcess.cmd file. It may be that Atomic Parsley can't directly read the pyTivo file and kmttg is reading it and feeding the data into AP. Requires some investigation -- but seems interesting!
Downloaded the windows version of AP and did some quick experiments. This looks quite doable. I used AP to add a Description tag to a 600MB .mp4 movie file that I encoded with HandBrake. It has to increase file size to hold the tag so it has to write a temp file. Took about 30 seconds with all file operations on a USB hard drive. The Description tag showed up in QuickTime Player.

AP will not read the pyTivo metadata file directly so that will have to be handled. My current thought is to write a little command line program that reads the pyTivo file and runs AP with the correct arguments. Then this program would be called from the TVAPpostProcess.cmd file.

A question is: which meta tags are to be set by this process?

AP says it can set all these iTunes style tags:
--artist (string) Set the artist tag
--title (string) Set the title tag
--album (string) Set the album tag
--genre (string) Genre tag (see --longhelp for more info)
--tracknum (num)[/tot] Track number (or track number/total tracks)
--disk (num)[/tot] Disk number (or disk number/total disks)
--comment (string) Set the comment tag
--year (num|UTC) Year tag (see --longhelp for "Release Date")
--lyrics (string) Set lyrics (not subject to 256 byte limit)
--composer (string) Set the composer tag
--copyright (string) Set the copyright tag
--grouping (string) Set the grouping tag
--artwork (/path) Set a piece of artwork (jpeg or png only)
--bpm (number) Set the tempo/bpm
--albumArtist (string) Set the album artist tag
--compilation (boolean) Set the compilation flag (true or false)
--advisory (string*) Content advisory (*values: 'clean', 'explicit')
--stik (string*) Sets the iTunes "stik" atom (see --longhelp)
--description (string) Set the description tag
--TVNetwork (string) Set the TV Network name
--TVShowName (string) Set the TV Show name
--TVEpisode (string) Set the TV episode/production code
--TVSeasonNum (number) Set the TV Season number
--TVEpisodeNum (number) Set the TV Episode number
--podcastFlag (boolean) Set the podcast flag (true or false)
--category (string) Sets the podcast category
--keyword (string) Sets the podcast keyword
--podcastURL (URL) Set the podcast feed URL
--podcastGUID (URL) Set the episode's URL tag
--purchaseDate (UTC) Set time of purchase
--encodingTool (string) Set the name of the encoder
--gapless (boolean) Set the gapless playback flag

A few of these have obvious one-to-one relationships to the pyTivo metaData and many of them have no pyTivo counterpart.

What are the desired tags, ranked in order of importance? If any desired tags are not available in the pyTivo metaData (e.g., grouping) they would have to handled as optional command line options for my program.

Icarus

06-11-2009, 12:54 PM

I think you might be able to figure out some of them from this.

This one is the program info (itunes) from a file I downloaded from tivo, processed and converted with ttg+ to h.264

http://lh5.ggpht.com/_27er8ut4Pow/SjFD02U0d5I/AAAAAAAADVA/ojXA5-Ogm-w/s800/numbers.jpg

Contrast that to this episode of Fringe which I downloaded from itunes:

http://lh3.ggpht.com/_27er8ut4Pow/SjFDu-QuQ5I/AAAAAAAADU8/uCbbzNSBLKs/s800/midnight-info.jpg

It would be nice to do the proper tivo episode id to season#, episode# translation. For 523, that translates to season 5, episode 23.

If there's a better program I can use to display all the metadata, I'll be happy to download it and run it and post the output. I haven't looked for one yet.

I'm not sure what the metadata looks like for downloaded movies.

I think these are all ID3 tags. There must be a spec somewhere.

-David

Icarus

06-11-2009, 01:34 PM

I found an old movie I downloaded in 2008. tivo and ttg+ incorrectly categorize it as a tv show, and it shows up under tv shows in itunes. On the video pane, Episode is 1.

I think movies should just have name, artist, year, genre and description, but you will get whatever tivo put in its own metadata of course.

-David

Icarus

06-11-2009, 01:42 PM

hey, you know I have 2 mpg files and their metadata files still. I will download atomic parsley and play with them and see what I come up with.

the mpg files are the qsf output from when I was doing it the other way. I haven't gotten around to converting them yet, so I will run handbrake on them now and then play with this thing.

-David

Icarus

06-11-2009, 01:51 PM

Found a gui for atomic parsley here: http://www.textzombie.com/videotag/

ah well, never mind. videotag didn't work at all for me. for me it crashes when running its own bundled copy of AtomicParsley.exe (named VTAtomicParsley.exe in videotag's install dir.)

Update: Phil, the guy who wrote this got back to me and we debugged it. I either had a corrupt download or his bundled version of Atomic Parsley is corrupt. Either way, if you replace the file named VTAtomicParsley.exe with the current 0.9 version of AtomicParsley.exe (properly renamed to VTAtomicParsley.exe in the install dir for videotag) this tool works, and it's a very nice tool.

AtomicParsley.exe <filename> -t
dumps all the tags in <filename>
Run it in a command prompt. Easier if you copy AtomicParsley.exe to where the video file is.

Atomic Parsley:

http://sourceforge.net/project/showfiles.php?group_id=153768&package_id=170610&release_id=447801

-David

Icarus

06-11-2009, 04:12 PM

I found another front end for it called iPodTvShow. It's a gui front end to atomic parsley. It doesn't let you set much, just enough to make itunes/ipod think it's a tv show. It doesn't even support filling in the description.

Looks like a lot of people needed a fix like this for "Lost" for some reason. If you have a mac, there's a gui called "lostify" that does it also. hahaha.

This is the bat file it creates to run Atomic Parsley after I set all the fields manually in the GUI:

AtomicParsley.exe "C:\Users\dmk\video\qsf\CSI NY - ''Pay Up''.mp4" --genre "TV Shows" --stik "TV Show" --TVNetwork "CBS" --TVShowName "CSI NY" --TVEpisode "525" --TVEpisodeNum 25 --TVSeason 5 --title "Pay Up"

hmmm, that stik thing is being set also?

Anyway, when I added it to itunes, it properly categorized it as a episode of the tv seriers, CSI NY.

itunes will also let you change all these fields, but it won't recategorize the show after you change the tags.

-David

Yoav

06-11-2009, 05:29 PM

For an atomicparsley front-end, I've been fairly happy with MetaX on the mac, and it looks like there's a windows port:

http://www.danhinsley.com/MetaX.htm

This is a double-bonus since the metaX coder is updating atomicparsley (it has been abandoned by the original coder)

dlfl

06-11-2009, 06:57 PM

....... My current thought is to write a little command line program that reads the pyTivo file and runs AP with the correct arguments. Then this program would be called from the TVAPpostProcess.cmd file.

A question is: which meta tags are to be set by this process?
.......
Problem solved the easy way: kmttg already does this and the code is visible in the Google Code pages. My program, initially at least, will just mimic the functionality already in kmttg (in C# rather than Java).

Hope to have this ready before Sat. morning, when I go out of town for a week and won't be able to reach my development machine.

I have my doubts about the reliability of an algorithm for getting season number from the TiVo episode number. I just checked an episode of House that has a TiVo episode number of 6815. The current kmttg algorithm would yield Season #68, Episode #15 (if I'm reading the Java code correctly). The epiisode number is correct but the season number can't be.

Icarus

06-11-2009, 10:53 PM

I would just go with their algorithm for episode number. That's easy to override in itunes.

Thanks again,
-David

dlfl

06-12-2009, 07:04 PM

......... My current thought is to write a little command line program that reads the pyTivo file and runs AP with the correct arguments. Then this program would be called from the TVAPpostProcess.cmd file.
.......
pyTiVoParsley is a command line program. It reads a pyTiVo metadata file and inserts metadata tags in a .mp4 or .m4v file using Atomic Parsley.

I've put a zip file (pyTiVoParsley.zip) on the TVAP download site (given in first post of this thread). The zip includes a readme file that should tell you all you need to know.

Let me know how it goes. Although intended for TVAP post-process scripts, to be used after transcoding to MPEG4, it obviously could be used to insert metaData in previously encoded videos too.

Icarus

06-12-2009, 07:22 PM

seems to work for me. and no directory names needed if all files are in the same dir.

before (I must have used on of the other programs to set the metadata):

C:\Users\dmk\video\qsf>AtomicParsley.exe "CSI NY - ''Grounds for Deception''.mp4
" -t
Atom "ctoo" contains: HandBrake 0.9.3 2008112300
Atom "cgen" contains: TV Shows
Atom "stik" contains: TV Show
Atom "tvnn" contains: CBS
Atom "tvsh" contains: CSI NY
Atom "tven" contains: S5E24
Atom "tves" contains: 24
Atom "tvsn" contains: 5
Atom "cnam" contains: Grounds For Deception

After:

C:\Users\dmk\video\qsf>AtomicParsley.exe csiny-gfd.mp4 -t
Atom "ctoo" contains: HandBrake 0.9.3 2008112300
Atom "cgen" contains: TV Shows
Atom "stik" contains: TV Show
Atom "tvnn" contains: KGMBDT
Atom "tvsh" contains: CSI: NY
Atom "tven" contains: Grounds for Deception
Atom "tves" contains: 524
Atom "tvsn" contains: 5
Atom "cnam" contains: CSI: NY
Atom "cgrp" contains: Action Adventure
Atom "cday" contains: 2009-05-13T00:00:00Z
Atom "desc" contains: When Stella learns that New Yorkers are being murdered ove
r ancient Greek artifacts, she and Mac head to Greece and uncover a mystery.

I think cnam is being set wrong. cnam should be the episode name maybe?

-David

Icarus

06-13-2009, 07:55 AM

I can't even figure out how to set cnam with AtomicParsley. --longhelp doesn't mention it.

FWIW, kmttg does the same thing.

-David

dlfl

06-20-2009, 09:22 PM

20 June 2009 Ver. 0.75
- Added Transport Stream (TS, *.ts) output type selection.
- ComSkip Ad Detection can be used for either MPEG2 or TS output types.
- TVAPPostProcessBatch file can be used with MPEG2, DVR-MS or TS output types.
- Fix: Tab order for Use-ComSkip check box

ComSkip is also supposed to handle DVR-MS files but in my limited testing it has locked up -- so I have not enabled the ComSkip option for that file type.

I have verified that HandBrake handles TS inputs just fine, for anyone wishing to use TS output file type and also transcode to .mp4 in a TVAPpostProcess script.

Burger23

06-29-2009, 07:55 PM

I am having trouble getting TVAP to work with Windows 7 RC1- all I want to do is to download a .tivo file, convert it to .dvr-ms and send the converted file to my Win7 Media Center. I have set up all 3 programs, TiVo Desktop, Video Re-Do, and TVAP to run in Vista SP2 compatibilty mode and Run as Administrator. I have gotten this to work in the past, so I know it can be done. But I have chnaged verions of all programs and I may have an odd version combination between the 3 programs. I am using TiVoDesktop ver. 2.7 , Video-Redo ver 2.5.7.602, and TVAP ver.72

TVAP either does nothing but start processing- or, when selecting RESET, and unchecking Block Processing, it starts- but immediately says it is completed.

Can anyone verify version numbers that work with Windows 7?

dlfl

06-29-2009, 10:16 PM

I am having trouble getting TVAP to work with Windows 7 RC1
TVAP runs VRD via VBScripts. I think the most likely problem is asscociated with these VBScripts running properly on Windows 7. Here are links to some posts/threads on the VideoReDo forum that may be of help:

http://www.videoredo.net/msgBoard/showpost.php?p=50455&postcount=4

http://www.videoredo.net/msgBoard/showthread.php?t=11282

I'm still running XP. TVAP runs OK on Vista and on 64bit Vista, but I won't be in a position to test it on 7 any time soon.

Burger23

06-29-2009, 11:21 PM

TVAP runs VRD via VBScripts. I think the most likely problem is asscociated with these VBScripts running properly on Windows 7. Here are links to some posts/threads on the VideoReDo forum that may be of help:

http://www.videoredo.net/msgBoard/showpost.php?p=50455&postcount=4

http://www.videoredo.net/msgBoard/showthread.php?t=11282

I'm still running XP. TVAP runs OK on Vista and on 64bit Vista, but I won't be in a position to test it on 7 any time soon.

Thanks for your prompt reply. I tried cleaning the registry keys as recommended in one of the links above. I am now attempting this on 2 different Windows 7 machines- one 32-bit, one 64-bit. Same issue on both machines.

6/29/2009 9:09:20 PM Started QSF, input: 30-Minute Meals - ''Ding Dong Dinner'' (Recorded Jun 29, 2009, FOODHD)
6/29/2009 9:09:22 PM VideoReDo completed QSF, creating: \\Mediacenter7esc\e\recorded tv\30-Minute Meals - ''Ding Dong Dinner'' (Recorded Jun 29, 2009, FOODHD)_QSF.dvr-ms

I have also tried changing the output directory to a local, as opposed to network, drive. Same issue- It instantly reports the file as being converted- and there is obviously no hint of it in the output directory.

As I mentioned above, I have gotten this to work before. In fact, as late as June 25, 2009 I show a sucessfull tivo to dvr-ms converted file in my MediaCenter. This is very odd.

Any ideas about the "instant completion" mentioned above?

Burger23

06-29-2009, 11:30 PM

OK - this is a bit embarrasing- but I knew it had to be a human error.

When I did my clean install of Windows 7, I did not re enter my registration key into Video ReDo. With that entered, everything works fine now...duh.

dlfl

09-18-2009, 03:03 PM

See this post. (http://www.tivocommunity.com/tivo-vb/showthread.php?p=7504216#post7504216)

If you're interested in the mentioned TVAP mod, post.

dlfl

09-22-2009, 03:02 PM

22 September 2009
- Fixed: Sequencing errors when using ComSkip ad detection with autocuts -- Sometimes failed to do postProcess script -- Sometimes did it twice.
- Note: Still installing version 80-023 of ComSkip. The changes in 024 and 025 do not appear to have any relevance to TVAP usage. However feel free to substitute whatever ComSkip executable and ini file you prefer to use.

Burger23

10-09-2009, 04:40 PM

dlfl

10-09-2009, 05:37 PM

When running program under Windows 7 32-bit, I get the following error message: windowsapplication1 has stopped working- and TVAP crashes. I tried uninstalling and then reinstalling. Still have same issue. Not sure what to try now??
Is this happening immediately on starting TVAP, or when it tries to run a VRD process?

You posted on 6/30/09 about problems that were fixed by registering VideoReDo. I assume this can't be the same problem.

Has TVAP never run OK on the system in question, or did it just start doing this? If it was OK before, what has changed?

Do you have TiVo Desktop installed? If not, can you install it and enter your MAK, then try TVAP again?

If the crash comes when TVAP tries to run a VRD process, please search the VRD forums for anything new regarding running VRD on Windows 7 (beyond what I linked in this thread circa 6/30/09).

Burger23

10-09-2009, 05:55 PM

Is this happening immediately on starting TVAP, or when it tries to run a VRD process? It happens immediately on starting TVAP

You posted on 6/30/09 about problems that were fixed by registering VideoReDo. I assume this can't be the same problem. It is unrelated I believe

Has TVAP never run OK on the system in question, or did it just start doing this? If it was OK before, what has changed? TVAP has been running great- it just started.

Do you have TiVo Desktop installed? If not, can you install it and enter your MAK, then try TVAP again? TiVo Desktop is installed.

Since I assume that you have not seen this error before, it must be caused by something that I did. I use Windows Home Server to backup daily so I will just go back a couple weeks ago and restore when I know TVAP was loaded correctly.

Thanks for your response...

dlfl

10-09-2009, 06:25 PM

Burger23,

Try emptying your TiVo transfer directory then running TVAP. Does it run?

Also, does VideoReDo run on this machine?

Burger23

10-09-2009, 06:57 PM

Burger23,

Try emptying your TiVo transfer directory then running TVAP. Does it run?

That fixed it :-)
I run TVAP in my laptop. My TiVO transfer directory is on an external hard drive that plugs into the laptop. I just returned from a trip whre I took my laptop with me. I forgot to plug the external hard drive back in - that fixed in.

I sure enjoy, and use your program daily. Thanks so very much for effort.

dlfl

10-09-2009, 07:31 PM

That fixed it :-)
..........I sure enjoy, and use your program daily. Thanks so very much for effort.
:up: Great! Now that I'm on TWC digital cable where most channels are copy protected, I guess others are using TVAP more than I do! :( ;)

Burger23

10-10-2009, 04:28 PM

Now that I'm on TWC digital cable where most channels are copy protected, I guess others are using TVAP more than I do! I am on Comcast- and I use TVAP exclusively on TiVO recorded extended cable channels like USA, TNT, BRAVO, etc- but no premium movie channels (HBO, etc). All clear QAM chnnals are recorded on my Windows Media Center. So I use TiVo primarily as back up during the regular TV season (with exceptions of Mad Men and Monk)- but heavily during the summer when Damages, Closer, and other favorite shows are available only on cable. It is my understanding that these channels will continue to have no copy protection as long as you pay for the package.

janry

11-25-2009, 04:03 PM

dlfl

11-25-2009, 05:50 PM

Thanks for this great utility, dlfl.

I have kttmg, TVAP & VideoReDo all running on a netbook with a 1.5TB external drive to automatically convert all my TiVo HD recordings so they can play on a WD TV Live. I plan to get a 2nd WD TV Live so we can watch our recordings on any of our 3 TVs.
Interesting! How do you divide your work flow between TVAP and kmttg? It's been looking like kmttg does everything TVAP does, plus more.

janry

11-25-2009, 06:11 PM

Interesting! How do you divide your work flow between TVAP and kmttg? It's been looking like kmttg does everything TVAP does, plus more.

I use kmttg just to transfer the recordings from the TiVo. I found if I converted the files with kittmg, I had no audio on the WD TV Live unless I process with comcut, which I didn't want to do since it is not perfect. For whatever reason, when I auto-process the TiVo recordings throgh VRD, I get the audio on WD TV Live.

moyekj

11-25-2009, 09:57 PM

I use kmttg just to transfer the recordings from the TiVo. I found if I converted the files with kittmg, I had no audio on the WD TV Live unless I process with comcut, which I didn't want to do since it is not perfect. For whatever reason, when I auto-process the TiVo recordings throgh VRD, I get the audio on WD TV Live. If you run through VRD QS Fix task in kmttg I don't see any reason why it would not work.

dlfl

11-25-2009, 10:44 PM

moyekj

11-26-2009, 12:48 AM

IIRC janry has an issue with audio that switches between stereo and 5.1 in his files and this confuses the WD device so it plays no audio at all. You can make the VRD output audio be converted to stereo-only with an option setting, which will at least let the WD device play it, although giving up 5.1. I'm guessing he is doing this and for whatever reason finds it easier to do using TVAP than kmttg. The VRD output audio option has to be set manually in the VRD GUI -- TVAP can't set it. Some VRD options (e.g., Ad Detective tuning parameters) can be set in the GUI and then they "stick" and are used in the COM processes. I don't know if this audio option is like this, although I would not expect it to be. If it is "sticky" I would think it would stick for kmttg VRD operations as well. I'm really guessing here!
Oh OK, thanks for the explanation. Certain settings like audio boost don't seem to stick unfortunately. What's worse is if I adjust the audio to a level I want and then save the project to .Vprj and then run COM job to cut the audio boost is ignored, so if you want audio boost via VRD you have to use the GUI mode. I think you mentioned this is going to improve in future versions of VRD so look forwards to that.

janry

11-26-2009, 04:45 AM

IIRC janry has an issue with audio that switches between stereo and 5.1 in his files and this confuses the WD device so it plays no audio at all. You can make the VRD output audio be converted to stereo-only with an option setting, which will at least let the WD device play it, although giving up 5.1. I'm guessing he is doing this and for whatever reason finds it easier to do using TVAP than kmttg. The VRD output audio option has to be set manually in the VRD GUI -- TVAP can't set it. Some VRD options (e.g., Ad Detective tuning parameters) can be set in the GUI and then they "stick" and are used in the COM processes. I don't know if this audio option is like this, although I would not expect it to be. If it is "sticky" I would think it would stick for kmttg VRD operations as well. I'm really guessing here!

No, I'm not switching to stereo only. For whatever reason, ktmmg converted files confuse the WD but VRD converted files do not. My converted VRD files play back fine in 5.1 on the WD TV Live.

dlfl

11-26-2009, 06:54 AM

No, I'm not switching to stereo only. For whatever reason, ktmmg converted files confuse the WD but VRD converted files do not. My converted VRD files play back fine in 5.1 on the WD TV Live.
Hmmm.... Sounds like it's a difference between TiVoDecode and VRD in the TiVo-->Mpeg2 stripping process. (?).

Burger23

12-17-2009, 03:51 PM

I am getting an error message after the QSF processing: Ad-Scan cancelled- Input file not found. Screenshot attached.

http://www.gradygroup.com/images/1.jpg

Ideas?

Thanks so much

dlfl

12-17-2009, 05:44 PM

I am getting an error message after the QSF processing: Ad-Scan cancelled- Input file not found. Screenshot attached.

http://www.gradygroup.com/images/1.jpg

Ideas?

Thanks so much
A quick initial thought: I see you're using comskip for ad detection and outputting dvr-ms files. Have you successfully been using comskip with this file type prior to this? I tried comskip a couple of times on dvr-ms files and it crashed, although I may have configured it wrong.

Also can you check to see if the QSF output file it says is missing is actually there, and the name matches what TVAP is looking for?

Burger23

12-17-2009, 06:30 PM

Thanks for your prompt reply-

First, I included in the screenshot a Windows Explorer IE of the location: S:\QSF- the Closer ..._QST.dvr-ms file is indeed there.

Second, I have used Comskip to successfully edit dvr-ms files while using DVRMSToolbox on .wtv converted files. The error seems to be that VRD can not find the file in S:\QSF- wonder if it needs any specials permissions?

I tried it with the Comskip box UNCHECKED- but I got the same error

Burger23

12-17-2009, 07:02 PM

I should add that I can manually convert .tivo, cut ads, and Save As a dvr-ms just fine. It is only when using the TivoVideoReDo software that I have this issue.

dlfl

12-17-2009, 07:49 PM

If your QSF destination drive is a USB drive or a network drive, can you try again with it set to a drive partition on an internal hard drive? Also try setting the output type to mpeg2. Keep the adscan set to VideoReDo Ad Detective for now. Let me know if either change makes a difference.

Burger23

12-17-2009, 10:07 PM

Your guess that Drive S was a USB drive was correct. I changed drive to drive E, a partitioned internal drive. I then started the process again, once with Comskip UNCHECKED- and once with Comskip checked ON. Unforntuately I got the same error.

I then tried another show- same error.

dlfl

12-18-2009, 08:23 AM

Burger23

12-18-2009, 10:57 AM

dlfl

12-18-2009, 02:36 PM

Sorry I forgot to try saving show as a mpg. I did that this morning and that indeed DID WORK CORRECTLY. But, of course, a mpg file is not visible in Windows Media Center. I believe I mentioned earlier that the process completes successfully if done manually in VRD.

Thanks for your assistance in troubleshooting
I understand you need dvr-ms output -- this was just a diagnostic exercise, and it tells me there probably is a bug in TVAP. I will look into it.

dlfl

12-18-2009, 03:32 PM

Sorry I forgot to try saving show as a mpg. I did that this morning and that indeed DID WORK CORRECTLY. But, of course, a mpg file is not visible in Windows Media Center. I believe I mentioned earlier that the process completes successfully if done manually in VRD.

Thanks for your assistance in troubleshooting
Could you try your process with a short input video, please (e.g., 1 min., just edit a larger TiVo to a short one)? Keep VRD as the AdScan agent for now. I just did this and had no problems, so I'm wondering if your problem is somehow related to the file size (video length).

Edit: I've now processed a 2 GB file successfully.

meowth

01-14-2010, 09:06 PM

See this post. (http://www.tivocommunity.com/tivo-vb/showthread.php?p=7504216#post7504216)

If you're interested in the mentioned TVAP mod, post.

I routinely have tivo files that need the qsf with the filters for videoredo to process the files. I had tried using TVAP about a year ago hoping to automate the editing process for my media server but couldn't get it to work using the standard qsf. I just recently found a link to this thread talking about mods to the qsf script allowing it to do the filters. However, I can't figure out what needs to be changed and where in the script as I know nothing about scripting.

I know that I have about 5 different cable networks that I routinely need to do the filters with. Can the filters be set to select what resolution to use based on the channel name listed in the file name? (ex: FOODHD, DSCHD, SCIHD, HSTRYHD) I don't know what the syntax would need to be for the different resolutions. The main resolutions used for the various channels I have to use the filters on are 704x480, 1280x720, 1920x1080.

dlfl

01-14-2010, 11:03 PM

I routinely have tivo files that need the qsf with the filters for videoredo to process the files. I had tried using TVAP about a year ago hoping to automate the editing process for my media server but couldn't get it to work using the standard qsf. I just recently found a link to this thread talking about mods to the qsf script allowing it to do the filters. However, I can't figure out what needs to be changed and where in the script as I know nothing about scripting.

I know that I have about 5 different cable networks that I routinely need to do the filters with. Can the filters be set to select what resolution to use based on the channel name listed in the file name? (ex: FOODHD, DSCHD, SCIHD, HSTRYHD) I don't know what the syntax would need to be for the different resolutions. The main resolutions used for the various channels I have to use the filters on are 704x480, 1280x720, 1920x1080.
No problem.

--Make a copy of QSF.vbs in your TVAP install directory and save it in case.
--Edit QSF.vbs by right clicking and selecting "Edit". Or load it in any text editor of your choice.
-- Find these two lines:
percentComplete = 0.0
if NOT VideoReDo.FileSaveAsEx (Args(1), Args(2)) = 0 then
-- Insert these lines between the above two lines:
if instr(Args(0), "the foobar show") > 0 then
VideoReDo.SetFilterDimensions 704, 480
elseif instr(Args(0), "foobar with the stars") > 0 then
VideoReDo.SetFilterDimensions 352, 480
elseif instr(Args(0), "foobar tonight") > 0 then
VideoReDo.SetFilterDimensions 704, 480
end if
(You can copy and paste right from this post.)
-- spacing and indentation are not critical, just make it look good to you.
-- Edit the lines you inserted to customize them as follows:
1. Replace the strings in quotes by your channel strings, e.g., "FOODHD", note: this is case sensitive and spaces, if any, DO count between quotes.
2. Substitute your corresponding dimension numbers.
3. If you need more comparisons, just repeat the elseif structure as needed.
Save the file and run TVAP.

If you have trouble post or pm me an exact table of matching strings and corresponding dimensions and I will send you the correct file.

meowth

01-15-2010, 12:28 AM

[CODE]if instr(Args(0), "the foobar show") > 0 then
VideoReDo.SetFilterDimensions 704, 480
elseif instr(Args(0), "foobar with the stars") > 0 then
VideoReDo.SetFilterDimensions 352, 480
elseif instr(Args(0), "foobar tonight") > 0 then
VideoReDo.SetFilterDimensions 704, 480
.

if I read this right I would substitute:
1920, 1080
1280, 720
704, 480

for the 3 resolutions right?

dlfl

01-15-2010, 09:10 AM

if I read this right I would substitute:
1920, 1080
1280, 720
704, 480

for the 3 resolutions right?
For each if or elseif clause you have to use the dimensions that correspond to whatever match string (channel name) you put between quotes in that clause. You don't give enough information in your posts for me to do this for you. (You mention 5 cable networks, give 4 channel-name examples, then only mention 3 resolution pairs. No way for me to deduce how they match up.)

meowth

01-15-2010, 12:45 PM

For each if or elseif clause you have to use the dimensions that correspond to whatever match string (channel name) you put between quotes in that clause. You don't give enough information in your posts for me to do this for you. (You mention 5 cable networks, give 4 channel-name examples, then only mention 3 resolution pairs. No way for me to deduce how they match up.)

Sorry. That's what I get for posting tired. This is what I put in the qsf script for the channels I routinely find needing qsf. When I ran TDAP after that it now says it completed creating the qsf file then tries to run adscan but fails with file not found errors. It is not actually creating any qsf files as they normally take several minutes to create when run manually but says they complete through TVAP within 2 seconds. I don't know what I'm doing wrong.

percentComplete = 0.0
if instr(Args(0), "FOODHD") > 0 then
VideoReDo.SetFilterDimensions 1920, 1080
elseif instr(Args(0), "DSCHD") > 0 then
VideoReDo.SetFilterDimensions 1920, 1080
elseif instr(Args(0), "SPIKEP") > 0 then
VideoReDo.SetFilterDimensions 528, 480
if instr(Args(0), "SCIHD") > 0 then
VideoReDo.SetFilterDimensions 1920, 1080
elseif instr(Args(0), "HSTRYHD") > 0 then
VideoReDo.SetFilterDimensions 1280, 720
elseif instr(Args(0), "GOLFHD") > 0 then
VideoReDo.SetFilterDimensions 1920, 1080
if instr(Args(0), "TRUTVP") > 0 then
VideoReDo.SetFilterDimensions 704, 480
elseif instr(Args(0), "HGTVD") > 0 then
VideoReDo.SetFilterDimensions 1920, 1080
end if
if NOT VideoReDo.FileSaveAsEx (Args(1), Args(2)) = 0 then

dlfl

01-15-2010, 02:26 PM

Sorry. That's what I get for posting tired. This is what I put in the qsf script for the channels I routinely find needing qsf. When I ran TDAP after that it now says it completed creating the qsf file then tries to run adscan but fails with file not found errors. It is not actually creating any qsf files as they normally take several minutes to create when run manually but says they complete through TVAP within 2 seconds. I don't know what I'm doing wrong.

percentComplete = 0.0
if instr(Args(0), "FOODHD") > 0 then
VideoReDo.SetFilterDimensions 1920, 1080
elseif instr(Args(0), "DSCHD") > 0 then
VideoReDo.SetFilterDimensions 1920, 1080
elseif instr(Args(0), "SPIKEP") > 0 then
VideoReDo.SetFilterDimensions 528, 480
if instr(Args(0), "SCIHD") > 0 then
VideoReDo.SetFilterDimensions 1920, 1080
elseif instr(Args(0), "HSTRYHD") > 0 then
VideoReDo.SetFilterDimensions 1280, 720
elseif instr(Args(0), "GOLFHD") > 0 then
VideoReDo.SetFilterDimensions 1920, 1080
if instr(Args(0), "TRUTVP") > 0 then
VideoReDo.SetFilterDimensions 704, 480
elseif instr(Args(0), "HGTVD") > 0 then
VideoReDo.SetFilterDimensions 1920, 1080
end if
if NOT VideoReDo.FileSaveAsEx (Args(1), Args(2)) = 0 then
I see some syntax errors where "if" was used where "elseif" should be. Here is a corrected version:
if instr(Args(0), "FOODHD") > 0 then
VideoReDo.SetFilterDimensions 1920, 1080
elseif instr(Args(0), "DSCHD") > 0 then
VideoReDo.SetFilterDimensions 1920, 1080
elseif instr(Args(0), "SPIKEP") > 0 then
VideoReDo.SetFilterDimensions 528, 480
elseif instr(Args(0), "SCIHD") > 0 then
VideoReDo.SetFilterDimensions 1920, 1080
elseif instr(Args(0), "HSTRYHD") > 0 then
VideoReDo.SetFilterDimensions 1280, 720
elseif instr(Args(0), "GOLFHD") > 0 then
VideoReDo.SetFilterDimensions 1920, 1080
elseif instr(Args(0), "TRUTVP") > 0 then
VideoReDo.SetFilterDimensions 704, 480
elseif instr(Args(0), "HGTVD") > 0 then
VideoReDo.SetFilterDimensions 1920, 1080
end if
Is SPIKEP really supposed to be 528x480 ? (It's possible, just seems odd.)

meowth

01-16-2010, 05:00 AM

I see some syntax errors where "if" was used where "elseif" should be.

Is SPIKEP really supposed to be 528x480 ? (It's possible, just seems odd.)

Thanks. That fixed it. Seems to be working well now. And yes that is the resolution of the tivo files that were recorded off spike network. I took the dimensions from each tivo file according to what was listed in videoredo's filter box on the quickstream fix. Some of the files would have 2 resolutions to choose from but the ones from spike only had the one choice.

Anyway thanks again. This is an awesome little program that is going to make things so much easier. Be really nice to get up in the morning to find the videos already ad scanned and ready for manual cutting.

dlfl

01-22-2010, 04:25 PM

TVAP is ready to capitalize on the new TV Suite 4 !

TV Suite Ver. 4 and output profiles:

TVAP at startup will automatically determine from the registry if you have TVS4 installed.
If you don't have TVS4, the TVAP GUI features associated with TVS4 profiles will be disabled
but the program will run as before with earlier versions of VRD.

As always, if you have multiple versions of VRD installed, TVAP will run the COM functions
from the last version you ran in GUI mode. Thus if you want to use TVS4 features
(i.e., output profiles), be sure TVS4 was the one last run in GUI mode.

To use an output profile:
a. select "Profile" in the OutputType pull-down box.
b. Enter the profile name and the desired output file extension in the appropriate boxes
to the right.
The profile name MUST MATCH EXACTLY (including spaces and capitalization) the name of a
valid profile name (either built-in or created by you in the GUI version). Choose a file
extension appropriate for your profile. This extension will be used for the output file
whether it makes sense or not. (You can change it later in Windows Explorer if you goof.)

Hint: Profile definitions are maintained by TVS4 in file "outputProfiles.xml", which is
located in "C:\Documents and Settings\Administrator\My Documents\VideoReDo" on my XP machine.
A sure-fire way to get correct exact profile names is to bring this file up in a text
editor (usually right-click, select "edit" will do it) and select and copy the name from
the <name> element of the desired profile. (BE CAREFUL NOT to MODIFY this file!)

Eventually profile and extension setting will more automated, but this is pending VideoReDo
creating a new COM function to support that (and pending my writing the code to use it).

Note that if you use a two-step process (QSF then AdScan/Comskip) the intermediate file (QSF'ed one)
will always be a mpeg2 (.mpg) when you are in profile output mode. Also, if you just want to get
a transcoded output file, configure QSF only, with an appropriate profile.

If you have problems, revert to Version 0.76 and let me know the details.

Here's the **download link** (ftp://upload:upload@videoredo.net/VRD%20Add-Ons/TiVo-VideoReDo-AutoProcessor/)for your convenience.

tannebil

01-25-2010, 12:37 PM

dlfl

01-25-2010, 01:55 PM

I'm using 0.80 on Win7 HP 64-bit and VRD 4.20.2.594 to transcode into H.264.

How does TVAP decide that a Tivo transfer is complete? I'm having an unreleated problem with TTG where transfers interrupt every five minutes and resume 5 minutes later. TVAP started processing the Tivo file after first interruption even though TTG did not show the transfer as complete. Ignoring the interruption problem, is this going to be an issue whenever a transfer doesn't complete in a single session, e.g. the TIVO reboots, there's a network connection problem, the PC reboots, etc...?
Yes this is probably going to be a problem. TVAP monitors the file size and when it sees it hasn't increased for a certain time period (much less than 5 minutes) it assumes the transfer is done. I don't know any other way to determine when a transfer is completed.

You could try **TiVoPlaylist** (http://tivoplaylist.dyndns.org/) instead of TiVo Desktop for the transfers. Presumably one way or another you will get past this TTG problem, which certainly isn't normal behavior. Then TVAP will work correctly.

I might be able to mod TVAP so it waits 10 minutes to decide a transfer is complete but I doubt that would be desirable for most users, and I think the real solution is to fix your TTG problems. Are you already getting help on that in another thread?

Edit: I see you have another thread on the TTG problem and have tried TiVoPlaylist.

dlfl

01-25-2010, 11:01 PM

For TVS4 users, there is now an Output Profile pull-down selector that selects from the existing profiles. The profile selection also fills in a default output file extension (e.g. .mp4) appropriate for the selected profile, but you can edit the extension (e.g., if you need .m4v instead of .mp4).

TVAP reads the the profile information using new com functions just provided by VRD in TVS4 build 595 (Thanks to Dan203 and the other VRD developers). Thus you need to upgrade to that build before using TVAP 0.81. Operation with VRD Plus and VRD TVSuite 3 should be fine -- the profile functionality will be disabled for those VRD programs.

In view of the rapid changes with little testing, I've left two previous versions of TVAP on the download site:

0.76 is the pre-TVS4 version. Will not work correctly with TVS4.
0.80 is the first TVS4-compatible version with manually entered profile names

dlfl

01-27-2010, 08:52 PM

- Improved output file extension fill-ins when selecting output profiles.
- Now writes pyTiVo metadata file in output folder along with all profile-type output video files.

dlfl

02-03-2010, 03:07 PM

3 February 2010 Ver. 0.83
Fixed -- TVAPpostProcess did not run in some cases using output profiles ("_QSF" file naming issue)
Fixed -- TVAPcleanUp batch passed file name arg sometimes was wrong (another "_QSF" issue)
Added CL arg: "-metabtv" which causes an XML-formatted metadata file for use with Beyond TV
to be generated.
Improved tooltips and Activity message to indicate that QSF's for profile outputs will transcode per
the selected profile.
Improved parsing of call sign meta item from TiVo file name to handle different formatting used
by TiVoPlaylist.

tinytool

02-12-2010, 09:14 PM

Awesome program, Great job!!!

dlfl

02-17-2010, 09:50 PM

Minor fixes:

17 February 2010 Ver. 0.84
Fixed -- Profile selection disabled when no video file in transfer folder.
Fixed -- Obscure bug: If TVAP couldn't find TiVo transfer folder in registry and user shut down before setting it manually, would be unable to restart TVAP.

dlfl

02-19-2010, 09:05 PM

19 Feb 2010 Ver. 0.85

Major Change -- Program no longer writes files to runtime folder (in program files) but to %ALLUSERSPROFILE%\TVAP. (To see what this is on your pc, open a command window and type "echo %ALLUSERSPROFILE%\TVAP". It varies depending on what version of Windows you have.) Files affected are TivoFileManager.xml, TiVoVRDAutoProcessLog.txt, stopper.txt, and arglog.txt.
If upgrading to this version and you want to retain the file status database from a previous version of TVAP you need to copy the TiVoFileManager.xml file to the new data directory. Recommended procedure: (1) Start TVAP and get the message about needing to set folders etc., then (2) shut it down. This will create the data folder. Then (3) delete the new xml file just created in the data folder and copy the previous xml file (from the TVAP install folder in Program Files) to that folder and (4) restart TVAP. This change was made to allow TVAP to run in Vista and Win 7 without requiring "run as administrator" elevation (e.g., the UAC prompt).

Changed -- Until now TVAP would disable DVR-MS output if not running as administrator. Testing on Windows 7 and XP indicates this is no longer necessary. Thus DVR-MS output is now always enabled. This has not been tested on Vista so could be a problem. If so, a workaround is to set program and/or shortcut properties to force running as administrator.

Changed –- ComSkip commercial detection is now enabled for DVR-MS files. It still doesn’t work for me but it clearly is intended to work with DVR-MS files, so I leave it up to the user to try it out.

Another minor change: TVAP-ReadMe is now a PDF file.

dlfl

02-26-2010, 07:49 PM

Sorry for all the changes -- mostly related to Windows 7. I suspect the number of people who fully understand Win7 accounts and permissions is not much greater than the number who fully understand the U.S. Tax Code! I think I've got a good solution now so you don't need UAC elevation, and different logons (user accounts) can use TVAP without interference or other problems.

Major Change – TVAP data files have been moved to user-logon-specific folders defined by %APPDATA%\TVAP.

(Type echo %APPDATA%\TVAP at a command prompt to see where this is for your logon.)

The common location (%ALLUSERSPROFILE%\TVAP) was not working out on Windows 7 – too many file and folder permissions problems when switching between user logons as well as virtual folders being created all over the place. Now, if you run TVAP with a different logon for the first time, you are starting over. Also, you should NOT try to share the same TVAP folders (AdScan, QSF, etc) for different user logons. Note that both VideoReDo and TivoDesktop follow this same principle. Each different logon will have to be individually configured. Note that in Windows 7 if you use your administrative powers to copy data files (e.g., TiVoFileManager.xml) between data folders for different logons, you need to check the file permissions of the destination file and ensure it has full control for the logon that will use that data folder.

For Windows 7 the data folder (%APPDATA%\TVAP) is:
C:\Users\<User account name>\AppData\Roaming\TVAP. This folder will not exist until TVAP is run the first time on a user logon.

Changed – Added code to enable TVAP to determine the VideoReDo installation folder and which VRD program is installed for users who do not have administrator privileges.

Fixed – “Run VideoReDo” button failed with error message for VRD TVSuite 4 Build 596 or later because VRD changed the name of the executable file.

Fixed – If TVAP is unable to read the Profiles when running TVS4, a descriptive error message is displayed suggesting running VRD once as administrator (rather than just crashing) – this is a COM function issue.

Burger23

02-26-2010, 11:35 PM

A picture is worth a 100 words!
9:12:46 Input started
9:12:50 QSF complete

Obviously this is not possible that fast- D:\TEMP QSF\ does not have anything in it

http://www.gradygroup.com/tvap.jpg

Any ideas?
Thanks

dlfl

02-27-2010, 06:30 AM

Burger23,

First can you provide some details about your setup:

Operating System
Version of VideoReDo (Based on your screen shot it would NOT be TVSuite 4.)
What type of drives are the folders you're using? Obviously the AdScan folder is a network drive.

Has anything recently changed about your setup other than installing TVAP 0.85 ?

Two things stand out from your screen shot:
1. You are transferring a lot of files. This should not be a problem. What is the transfer agent? TiVoDesktop? TiVoPlaylist? Or by chance are you copying these in from another folder?

2. This one is very suspicious: Within a second or two of starting a VRD COM function (such as QSF) there is always a log message giving the version of VRD being invoked -- and this is not in your log display. This strongly suggests a problem of TVAP not being able to access the COM objects. This is a known issue with Windows 7 at least and the usual fix is to run VRD one time with "Run as administrator" set. (In Win7, Right click the VRD shortcut and select "Run as administrator". Not sure about Vista as I never had it. In XP, right click shortcut, select "Run as..." and uncheck the "protect.." checkbox.). If you are actually running TV Suite 4, this COM problem is definitely the issue, since that explains why the Profile pull-down selector did not populate.

Try opening the file in question manually in VRD and doing a QSF with the same input and output folders - just to verify there is no problem with the file or your VRD installation.

I strongly recommend installing TVAP 0.86 before further testing.

Burger23

02-27-2010, 12:15 PM

Thanks for your prompt reply.
OK- I am running Windows 7 64-bit with TiVo Desktop 2.8 with Video-Re-Do Plus. I also tried TVAP on a Windows 7 32-bit machine. And I have tried TVAP versions .76, .85, and .86.

I have tried with several different shows- I have moved shows to different computers. All shows I tried played fine as .tivo with Windows Media Player.

I have been using TVAP for a couple years with great results. This all started with a clean install on my primary computer (Windows 64 bit). As mentioned above, I also switched to my laptop (Windows 7 32-bit) after copying the show to a local laptop directory.

In all cases TVAP reports that QSF processing has completed in less than 1 second.

Any other suggestions for troubleshooting- this is very odd :-)

Burger23

02-27-2010, 01:07 PM

I forgot to mention that I always open TVAP using Run as Administrator

dlfl

02-27-2010, 07:00 PM

Have you run VRD as administrator at least one time after installing a new version of it? That's a fix for what I think is your problem, which is the VRD COM object VideoReDoSilent is not registered where it should be in the Windows Registry.

My primary development computer now is a Win 7 64 bit and I also have two Win XP Pro computers. However, I'm no longer running VRD Plus on any of them, which could be a complication in debugging this case.

For testing I have a non-admin logon account on my Win 7 machine and I can run TVAP successfully from that account without using Run as admininistrator and no UAC prompts.

Burger23

02-28-2010, 12:04 AM

That's exactly what the problem was! Thankls you.

Since I never actively use VRD, I never had cause to Run as Administrator.

Now I have anoher issue with commercial editing- At the end of QSF processing, or perhaps at the very begginning of the Comskip processing, I get the error message as shown below. The processing continues for another 30 seconds- then says it is complete- obviously not enough time has gone by. And no file is created in \\SERVER\Movies. Also, do I have my settings correct? I just want TVAP to handle processing of .tivo to .dvr-ms with QSF, then use Comskip to cut out commercials, and finally to place the edited dvr-ms to \\SERVER\Movies.

We're getting there

http://www.gradygroup.com/1111.jpg

dlfl

02-28-2010, 12:29 AM

You're using a really old version of VRD Plus. Why not download the latest version? It looks like it just doesn't want to load the .TiVo file -- the error message is coming from VRD, not TVAP.

Can you load that file manually into VRD and QSF it to DVR-MS ? I mean without running VRD as administrator?

Even Dan203 doesn't remember the details now, but there was a time (probably the version you're using) when you had to have Admin privileges on Vista to process DVR-MS files. I think that would translate to requiring run-as-admin in Win7. You could try running TVAP with run-as-admin but even then I'm not sure it launches the VRD COM functions with run-as-admin in Win7. I don't know if it could be coded to do that but it isn't necessary with any recent version of VRD.

Burger23

02-28-2010, 02:15 AM

Wow- you were right. I was using a really old version- 2007! It is the version listed on their main web page. I went into betas and dowmloaded a very current version.

A show is procesed fine from tivo to dvr-ms with QSF and placed into D:\TEMP QSF folder. Comskip starts- but it completes in under a minute-this is not possible. Furthermore the log reports that the completed file is written to \\SERVER\Movies- this is not happening- there are no new files in the folder.

http://www.gradygroup.com/1112.jpg

dlfl

02-28-2010, 02:38 AM

I've never used DVR-MS much. However I've been testing tonight with DVR-MS outputs selected and I find that the first two .TiVo files I tested with QSF followed by ComSkip cause ComSkip to hang up. Doing the same thing but using VRD AdScan works OK. I'm using the default comskip.ini file and don't know much about tuning ComSkip -- maybe there's some parameter change that would make it work(?).

I've verified that these ComSkip hangs have nothing to do with TVAP by running ComSkip stand-alone on the same QSF'ed .dvr-ms files. The same hangups occur. On these two files, ComSkip runs a good long while then during one of its processes it gets up to 64% or 93% then just hangs. I have to close the ComSkip command window and no .vprj file is produced.

Also, if you QSF to .mpg then apply ComSkip these same files do OK. There seems to be something about VRD's DVR-MS output that causes a problem with ComSkip. I'm running TVSuite 4, Build 596.

Burger23

02-28-2010, 10:50 AM

Thanks for the prompt reply. I also have successfully previously used just Adscan to cut commercials. But I wanted to try out Comskip. And I also occassionally got Comskip to sucesfully complete and successfully place the completed adcut show in the proper directory- but only 1 show. Then Comskip hangs.

I use dvr-ms because my whole HT (music, videos, blu-ray, pictures,TV, etc) is built around Windows Media Center. WMC currently uses the .wtv to format its TV shows- previous versions used dvr-ms externsions. DVRMST (http://babgvant.com/Wiki/view.aspx/DVRMSToolbox) is a wonderful program that among other things, uses either ShowAnalyzer or Comskip to automatically edit out commercials. But the commercial removal program can only process dvr-ms files.

I use TiVo because 1)I had it before I got my media center hooked up; and 2)the TiVo has my cablecard which I need for cable shows. The the announced 2nd or 3rd quarter release of cablecard ready tuners by by HD Homerun and Ceton which coincides with my 3-year renewal of TiVo subscription, I will switch to the new HD Homerun box and eliminate the TiVo, and its monthly/annual fees.

But in the meantime I will return to Adscan (not Comskip) now that I know that I am not the only one having issues. Thanks again for you help.

dlfl

03-02-2010, 04:35 PM

dlfl

03-02-2010, 04:37 PM

Changelog 2 Mar 2010 Ver. 0.87
Major Change – Process flow and folder uses have been changed substantially. There is a single output folder where all final outputs of any process flow are saved. There is a temp(QSF) folder that is used only for temporary QSF'ed files (when the process flow is QSF followed by AdScan). All folders must be distinct now – no two folders can be the same. See the Process Flow and Folders section [of TVAP-Readme.pdf] above for details. When the process is QSF followed by AdScan, the (temporary) QSF file is saved in the Temp(QSF) folder and will be deleted when processing is done, provided Delete QSF is checked.
Major Change – When the process flow is QSF followed by AdScan, the (temporary) QSF'ed file is saved in .mpg format. This has the advantage increasing ComSkip usability – if the QSF'ed file was DVRMS format, ComSkip frequently failed. Also, no temporary or final output files have “_QSF” added to their names.
Change – User Post-process files are run (if checked) for all output types now.
Fixed – For DVRMS outputs, the metadata was not being inserted in the output file for some process flows.
Fixed – The user postprocess and clean-up batch files were being called twice for some process flows.

DISCUSSION OF CHANGES:
For upgrading TVAP users, your current XML data file will be fine but what you used to call the QSF Destination folder will now be the Temp (QSF) folder, and what you used to call the Ad Scan Destination folder will be the (final) Output Folder.

However you may have to make some changes, for example:
1. If you had two folders that were the same, they will have to be set to different locations. And all folders must be set except the TiVo Destination.
2. If you use a process flow where all you do is QSF, the output file will now be saved to the Output Folder (the one that used to be called the Ad Scan folder). And of course the location of your post-process script will have to change accordingly.
3. Post-Process and Clean-up scripts may have to change because TVAP now produces NO output files with "_QSF" in their names! (That's a good thing, right?)

Notes to Windows 7 users:
1. Whenever you install a new version of VideoReDo , it is strongly recommended you run it once as administrator (Right-click shortcut and select “Run as administartor”) before starting TVAP.

2. After TVAP inserts metadata into a final DVRMS output file, the file may be unavailable to other programs for up to 5 minutes. If you are doing postprocessing or cleanup involving the output file your batch file should take this into account, e.g.,, with a wait statement. I have no idea what's going on here and it only seems to happen on Win 7. I spent some time on it but didn't see what causes it -- so we have to live with it for now, at least.

Burger23

03-02-2010, 04:57 PM

drv-ms is checked- but looks like a mpg is being created

dlfl

03-02-2010, 05:38 PM

You have Do QSF and Do Adscan both checked, correct?

The QSF will produce a .mpg file in the Temp (QSF) folder. Then the AdScan output will produce a DVRMS in the Output folder.

dlfl

03-02-2010, 06:37 PM

You have Do QSF and Do Adscan both checked, correct?

The QSF will produce a .mpg file in the Temp (QSF) folder. Then the AdScan output will produce a DVRMS in the Output folder.
I decided to make my laptop XP machine a test bed for VRD Plus (for now), so I uninstalled all VRD versions then installed the latest Beta Build 596 of VRD Plus. I discovered the "Run VideoReDo" button would not launch VRD and found the reason was that somewhere along the line VRD changed the executable's file name from "videoReDo.exe" to "VRDPlus3.exe".

I modified TVAP to handle either executable name and with the modified version the QSF+ComSkip-AdScan process without autocuts ran just fine.
Will put the modified TVAP up for download ASAP.

dlfl

03-02-2010, 06:52 PM

2 Mar 2010 Ver. 0.88
Fixed – “Run VideoReDo” button did not work with VRD Plus Beta Build 596 because the VRD Plus executable file name had been changed from “VideoReDo.exe” to “VRDPlus3.exe”.

Unless you're using late VRD Plus betas, you probably don't need this fix.

philhu

03-09-2010, 09:18 AM

Hi

How about two things:

You have post processing. Can you add preprocessing?

The reason I ask is I use mfs_ftp to download from the Tivo. It is much faster but creates .ty or .ty+ files, not .tivo

I want to run a preprocess to use s3tots to cvt these to .mpg files, which would then be used to go thru VRD4 to make MP4 files.

Or better, preprocessing *AND* ty/ty+ support. All you would need to do is run s3tots as a first step outputting a mpg for the rest of the processing.

dlfl

03-09-2010, 12:40 PM

dlfl

03-10-2010, 09:16 AM

10 Mar 2010 Ver. 0.89
Fixed – BTV metadata dates were incorrect.
Fixed – Unnecessary updates to input video file list during file transfers caused scrolling that interfered with operator use of the list.

I've left Ver. 0.88 on the download site in case.......

dlfl

03-10-2010, 08:32 PM

10 March 2010 Ver. 0.90
Added – Default configuration option to insert metadata in .mp4 and .m4v output files, using AtomicParsley. Checkbox is enabled only if running TVSuite 4. AtomicParsley.exe is installed with TVAP. It is run before any postprocess or cleanup batch files.

Thanks are due the Source Forge AtomicParsley project (http://atomicparsley.sourceforge.net/)for this capability.

Due to two TVAP updates in one day, the previous two versions of the program have been left on the download site, just in case.....

msmart

03-11-2010, 12:00 AM

dlfl

03-12-2010, 04:42 PM

Hey dl, speaking of AtomicParsley.... now that I'm using it, I've noticed that the episodeNumber for the show Psych is consistently wrong. I'm sure it's TiVo's fault, but what I'm noticing that it's always short one episode.

Example, the 3/3 episode is the 15th episode of season 4 but the metadata file shows it as 4014. It should be 4015. What I have to do is edit the metadata file before the post process batch runs to make it 415.

Has anyone else noticed that the episode number is off by one?

Also, because there is a leading zero in the episode, Atomic Parsley makes it season 40 but I know there probably isn't anything you can do about this.
Yeah, don't think there's much that can be done about these issues, unless you wanted to adopt a rule that season numbers can never be greater than some maximum. I'm not sure what a safe number would be, however. I wonder if 9 would be worth using, recognizing there are definitely series that are past 9 seasons -- but are there any that TVAP users care about ? (The only ones that come to mind are soap operas, Wheel of Fortune and Jeopardy. I think one or two popular series may have gone more than 9 seasons, but it's getting pretty rare.)

I think you're discussing pyTiVoParsely rather than TVAP, but the conversions are identical.

garrubal

04-02-2010, 07:21 PM

Is there any way to automate or semi-automate doing this the following?

- Transfer shows from Tivo to PC using Tivo Desktop Plus (I think the feature is alredy built in

- Remove commercials using VideoReDo automatically (it looks like this program TVAP does that).

- Return the edited program back from PC to Tivo using Tivo Desktop Plus automatically.

Is there a way to do this? Looking at Tivo desktop plus, I think there is an option to place a file in a folder to automatically move back to the Tivo.

dlfl

04-02-2010, 07:54 PM

- Transfer shows from Tivo to PC using Tivo Desktop Plus (I think the feature is alredy built in
You don't need the Plus version for this. Also I think free program TiVoPlaylist offers more flexibility.

- Remove commercials using VideoReDo automatically (it looks like this program TVAP does that).
TVAP runs VideoReDo or ComSkip to do this but usually neither method is perfect. TVAP has a mode where it runs the detection program then puts processing of that particular video on hold until you manually review and adjust the cuts in VideoReDo.

- Return the edited program back from PC to Tivo using Tivo Desktop Plus automatically.

Again the plus version isn't needed. Either TivoDeskTop or pyTivo can be used to let you "pull" programs from the TiVo user interface. pyTiVo also lets you "push" videos back.

You may also want to checkout kmttg which can auto-transfer from the TiVo to your PC, and automate commerical removal, editing and processing, similar to TVAP. kmttg will also "auto push" videos back to the TiVo, working in conjunction with pyTiVo.

With either TVAP+VideoReDo or kmttg you can re-encode your videos to MPEG-4 (2X or 3X smaller for same video quality) and they can be pushed back with pyTiVo or streamed back with StreamBaby.

As you may be guessing by now there are a lot of good options and I haven't even mentioned some of the ifs, ands or buts concerning metadata.

Since I'm a TVAP user, my approach would be TiVoPlaylist, TVAP (and VideoReDo), and pyTiVo. I also encode to MPEG-4 and stream back using StreamBaby.

You might want to consider starting a thread here giving the most precise definition possible of your requirements and your PC and TiVo equipment info. Then users with other preferred approaches could give their suggestions. (I'd prefer to keep this thread on topic, i.e., TVAP.)

If you decide to use TVAP I and other TVAP users will be happy to help you in this thread.

dlfl

04-07-2010, 03:59 PM

7 April 2010 Ver. 0.91
Added: Automatic application of dimension filters during QSF based on configuration file “VRDDimensionFilters.txt” located in the user's TVAP data folder (%APPDATA%\TVAP). Each line in this text file must contain three items, formatted as follows:
<match string> :: <filter width> :: <filter height>
Examples:
Tonight Show :: 1920 :: 1080
WDTNDT :: 1280 :: 720

If the video name contains the match string, the corresponding dimensions will be applied.

Syntax rules:

Matches are NOT case sensitive.
The double-colon delimiters “::” MUST be used to separate the three items.
Quotes are not needed, and should not be used, on the match string (unless they are part of the string).
Spaces before or after each item are ignored. (The spaces on each side of the double-colon delimiters in the examples are just for a neat look.)
If a line is improperly formatted it is ignored. The TVAP log gives messages indicating whether a filter was used during QSF of a file, and the dimensions used.
The first match found will be used. Thus if you have two match strings like “WDTNDT” and “WDTNDT2”, place the line with the longer match string higher in the file list.

If the dimensions file doesn't exist filtering is not done but operation is otherwise normal.

The dimensions file is read at the start of each QSF operation -- Thus you can modify it and changes will be in effect without restarting TVAP.

Note: If the file being processed has NO scenes with the filter dimensions you specify, VideoReDo will pop up a message box, which you must click. This obviously halts automatic processing until you click it.

dlfl

05-31-2010, 11:15 PM

31 May 2010 Ver. 0.92
Added: Saves current configuration and file processing status if ended due to system shutdown or restart, and adds log entry: “Program ended because of system shutdown or restart”.

This should prevent having to manually stop processing on restart for XP and should prevent repeating past VRD processing for Win7 systems after restart.

bigfella

07-22-2010, 07:30 PM

dlfl

07-22-2010, 09:14 PM

Can any one help me.
I have a couple of programs that are remaining in the top list, saying they are transferring.
They are not in the original TIVO folder and I can not get rid of them.
I have tried deleting the log files for TVAP but this didn't work

Any help would be appreciated.
Thanks Matt
There are two ways to fix this, both of which involve the TVAP XML data file, which is named TiVoFileManager.xml and is located in the TVAP data folder: %APPDATA%\TVAP (Type echo %APPDATA%\TVAP at a command prompt to see where this is for your logon.) Either method requires you shutdown TVAP.

1. Delete the XML file. This will mean you have to reconfigure TVAP just as in an initial installation, and will lose file status of all video files.

2. Edit out the sections in the XML file corresponding to the problem videos. Each video file has a section that starts with <TivoFileData> and ends with </TivoFileData>. The file name is the first element in the section.

I'm curious how this happened. If it continues to happen, try to figure out what action may have caused it and let me know.