TiVo Community Forum banner
  • TiVoCommunity.com Ambassador Program Now Open! >>> Click Here

Metagenerator 3 -- Support & Downloads

85K views 1K replies 49 participants last post by  dlfl 
#1 · (Edited)
Support and download links for Metagenerator 3 (MG3) are now transferred from the pyTivo forum to this thread, starting with the release of MG3 Ver. 3.83

Metagenerator looks up metadata for TV Shows and Movies, including Rovi-style programId and seriesId. It creates pyTivo .txt metadata output files but also can insert metadata into .mp4 and .wtv files. It can create output folders, and rename output files, based on metadata. It has automatic and semi-automatic modes. There is no user guide for MG3 but a complete cumulative change log is included in each version distribution. Searching this log and/or posting questions on this forum are the two best ways to get help.

Metagenerator was originally programmed by Master Cephus and has been enhanced and supported by me starting in 2011.

NOTE REGARDING ANTI-VIRUS:
Norton AV and Windows Defender have flagged some distributed MG3 files but these are believed to be false alarms. Just configure an AV exception for the MG3 runtime folder.

Change Log: The change log is included in the distribution zip. Only the most important changes for a few of the latest versions will be given in this post:

All versions starting with Ver. 4.01 (25 October 2021)
Enhanced: RPC searches for programId and seriesId now require no support
files or installations
. A domainToken (cookie) is required, see "domainToken.txt"
which is attached and included in the distribution zip.
Ver. 4.04 (20 July 2022)
Enhanced: Can fetch domain token needed for RPC searches directly from Tivo.com or from KMTTG config file.
Ver. 4.14 (1 February 2024)
Fixed: In Autoprocess Series TV, Show Unmatched files showed some matched files.
Enhanced: In metadata-based folder/file rename, checked if source file was locked
by another process, tried for ten seconds before announcing error.


CL option "-runDirConfig" puts configuraton files in "Config" subfolder of runtime (installation) folder.

Known movie programId's are added to the database when movie metadata is saved to a pyTivo .txt metadata file either individually or during movie autoprocessing. See post #265 of this thread for more info on the movie programId database:
Metagenerator 3 -- Support & Downloads

Use of the {resolution} tag is optional and requires mediaInfo.dll in the installation (run time) folder.
Download here: MediaInfo.zip
See discussion in this pyTiiVo forum thread from July 18-21, 2011 for details on this and the optional filenamer.VBS file:
pyTivo Discussion Forum :: View topic - MetaGenerator Version 3

You can download the latest version of MG3, 4.14 in the zip file. Found via this one-drive link:
Metagenerator414.zip

There is no installer. Just extract the files to any folder and create a shortcut to MetaGenerator Version 3.exe.
NOTE: To avoid weird Windows file permission issues it is recommended that you do NOT put MG3 into a folder under the "Program files" or "Program Files (x86)" folders, and that you follow the procedure given in Post #125 of this thread for unzipping the downloaded distro:
Metagenerator 3 -- Support & Downloads
 

Attachments

See less See more
#771 · (Edited)
I would like to go in this direction. I'm hoping you are offering to create that node server, since I am a long way from knowing how to do it.

I'm curious: is the GetDomainToken function in the Git repo working or still under development?
Much to my surprise I've managed to create a node server that seems to work for this purpose. I've made the required mods to the rpcSearch python file and I'm testing MG3. Initial results look good.

The certificate that expires is no longer needed, but the "domainToken", which is a currently valid cookie for online.tivo.com, is required. It is easily obtained from the MS edge browser. Assuming testing continues to be successful, some work will be required to create distribution packages and facilitate entering the domainToken cookie. The python code is ported to Python ver. 3.9 so either that version will have to be installed, or a new version of the python executable will be an option. The node server has to be distributed. I will look into the practicality of creating a stand-alone .exe for that too, for those who don't want to install node.js and the required express package. Hopefully, MG3 will be able to launch the server on startup and terminate it upon shutdown.

Hopefully, having the node server automatically obtain/refresh the domainToken cookie can be incorporated, assuming @lart2150 has perfected that code.
 
#894 ·
I found an easier way to refresh my domain token. If you are also using kmttg just go into its config.ini file using Windows wordpad(write) and scroll down until you come across its domain token - highlight and copy then paste same into MetaGenerator. Its also very easy to refresh the domain token using kmttg under file>cofigure>Tivos>chose "Refresh Token". Beats the pain of logging in to tivo online nonsense.
 
#958 ·
Version 4.07 released (see download link in first thread post).
RPC (seriesId, programId) functionality restored. The TiVo URL for RPC calls had changed.

Heavy thanks are due to @lart2150 for diagnosing this problem!
 
#95 ·
I had a conversation with @moyekj about the security issue. He is the programmer of kmttg and provided the framework of Python code that MG3 uses for RPC searches. I quote his response:
The program communicates with TiVo servers the same way a TiVo or iOS/Android apps do, so it's as secure as them. The only unsafe part is the username and password are specified in plain text as part of MG3 program/installation [actually during configuration -- dlfl], but then that would mean a hacker has penetrated your router firewall and you have a lot more to worry about than your TiVo username/password.
This is what I suspected so I don't think there is much danger particular to MG3.
 
#191 · (Edited)
Test distro Ver. 3.86T7 in attached zip [EDIT: Removed - superseded]addresses everything discussed in previous post #190. Thanks for the testing. The code changes to prevent the current file being processed when processing was canceled were more complex than you may have imagined. That led to the two crash bugs reported. There could be more. :oops:
 
#443 ·
The search API is really screwed up now. According to the documentation the calls and functionality of V3 are identical to V2. However a lot of data is missing, e.g., a series name and ID will be returned but when you try to retrieve data for the series using that ID a null document is returned. This should be impossible so the error isn't handled in MG3. If you get a crash when you select a series to get episodes, that is what caused it.

At the moment the interactive website search isn't responding to searches at all so, for example, I can't check to see if ID's found via the API match those in the web page..

I'm not going to address MG3 search issues until they get this thing settled down. I already wasted hours on the authorization problem which eventually went away with no changes needed in MG3 code.
 
#444 ·
The search API is really screwed up now. ... If you get a crash when you select a series to get episodes, that is what caused it.
...
I'm not going to address MG3 search issues until they get this thing settled down. I already wasted hours on the authorization problem which eventually went away with no changes needed in MG3 code.
Thanks for the update. Yep, that's what I'm seeing now. I get search results for the series title, but it crashes when I try to retrieve episode info. Will wait it out.
 
#542 ·
Ver. 3.90 released. See first post for downloads and changes. This version is almost functionally identical to test distro 3.90C9 but includes a couple of improvements in handling unexpected errors in theTVDB results.
 
#651 · (Edited)
Try test distro 3.93T1 in attached zip
EDIT: Attachment removed. Superseded by more recent test distro.

Ver. 3.93T1
Enhanced:
Added button to display all unmatched files in automatch processing

If you browse to match a file to one of the unmatched episodes, that file will be removed from the list displayed the next time you hit the button to display unmatched files.
 
#658 ·
Try test distro Ver. 3.93T3 in attached zip.

Ver. 3.93T3
Fixed: In auto-export by season folders, files in some folders were ignored
Fixed: Season 0 was ignored in auto-export when doing S/E matching
 

Attachments

#659 ·
Testing 3.93T3

Quick round of testing says you fixed my issues. Let me test a bit more (probably tomorrow ... other commitments today) and we can release.

Here are updated versions of files for the distro ...
 

Attachments

#721 ·
Ver. 3.95 released. See first post for download link.

Ver. 3.95 (29 April 2021)
Enhanced: Right-click menus for Series and Movies in search result lists give Overview, Database Web Page and IMDB web page.
Enhanced: In TV Series season/episode tree, right-click menus at season and episode items give Database Web page and IMDB web page,
for either database selection.
Fixed: Left click in TV Show search list box beneath listed items caused crash.

"Database" in above change notes refers to either TVDB or TMDb as selected.
Showing the Database or IMDB web pages requires a default browser to have been defined. A descriptive error message should pop up if you attempt to show a web page without having defined the default browser.
 
#722 ·
Ver. 3.95 released.
Not sure if its 3.95, but getting programID times out now, says check login credentials in the RPC error. Tried getting Ghostbusters movie from 1984 and with The Simpsons getting a timeout even on a deep search. Login to online.tivo.com/start working with same credentials.

The I remember, you cant have rpcSearch128.py if you need rpcSearch128.exe for the search to work - but even when I use rpcSearch128.exe alone with rpcSearch128.py not present its still not working.

rpcSearch128.exe seems to run, but still getting credential errors...

When using rpcSearch128.exe from the command line as follows:

rpcSearch128.exe "ghostbusters" "tivoemaillogin@login.com" "Password123" "streamingMovies" "1984" "" "" ""

credential error

Help? Any chance the rpcSearch128.py was ever ported to python3 so i could test that? will try on an 2.x box.
 
#745 ·
No worries @dlfl! I thought it was worth asking.

As I think I mentioned earlier, I've switched to downloading content from my TiVos and playing it back on JRiver Media Center, which doesn't require an external metadata file.

I've stopped downloading metadata files with kmttg and pyTivo, since I no longer need them to pull back to my TiVos.

I'm sorry to see the functionality broken, because I'm sure people would still still like to use it.

That being said ... I still use MG3 multiple time daily to look up shows and movies and rename them.
 
#805 · (Edited)
EDIT: Disregard, and attachment removed: Any RPC-enabled testing should use the files provided by post #808 of this thread.

Urgent Update:


If you're using the test version that does RPC searches with the node server, I discovered a bug in the rpcSearch130.py (and .exe) files that prevents some of the results. Rather than a complete new MG3 distribution, I'm providing corrected versions. The .py file is in the attached zip. The .exe file can be downloaded from this link:
rpcSearch130a.zip

The new files have the same names, rpcSearch130.py (and .exe), as the ones they are replacing, so be careful to keep track of them.

And just a reminder: After downloading a .zip file, bring up properties and unblock it before extracting the files. Also when you place the revised files in the MG3 runtime folder, it is safest to move the ones being replaced to a different location first.

Just a tidbit of good news: I am creating a C# executable that will replace the node server, so you don't require a node.js installation. Just got it running so some hours of testing and refinement before distributing it. The MG3 executable will be able to run with either server version and if you have both, the c# version will be the default but a command line option will allow you to force use of the node server. Initial tests indicate the node version is faster, 14 secs vs. 22 secs for one specific search.

Ultimately there is no reason the python program can't be replaced with c# code, but that will be a major porting job, maybe in the future.
 
#830 ·
Version 4.01 has been released. See first post to download attached distribution zip, or instructions for getting the domainToken cookie needed for RPC searches.

This release requires no additional files or installations to perform RPC searches. The option of using nodeJs and python programs for this is preserved (see the Mind RPC settings) and instructions for the various configurations needed for this option are included in the attached RPCsupportFilesInstructions.txt file.
 

Attachments

#831 ·
Congratulations and a big thanks. I just happen to come here tonight, thought I might have a lot of reading to do ( haven't been to the site in some time - lo and behold a completed 4.01 ) Wow. It works great. And just last night I was using t


Congratulations and a big thanks. I just happen to come here tonight, thought I might have a lot of reading to do ( haven't been to the site in some time - lo and behold a completed 4.01 ) Wow. It works great. And just last night I was using the labor intensive kmttg work around for all my Sunday shows, lol. if I had waited a day haha

Seriously though - thank you again for what must have been such hard work for this needed program . I mean to restore it to full functionally - it is so great you are the king!
 
#877 ·
Checking in after a few months away!

@dlfl Great work on getting the RPC functionality working again!

I’ve tested and everything is working great!

A couple of documentation improvement suggestions:
  • The Change Log included with MG3 download only goes through 3.96
  • The “DomainToken.txt” file should be updated to include the Firefox instructions that @Soapm provided
As mentioned earlier, I’m no longer creating metadata files for shows I download from my TiVos. I use JRiver Media Center on a HTPC to watch my shows. I also primarily use TMDB as my database for my TV and Movie content.

That being said, I will be happy to test and assist anyone who needs help with MG3 and programIds.
 
#879 ·
..............................
The Change Log included with MG3 download only goes through 3.96
............................
I can't verify this. I downloaded Ver. 4.03 from OneDrive as a test and the log goes up to 4.03.

Is anyone else seeing this?
 
#911 ·
Thanks to @lart2150 mg3 can now fetch RPC Domain Token Cookies directly.

Try test ver. 4.04T5 from this OneDrive link:

You now have to enter your TiVo user name (email) and password on the Mind RPC setup panel. Messages for invalid user name and password will pop up. If the direct fetch fails it will still try getting it from the KMTTG config file as in the previous test version. Or you can still get it via a browser and enter it manually.

@lart2150 I'm not sure what conditions the MIT license imposes on this project. The program and my support are free to everyone. I was on the verge of trying to port your Java code to C#. I'm sure you saved me hours and hours of work!
I already was using NewtonSoft.JSON in mg3 BTW.
 
#912 ·
@lart2150 I'm not sure what conditions the MIT license imposes on this project. The program and my support are free to everyone. I was on the verge of trying to port your Java code to C#. I'm sure you saved me hours and hours of work!
MIT is very flexible and can be used for almost any project (closed source or most open source projects). KMTTG on the other hand is gpl v2 would require metagenerator to have a gpl v2 compatible license.
 
#5 ·
Frankly never figured out exactly what the problem was but finally got a version of rpcSearch126.zip up on mediafire.com that doesn't show the "virus" problem and have edited the link in the first post. Whatever it was did not involve any changes in the rpcSearch126.py code or the method used to generate the .exe and .zip files. Rather it appeared to be related to Win10 folders and permissions.

I didn't catch the virus warning icon on mediatfilre.com (file view, which only I can see) because (1) it's very small and (2) I've never encountered this problem before. I (and 18 other people) downloaded the original rpcsearch126.zip and neither .zip nor .exe showed any virus detections on my PC, using Sophos Home AV. And MG3 ran fine with the downloaded file. So I'm guessing the issue was some quirky interaction between the Win10 file system and mediafire.com.
 
#62 ·
Ver. 3.84 has been released. See first post for changes and downloads.

The MG3 distribution zip is now attached to the first post rather than downloaded from MediaFire.com.
An updated distroSeriesId.txt list is included, courtesy of @elprice7345 and thanks also to him for testing and many suggested fixes and improvements, and for reverse-sorting the change log to non-chronological order.
 
Top