Metagenerator 3 -- Support & Downloads

Discussion in 'TiVo Home Media Features & TiVoToGo' started by dlfl, Jun 7, 2018.

  1. Sparky1234

    Sparky1234 Well-Known Member

    2,192
    315
    May 8, 2006
    MG3 is faster after first search. I did several searches and MG3 is faster after that initial search or 2.
     
  2. dlfl

    dlfl Cranky old novice

    8,746
    631
    Jul 6, 2006
    Dayton OH
    That should be doable.
    Every example you give above displays the desired title in first place. 'fbi' also returns 'FBI' on top. The similarity algorithm is case-insensitive.

    Will provide a test distro after I get the English language filter going.
     
  3. dlfl

    dlfl Cranky old novice

    8,746
    631
    Jul 6, 2006
    Dayton OH
    Try test distro 3.90T1 in attached zip.
    EDIT: Attachment removed -- superseded by release ver. 3.90
    This has the similarity sort for series search result display. There is no limit on the number of series displayed, although (strangely) it appears no more than 22 are ever returned.

    Try searching with just a couple of key words for longer titles, e.g.:
    adam ruins (or) adam everything (for adam ruins everything)
    orange black (or) orange new (for orange is the new black)
    how mother (or) how met (for how I met your mother)

    I haven't implemented the language filter as I actually couldn't figure out how to do that. However, I'm seeing very few series that appear to be foreign language. (??)
     
    Last edited: Jan 17, 2020 at 12:08 PM
  4. MHunter1

    MHunter1 TiVo Bug Hunter

    378
    21
    Oct 11, 2007
    Silicon Valley
    I'm still getting the TVDB search error. Even with MG3 v3.8.9.0 it says "Search error: Web error getting token" no matter how I format or punctuate the title.
     
  5. dlfl

    dlfl Cranky old novice

    8,746
    631
    Jul 6, 2006
    Dayton OH
    That message indicates a theTVDB.com server problem. I just tried and it was OK. Keep trying.
     
  6. Sparky1234

    Sparky1234 Well-Known Member

    2,192
    315
    May 8, 2006
    Worked ok last night for me.
     
  7. MHunter1

    MHunter1 TiVo Bug Hunter

    378
    21
    Oct 11, 2007
    Silicon Valley
    I am able to get some TVDB results for the first time tonight but I'm seeing the 22-line limit and some database bugs such as The Mandalorian having a duplicate entry that returns an error.
     
  8. dlfl

    dlfl Cranky old novice

    8,746
    631
    Jul 6, 2006
    Dayton OH
    Are you using test distro version 3.90T1 (attached to post #463)? With the series search list sorted by similarity to the search term(s) you should see your desired series at or near the top of the list, assuming your search terms are halfway reasonable. Thus 22 results should be more than enough. BTW, this 22 limit is built into the TVDB API -- no way for MG3 to change it AFAIK.
     
  9. elprice7345

    elprice7345 Member TCF Club

    344
    17
    Sep 28, 2009
    Denver, CO
    FYI – MG3 has been working fine for me with TVDB since earlier this week.
    Well you answered one of my questions! If the limit is 22, there’s no point in returning more results to be able to scroll through them.

    With one-word series titles and the changes to the TVDB search function, I think you have to implement the similarity search or run the risk of not being able to retrieve the series.

    @dlfl – I would like to see the search results filtered by language if you can figure out how to do it. I’ve attached a screen shot with examples. The results will be more relevant and it will be a programming challenge for you! :D MG3 Language.JPG

    I’ve also attached a new knownSeriesIds.txt file to replace the one you distribute. I’ve cleaned it up, added many new seriesIds, and removed duplicates.

    For extra credit, what do you think about adding the TVDB movies as a search source to the movies tab now that TVDB has added movies to their database?
     

    Attached Files:

  10. dlfl

    dlfl Cranky old novice

    8,746
    631
    Jul 6, 2006
    Dayton OH
    @elprice7345
    Try test distro 3.90T2 in attached zip.
    EDIT: Attachment removed -- superseded by release ver 3.90
    I modified the similarity distance to ignore trailing years in parens in the result series titles. Now the 'atlantis' search displays Atlantis (2009) and Atlantis (2013) at the top two results. (I assumed one of those is what you were after.)

    I really don't see any way to exclude foreign items. Hopefully the T2 mod will help on this issue.

    AFAIK theTVDB.com hasn't come up with an API to search their movies. Have you seen any indication of that on their forums? The available API just returns series. Do you see obvious advantages of their movie info over TMDb ?

    I will include your updated knownSeriesIds.txt in the next non-test release, and thanks for that.
     
    Last edited: Jan 17, 2020 at 12:11 PM
  11. Sparky1234

    Sparky1234 Well-Known Member

    2,192
    315
    May 8, 2006
    I like the new search results stacking! TV searches are faster. Nice improvements!
     
  12. elprice7345

    elprice7345 Member TCF Club

    344
    17
    Sep 28, 2009
    Denver, CO
    Ignoring the trailing years is a good improvement. :thumbsup: Most of the time users probably don't know the year of the series or even if it has a year.
    The T2 mod definitely helps and I think the MG3 search is great as it stands now. :) I would ask on the TVDB forums, but since I'm not a programmer, chances are I wouldn't understand the answer. Could you ask over in the TVDB forum? ;)
    I did ask in the TVDB forums here: https://forums.thetvdb.com/viewtopic.php?f=122&t=60462. We'll see what they say. As far as advantages to using TVDB movie info, probably not yet. They're just rolling it out and TMDB has been around for awhile. I always think it's good to have multiple sources available if possible. Remember, we used to have Netflix as a source before Netflix shut that down.
    You're welcome! I've also attached an updated knownMovieIds.txt to this post.
     

    Attached Files:

  13. dlfl

    dlfl Cranky old novice

    8,746
    631
    Jul 6, 2006
    Dayton OH
    Note to users: If you get "Search error: Web error getting token" in response to a TV Search, this means the TVDB server is not responding.

    I'm experimenting with a scheme to weed out foreign language series and had to stop because this error started happening.
     
  14. dlfl

    dlfl Cranky old novice

    8,746
    631
    Jul 6, 2006
    Dayton OH
    Try test distro Ver. 3.90T3 in attached zip. EDIT: Attachment removed. Superseded by 3.90T4
    This includes an attempt to exclude non-English series from TV search results.
    What it actually does is exclude series that have a missing 'Overview', based on this description from the API documentation:

    If you include a language = 'en' specifier in the search request:
    I noticed that some series that appear to have English names, e.g., Atlantis (2009), have missing overview elements, so are excluded. I suspect this may not be objectionable based on the assumption that a series of interest would be expected to have an overview.(?)

    I also included the updated knownSeriesIds and knownMovieIds provided by @elprice7345.
     
    Last edited: Nov 25, 2019
  15. Sparky1234

    Sparky1234 Well-Known Member

    2,192
    315
    May 8, 2006
    Wow, this keeps getting better and better!
     
  16. elprice7345

    elprice7345 Member TCF Club

    344
    17
    Sep 28, 2009
    Denver, CO
    Much better @dlfl! Props for figuring this out!

    Most of the series with non-english language titles don't show in the results!

    I did find a couple of quirky examples:

    1. Search for "ballers" found this: Search - TheTVDB.com

    If you scroll down you'll see the series De Allerslechtste Chauffeur Van Nederland. Someone created an overview for the series in English and an "English" title, but left the "English" title in Dutch. According to MG3's logic it is correctly included in the results.

    2. Atlantis (2009) may be an inverse example: Search - TheTVDB.com

    In this case, Atlantis is a proper English noun and as such doesn't have a German translation. At first glance, I would expect the series to show in the MG3 results, but the series title and overview are both tagged as German so they correctly don't show in the search results.

    I think MG3 is in pretty good shape post-TVDB upgrade, but I would let the dust settle and TVDB stabilize a bit more before I published a new version. It will also give me a chance to do some more testing using my normal processes.
     
  17. dlfl

    dlfl Cranky old novice

    8,746
    631
    Jul 6, 2006
    Dayton OH
    Please replace test distro 3.90T3 with test distro 3.90T4 from attached zip.
    EDIT: Attachment removed -- Superseded by release ver. 3.90
    I found the 22-result limit was not imposed by the API but in MG3 code. And when I introduced the pseudo English-only filter, I did the limit wrong, so some valid results might be filtered out.

    I agree.
     
    Last edited: Jan 17, 2020 at 12:12 PM
  18. elprice7345

    elprice7345 Member TCF Club

    344
    17
    Sep 28, 2009
    Denver, CO
    While testing T4, MG3 would return no more than 23 series in the query results.

    Example: When I search for "atlantis" MG3 returns 23 titles. When I search the same on the TVDB web site, it returns 72 TV shows. Many of the web results don't have an English overview and therefore should be excluded from the MG3 results. I didn't take the time to count through all 72 titles. ;) Do you do anything in MG3 to limit the results quantity other than the language trick?

    I also get 23 results when I search for "24", but web search returns 123 TV show titles. When I searched TVDB for any fairly common single word, I could get no more than 23 titles.

    Other than fixing the limit issue, the MG3 search results are much improved!
     
  19. dlfl

    dlfl Cranky old novice

    8,746
    631
    Jul 6, 2006
    Dayton OH
    3.90T4 didn't remove the 22 (23?) limit on displayed results. It just corrected the way the limit was imposed. MG3 gets the same number of results via the API as the web search yields. It eliminates the non-english ones then sorts the rest on similarity then displays the top 22 (23?) results.
     
  20. Dec 1, 2019 #480 of 542
    elprice7345

    elprice7345 Member TCF Club

    344
    17
    Sep 28, 2009
    Denver, CO
    Good to know @dlfl. I do see 23 results in some searches.

    I noticed when installing T4 that the knownseriesids.txt file had the same issues I cleaned up. The issued version has some duplicates and incorrect seriesIds.

    Can you replace your version with this one rather than letting MG3 combine them? Feel free to compare the files to make sure I didn't honk something up!
     

    Attached Files:

Share This Page