1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Questions about TS streams and TiVo metadata

Discussion in 'TiVo Home Media Features & TiVoToGo' started by Dark Helmet, Jul 25, 2012.

  1. Dark Helmet

    Dark Helmet New Member

    132
    0
    Sep 15, 2006
    Northern...
    Hi, I've been working on my own program to streamline my conversion process from my TiVo to iTunes on my Mac, since there isn't a great one-stop solution that does everything I need. I've not been following things lately regarding the latest state of the art on the TiVo front, so I have a few questions about things:

    • As I understand it someone was working on decoding Transport Streams from the TiVo for tivodecode, but it seems like that effort has been abandoned (when I tried that out it didn't work on the streams I tested). Is that correct? And as a related question ... is tivodecode development dead?
    • Is there a description of the metadata format used by the TiVo? I know it's XML, I was wondering if someone had a description I see that there are two "chunk" files that tivodecode produces and they have different information in them. A lot of that is relatively easy to understand but I haven't really seen a reference to what it all means. For example, I gather that "episodeNumber" is really a combination of season number and the actual episode number; is that right?
    • In a related note, I've seen at least one example where the TiVo knows the season and episode number of a show, but there's no corresponding episodeNumber in the metadata. Any idea where the TiVo is storing that information at? I was just interested in trying to automate as much metadata entry as I can.

    Thanks for any help you can give me!
     
  2. ThAbtO

    ThAbtO TiVoholic by the bay

    6,720
    7
    Apr 6, 2000
    SF Bay Area
    TivoDecode really does not work well with TS as with the regular PS streams. I use KMTTG to get metadata and it is in .tivo.txt or .mpg.txt. text files and only about 4 items are used by the Tivo, namely for title, description etc., everything else that was extracted and re-intracted from the .txt files was ignored by the Tivo.

    title:
    seriesTitle:
    description:
    episodeTitle:

    I can edit these items and they can show up on the Tivo for the video.
     
  3. lpwcomp

    lpwcomp Active Member

    8,075
    2
    May 6, 2002
    John's...
    Why on earth do you state that the rest of the metadata is ignored? It most certainly is not.
     
  4. lpwcomp

    lpwcomp Active Member

    8,075
    2
    May 6, 2002
    John's...
    Not really. It's just a number. Some series do format it that way in the TiVo metadata and it is the standard way for user generated metadata.
    If you're talking about what is displayed by the Premiere HDUI, nobody really knows. I have a theory but have not been able to either confirm or disprove it.

    What I do know is that the the last portion of the url for an individual episode page at zap2it is the <program> level <uniqueId> in the TiVo XML. The page for a season has a piece for each episode with season #, episode #, and that uniqueId. I had code at one time to get the uniqueID for an episode based on season and episode #. It would be a simple matter to do it in the other direction. What I couldn't figure out was how to navigate to the page for anything other than the most recent season from within a python program.
     
  5. wmcbrine

    wmcbrine Ziphead

    10,364
    22
    Aug 2, 2003
    He probably only uses push.
     
  6. ggieseke

    ggieseke Active Member

    4,020
    11
    May 30, 2008
    Or a Premiere.
     
  7. wmcbrine

    wmcbrine Ziphead

    10,364
    22
    Aug 2, 2003
    No, a Premiere will transfer all the fields.
     
  8. lpwcomp

    lpwcomp Active Member

    8,075
    2
    May 6, 2002
    John's...
    Using the <program><uniqueId> to obtain season & episode # should be easy. Just get the xml for the url of form
    Code:
    http://tvlistings.zap2it.com/tv/<series name>/<program><uniqueid>
    where <series name> is all lower case with "-" replacing blanks.

    for instance,

    Code:
    http://tvlistings.zap2it.com/tv/the-big-bang-theory/EP009311820069
    
    is the url for season 4, episode 2 of "The Big Bang Theory".
     
  9. Dark Helmet

    Dark Helmet New Member

    132
    0
    Sep 15, 2006
    Northern...
    Yeah, that's what I'm talking about. Ok, thanks for that tip!

    Okay, I just wanted to be sure I wasn't missing something there.

    I see the uniqueID is included in the second chunk file ... and that works with zap2it!

    But I am a bit confused ... you say in your later post to "get the xml for the url of the form ...". That URL you give me has already been formatted into HTML.

    Hm, okay, some googling around makes me think that the answer to that is:

    • zap2it used to provide XML data, but doesn't anymore
    • There are a number of screen scrapers that convert the web page to XML format
    • That seems to be the only option, free or paid.

    Is that all correct? I actually don't mind paying for a feed (depending on the cost), because I sure do hate entering in metadata.
     
  10. moyekj

    moyekj Well-Known Member

    11,140
    29
    Jan 23, 2006
    Mission...
    The HDUI gathers extra information from TiVo servers on the fly to display program information - such information is not available when TiVo servers are down. That's part of the reason it makes a zillion nslookups when browsing program info.
     
  11. lpwcomp

    lpwcomp Active Member

    8,075
    2
    May 6, 2002
    John's...
    It probably always has been HTML, but it doesn't really matter. All you need to do is get the source for the page. You should then be able to search and parse it as a text string.
     
  12. Dark Helmet

    Dark Helmet New Member

    132
    0
    Sep 15, 2006
    Northern...
    Ahhhh ... So do they actually retrieve the information via DNS? Or is it via some HTTP-based protocol that normal mortals can't use?
     
  13. Dark Helmet

    Dark Helmet New Member

    132
    0
    Sep 15, 2006
    Northern...
    I've done that for other things, but in my experience those things are brittle; server changes can easily break your programs.

    I found out about Subscriber Direct, but I don't know if it's a complete replacement because that looks more like a current program guide rather than a lookup for a particular program (which may not have been broadcast recently).
     
  14. moyekj

    moyekj Well-Known Member

    11,140
    29
    Jan 23, 2006
    Mission...
    Well no, the queries are made to TiVo servers by name so DNS is needed to convert to IP #s. It's been noted by those with special router firmware that can track such requests that when using the HDUI and navigating the My Shows list that there is a lot of HTTP and DNS lookup activity happening which is part of the reason HDUI can be so slow. For example the pictures associated with specific shows you see on the right side are all obtained that way while you are navigating the HDUI along with extra info such as episode # etc.
     
  15. Dark Helmet

    Dark Helmet New Member

    132
    0
    Sep 15, 2006
    Northern...
    You would think that some of those DNS queries could be cached, but hey, whatever. Guess it's time to break out a network sniffer ...
     

Share This Page