1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

pyTivo - Transcoding server

Discussion in 'TiVo Home Media Features & TiVoToGo' started by armooo, Nov 25, 2006.

  1. Aug 7, 2012 #3601 of 5682
    lpwcomp

    lpwcomp Active Member

    8,075
    2
    May 6, 2002
    John's...
    I guess it's only partial success, but using a slightly modified pyTivo and after adding programId to some of my metadata files, I have Season and Episode displaying in the HDUI. Unfortunately, it doesn't always work. The programId gets to the TiVo but it doesn't change anything. It doesn't cause a problem, I just don't always get the Season and Episode displayed. I have no idea why this is so.
     
  2. lpwcomp

    lpwcomp Active Member

    8,075
    2
    May 6, 2002
    John's...
    I'm disappointed that apparently whatever database the TiVo uses doesn't have access to data for every series, much less every episode, at least not when it is setting Season Number and Episode Number. I almost gave up when the first one I tried didn't work but I decided to try an episode from different season and it worked.

    It's doubly disappointing since the information is available to the TiVo for any series that is available to the TiVo. (Search->Episodes->Show All Episodes). It's also available on zap2it, even for series not available to the TiVo.
     
  3. lpwcomp

    lpwcomp Active Member

    8,075
    2
    May 6, 2002
    John's...
    Ok. I have tested both the programId (to get Season and Episode numbers) and re-enabling grouping on an arbitrary or inactive seriesId. Neither caused any problems on my TiVo 2, THD, or TP.

    There is one unfortunate aspect to the "invalid" groups however. They are only named in the HDUI. In the SDUI, you end up with a group with just "(n)" as the name, where n is the number of recordings in the group. Since this change also results in grouping on a THD, you get the effect on that platform also.

    Unless someone can think of a way to rectify this situation, my thinking would be to have a setting in each TiVo section to control the generation of the full <vActualShowing> section, the default being not to, but I am not sure of the best way to implement it - two different TvBus templates or a conditional in the template.

    Cross-posted in the pyTivo forum.
     
  4. bwall23

    bwall23 New Member

    73
    0
    Jun 8, 2009
    I would also like to have programId in the metadata and displayed for those episodes that didn't get tagged with the episodeNumber when recorded, since that's Tribune Media's sequential episode number.

    Curious why you mention <vActualShowing> ?
    I thought the TiVo used the <showing> section, which displays only the recording of interest you selected.
    Try recording a program and pad a minute before and after. You will get three elements in <vActualShowing>;
    1) the program before the recorded show (1 min. early pad)
    2) the recorded show of interest
    3) the program after the show you selected (1 min. late pad)
    Only one element in <showing>, #2 above.
     
  5. lpwcomp

    lpwcomp Active Member

    8,075
    2
    May 6, 2002
    John's...
    Different issue. I thought that through experimentation I had found that sending a full <vActualShowing> section, the Premiere would once again group on an arbitrary or inactive seriesId as it used to, but now I'm not sure. A couple of shows I had not previously xferred would not group on an inactive seriesId but a show I had previously xferred continued to group on a completely made up seriesId. Color me completely :confused:

    BTW, these are all Pulls.
     
  6. bwall23

    bwall23 New Member

    73
    0
    Jun 8, 2009
    I thought pulls would only group on their valid (TMS)seriesId [SH + 6# or 8#] if the series had an episode within the current 14 day guide.

    I have never seen my pushed and pulled series group into the same folder on the TiVo (HD or Premiere). I put that on the back burner as I found too much conflicting info in my searches and none of it worked for me. My issue now is with missing epTitles or ep#'s and I know that TMS is TiVo's data provider, but I gave up on them ever keeping 100% current on everything. I do keep the metadata files along with the TTG transfers and the programId is in them, so eventually...
     
  7. lpwcomp

    lpwcomp Active Member

    8,075
    2
    May 6, 2002
    John's...
    Pulls have been grouping on a Premiere on an arbitrary or inactive seriesId at least as long as I've had one (Feb. 2011). It works even now sometimes, even to the extent of not working on a series and then it will later. Tonight I had one that wasn't working. I changed the order of title and seriesTitle and it worked. Tried that on a different series and it didn't work. There is something odd going on that I haven't yet been able to figure out.

    The seriesId associated with a Pushed file is created by tivo.mind. I tried using that as a series ID for a pull and it didn't group. Like I said, there is something odd going on.

    What are you using to create the metadata file? The release versions of neither pyTivo nor kmttg put programId in the metadata .txt file.

    Getting season and episode numbers using the programId is fairly easy vi zap2it, even automatically using a program. Going the other direction is a bit more problematic unless it is the most recent season. You can do it by hand w/o much effort. Getting a program to do it is something else again, at least in python. Or it may be just that I don't know enough about web navigation to do it and believe me, I tried. I'll probably give it another shot at some point, especially now that I have confirmed that the HDUI gets Season and Episode Numbers using programId, but I want to get this grouping thing straightened out first.

    BTW, it's not Tribune that only keeps episode data for a limited time, it is TiVo.

    I asked the TVDB people to add zap2it episode ID to the episode record but never got a response.
     
  8. lpwcomp

    lpwcomp Active Member

    8,075
    2
    May 6, 2002
    John's...
    On a hunch, I disabled my internet access (brute force. Unplugged the phone line). The Premiere was very unhappy, as I knew it would be, but I was able to get grouping of a series using a made up seriesId that wasn't grouping before.

    Here is my current theory: When pulling a show, a Premiere first checks it's local database (I'm not talking about the guide data). If it find it there, it is stored with the recording data (and added to local db). If not, it checks the TiVo servers. If it is valid or for some reason it cannot contact the servers, it does the same. If it is invalid, it is not stored with the program record.

    Now if I could just figure out how to temporarily disable access to the servers for the first episode of an invalid seriesId just long enough for it to be added to the local db...

    One other little gotcha - pyTivo cannot access these groups via the web interface. You just get unnamed "folders" that cannot be opened.
     
  9. lpwcomp

    lpwcomp Active Member

    8,075
    2
    May 6, 2002
    John's...
    I'm starting to think there is a malicious code demon in my TiVo that is modifying the software. Every time I think I have found a method to re-enable arbitrary grouping on the Premiere, I am unable to re-create it. Tried the "kill internet access" method on a different series and no joy. I feel like Charlie Brown trying to kick the football.
     
  10. bwall23

    bwall23 New Member

    73
    0
    Jun 8, 2009
    Yes, was aware of that and we don't know what the mind really uses from the metadata.

    I've been using kmttg and transfer the tivo file w/o decrypting and use a custom script to extract the the two xml chunks from it. Same data (almost) is available from the tivo's npl and video details. I have to hand edit my pytivo metadata files videofilename.ext.txt. I also use vidmgr which allows even non-standard metadata, but want to convert (decrypt) my .tivo file library to .mpg and create accurate .txt metatdata. I've kept them in .tivo format for two reasons;
    1) smaller than decrypted mpg
    2) retains the metadata in the xml chunks
     
  11. bwall23

    bwall23 New Member

    73
    0
    Jun 8, 2009
    Yes lpwcomp, we R watching U as you know from your logs ;)
     
  12. lpwcomp

    lpwcomp Active Member

    8,075
    2
    May 6, 2002
    John's...
    I'm not paranoid, but I know everyone thinls I am.:eek:
     
  13. lpwcomp

    lpwcomp Active Member

    8,075
    2
    May 6, 2002
    John's...
    I have discovered that the Premiere uses the programId (if present and in whatever db the TiVo accesses) to set pretty much all of the metadata, including fields seen only in the SDUI like the whole number episodeNumber.
     
  14. lrhorer

    lrhorer New Member

    6,922
    0
    Aug 31, 2003
    San...
    I went to a therapist because I thought everyone was out to get me. At first he thought I was paranoid, but then he realized I am just an insufferable jerk, and everyone really is out to get me. He now requires payment in advance. :eek:
     
  15. bwall23

    bwall23 New Member

    73
    0
    Jun 8, 2009
    Thanks for the confirmation. Since i use kmttg, I've asked if it can be added as an option to add the programId to the metadata file that kmttg creates.
     
  16. lpwcomp

    lpwcomp Active Member

    8,075
    2
    May 6, 2002
    John's...
    There is a caveat however. It does use it as I said - when it uses it. It doesn't always use it it all, just stores it in the metadata. I am unable to determine what conditions lead to it's use. It gets used for some episodes of a series and not for other episodes of the same series.

    It's possible that the value I am using is not always the same one that TiVo uses but my source is zap2it(Tribune), so theoretically it should be the same.

    Happily though, if it doesn't use the programId, it simply behaves as before and uses the metadata it is sent.
     
  17. Sep 1, 2012 #3617 of 5682
    lrhorer

    lrhorer New Member

    6,922
    0
    Aug 31, 2003
    San...
    OK, I seem to have run across a bit of an issue, and I think I know what triggers it, but not entirely why.

    I have been converting a few 1080p .mkv files to h.264 in a .mp4 container for transfer to the TiVo. Even with six cores running flat out, it takes several hours to convert a 90 minute movie. During that entire time, there is no MOOV atom in the file, since that is created at the very end. Earlier today, I tried to bring up a directory containing one of these incomplete files in the web tool, and pyTivo hung. I was not sure what the issue was at the time, but clearing out the files from the directory alleviated the issue. I wasn't sure - and I still am not 100% certain - what was causing the issue, but while converting another file tonight, the problem popped up again. I'll try again in the morning when the currently re-coding file is done to make sure my deduction is correct.

    Edit: Confirmed the app is able to scan the directory after the file is finished recoding. It looks like perhaps the absence of the MOOV atom on one file prevents the app from completing its scanning the entire directory. Since it takes several hours for the recode to complete, this is most inconvenient.
     
  18. Sep 1, 2012 #3618 of 5682
    bluefoggyday

    bluefoggyday New Member

    7
    0
    Feb 26, 2010
    Hi....

    My apologies for being so ignorant about this stuff. I've been using Vuze to upload videos to my Premiere TiVo for some time with much success. Now all of a sudden, I don't even have a TiVo option in Vuze at all.

    So I decided to try and use pyTivo. After much trial and error, it seems to be running. But I don't know what to do now. When I go to localhost:9032, I get a blank page with pyTivo at the top and then a link to web configuration.

    I don't know where to go from here....the instructions seem to just end after the install.

    When I look in Terminal (which I assume must be running to use pyTivo), it seems to be running this over and over:

    INFO:pyTivo:10.0.1.105 [01/Sep/2012 19:34:13] "GET /TiVoConnect?Command=QueryContainer&Container=%2F&DoGenres=1 HTTP/1.0" 200 -
    INFO:pyTivo:10.0.1.124 [01/Sep/2012 19:34:14] "GET /TiVoConnect?Command=QueryContainer&Container=%2F HTTP/1.0" 200 -

    Would someone be interested in helping me or pointing me to some pyTivo for Dummies instructions?!

    Thanks!

    Oh...I'm on a mac using Lion.
     
  19. Sep 2, 2012 #3619 of 5682
    lrhorer

    lrhorer New Member

    6,922
    0
    Aug 31, 2003
    San...
    No need to apologize. All of us were ignorant until we learned something.

    It sounds like you haven't configured pyTivo. To do that effectively, you are going to need to define for yourself how you wish to use pyTivo. Do you want to:

    1. Transfer still pictures
    2. Transfer music
    3. Transfer videos to the TiVo via pull (using the My Shows / NPL on the TiVo)
    4. Transfer videos to the TiVo via push (using an HME or external utility)
    5. Transfer videos from the TiVo to the PC
    6. Transfer DVD rips to the TiVo

    At a bare minimum, you will need to provide your MAK and define at least one share. Both of these can be done by pulling up the web configuration.

    If you choose to implement #4, then you will also need to supply the user name and password you use to access your account on www.tivo.com.

    If you choose to implement #5, then you will need to also supply a path on the PC where pyTivo will be saving the videos.

    Option #6 requires installing the DVD Plug-in.

    Again, all of this except installing the DVD plug-in can be done right from the web configurator, or you can edit pyTivo.conf by hand.

    No, but until you get pyTivo up and running, it will be easier to troubleshoot that way. Once pyTivo is working properly, then you can take steps to run it in the background and to start up automatically.

    OK, first a little request / piece of advice. It will be much easier for us to read what you supply us if you surround pasted text with code tags (the little # symbol in the reply toolbar):

    Code:
    INFO:pyTivo:10.0.1.105 [01/Sep/2012 19:34:13] "GET /TiVoConnect?Command=QueryContainer&Container=%2F&DoGenres=1 HTTP/1.0" 200 -
    INFO:pyTivo:10.0.1.124 [01/Sep/2012 19:34:14] "GET /TiVoConnect?Command=QueryContainer&Container=%2F HTTP/1.0" 200 -
    Are you really using the 10./24 subnet for your home LAN? Unusual.

    Anyway, it looks like pyTivo is finding two TiVos on your LAN. That's good. If you have all the appropriate passwords and paths set up for the general pyTivo configuration, then you can set up the configuration (if any) for SD and / or HD TiVos. You probably don't need any. After that, configure one share for each group of files you want to transfer to the TiVos. You will need at least one share for each type of file you want to transfer (photos, music, video, or dvdvideo). You can configure more than one share of each type, with each share specifying a different path on the server PC. Read through the pyTivo.conf.dist file for details. As an example, here is my pyTivo.conf file (with passwords removed, of course):

    Code:
    [_tivo_00000DEADBEEF]
    
    [Server]
    tivo_username = XXXXXXXXXXXXXXX
    tivo_password = XXXXXXX
    tivo_mak = XXXXXXXXX
    ffmpeg = /usr/bin/ffmpeg
    ffmpeg_pram = -threads 3
    togo_path = /RAID/Server-Main/Movies/TiVo_TS
    debug = True
    port = 9032
    
    [_tivo_HD]
    audio_lang = en, eng, 0x80, 5.1, ac3
    
    [_tivo_SD]
    audio_lang = en, eng, 0x80, 5.1, ac3
    
    [RAID Server]
    force_alpha = True
    type = video
    path = /RAID/Recordings
    
    [DVD]
    path = /RAID/DVD
    force_alpha = True
    type = dvdvideo
    fast_index = true
    
    [TTG]
    force_alpha = True
    type = video
    path = /RAID/Server-Main/Movies/TiVo_MPG
    
    [pyMusic]
    type = music
    path = /RAID/Music
    
    [Unverified]
    type = video
    path = /usr/share/pyTivo/Unverified
    
     
  20. Sep 2, 2012 #3620 of 5682
    lrhorer

    lrhorer New Member

    6,922
    0
    Aug 31, 2003
    San...
    OK, I ran into another apparent issue. I have a video named "20,000 Leagues Under the Sea (Recorded Fri Aug 31, 2012, HDNETMV).mp4" that I tried to push to the TiVos. I tried several times using two different TiVos, but the transfer never started. I got no error, and the negotiation with the mind server seemed to work OK, but the transfer never occurred. I tried it both on a Premier and and S3. Vidmgr was able to push the file with no problems, but the web server never did. Is it perhaps the comma in the title causing the issue for the web server?

    Edit: Well, so it would seem. I removed the comma from the first number in the name, re-created the link and it transferred just fine. 'Weird that the other commas don't affect the transfer.
     

Share This Page