DailyMail: a daily e-mailed status report from your TiVo

[tivo-onion]

Originally posted by ddub
Thanks Chris,
Works fine.

can I make a suggestion?
In the next complete zip package, could you include a txt file that lists all the locations of the files?
I know you do this on the web page, but sometimes you have to trawl through the 100's of pages in this thread, and can me out of date anyway.

cheers
Darren

No problem - will start doing that with every zip file I release - good point,

cheers

Chris

[gardavis]

I attempted an upgrade from version 7 to 27 and when I run the command manually, it does not get very far. After about a second, this is output to the screen:

/var/hack => ./dailymail_jazz.tcl
": no such file or directory

I read back a few pages to get the latest zip file with all the files and images and then replaced with the recently posted version 27. I think I got the files in the correct directories - the itcl files went into tivoweb-tcl/modules and the dailymail_jazz.tcl and the cfg file into /var/hack. Images are on my web server.

I updated the new cfg from the parameters from my old one.

Any ideas on how to determine what "blank" filename is being used?

Does the .tcl language have a line-by-line trace mode like the set -x in sh?

Thanks,
Gary

[gardavis]

Originally posted by gardavis

/var/hack => ./dailymail_jazz.tcl
": no such file or directory


Solved by searching this thread - ftp using ws_ftp auto mode should have used binary mode. For some reason, my IE ftp stopped working so I used ws_ftp instead.

There have been quite a few updates since my last install and I am impressed.

Thanks!
Gary

[managerxxx]

TivoOnion

Thanks for dailymail_jazz - it just gets better and better. One question I do have is regarding logging. From V2.5 onwards I'm having erratic results with my cron job. According to the cron log the job is being run at the required time - however the only jazz logs that I see are those that appear to result from manually running from the web gui. If I run the jazz file manually I don't seem to have any problems.

Is there anything else that I can do to debug the issues that I'm seeing? I assume that I should be able to pipe the jazz 'transactions' fired off from cron to a log file??

Thanks

[PortlandPaw]

I may have posted this before, but in case I didn't, this is the cronjob line that works every day for me:

# Fifteen after eight a.m., Maine time, every weekday, push dailymail
15 13 * * 1-5 /tvbin/tivosh /var/hack/dailymail/dailymail_jazz.tcl > /var/hack/log/dailymail_jazz 2>&1

You'll note that I've put dailymail in its own directory, which requires adjustments to almost all the files to get the path correct.

Note to onion: A nice improvement would be to specify the path as being that where the executable was found. That can be done in html and dos, but I don't know about TCL.

[ddub]

Is it possible to have this module post to 2 email addresses automatically?

Would be nice to have one sent to home account, and one sent to work email address.

Darren

[PortlandPaw]

Tivo-onion says,
"5. Added capability to pass in an alternate email recipient on the commandline and through tivoweb with a new updated version of the senddailymail.itcl module, also provided in the attached zip file.

on the command line two arguments are now allowed, the override "hours ahead" value and the override "recipient email", for example.....

dailymail_jazz.tcl 72 jim@beans.com

......will send a jazz dailymail to "jim@beans.com" looking ahead for the next 72 hours."

So one way to address your request would be to put in a second cronjob with the override e-mail address.

[ddub]

Thanks, Ill give it a go...

Darren

[tivo-onion]

Next version (v0.30) available with the following updated features:

1. The current module version number and release date is now added to the generated email.

2. The ability to send an email to up to 3 recipients has been added.

3. A dynamic debugging capability has been added to the module.

4. The link from the noreddot (lightulb) “stopped” graphic to the noreddotcontrol.itcl tivoweb module has been removed and the noreddotcontrol.itcl tivoweb module has been removed.

5. The capability to login to your mail server using base 64 encoded username and password has been provided.


All details in the included datasheet.

Module is available here (http://deepinthejungle.servehttp.com/dailymail_jazz v0.30.zip),

enjoy and let me know if there are any problems,

cheers

Chris

[Prof. Yaffle]

Hmmm... Might be me Chris but I think something's missing from that file - the new version of dailymail_jazz.tcl.

[tivo-onion]

Originally posted by Prof. Yaffle
Hmmm... Might be me Chris but I think something's missing from that file - the new version of dailymail_jazz.tcl.

Cheers Prof .... schoolboy error! It is there now!

cheers

Chris

[Prof. Yaffle]

Cheers Chris. Works a treat. Cracking work yet again!

[Fozzie]

Looking good here too - great stuff.

[PortlandPaw]

I really like your HTML install/what's new page. Very nice touch. This remains one of my favorite TiVo features -- my thanks to you, Sanderton and all who contributed to the effort. Hey, that includes me!

[del4]

Thanks to all who have contributed to an excellent hack!

Just a quick suggestion to accomodate any 'colonials' who use this hack. (Just a minor thing really, but I think there's little else left to improve.) Could we use the uktivo value to decide whether or not to use the existing UK conventions for dates and spellings vs. their US counterparts?

For example, in writing out the date of the email:

if {$uktivo == true} {
puts $chan "Date: [clock format [clock seconds] -format {%a, %d %b %Y %H:%M:%S (%Z)} -gmt true]"
} else {
puts $chan "Date: [clock format [expr [clock seconds] + $tzoffset] -format {%A, %B %d, %Y %I:%M:%S%p}]"
}

:) And to "correct" some misspellings in the generated email:

if {$uktivo == true} {
set sectionWithData "The following programmes are scheduled to record in the next $dmailHoursahead hours: "
} else {
set sectionWithData "The following programs are scheduled to record in the next $dmailHoursahead hours: "
}

Again, it's a minor thing, but is simple enough to add into the next version. What do you think?

[ccwf]

Originally posted by del4
Could we use the uktivo value to decide whether or not to use the existing UK conventions for dates and spellings vs. their US counterparts? Not for the Date: header. That header must be in the format   Date: Sat, 26 May 2001 11:13:00 -0500 (EST)
where the day of the week, seconds, and the parenthetical timezone name are optional. See RFC2822 for the details. Of course, some mail readers have the capability to show you the date in a localised format (which you are free to do), but it must be sent in that format.

[ddub]

New 0.30 version working well, however get this error if I set debug level to 0 :

------welcome to the jazzed dailymail program - v0.30 (24/02/2004) - starting
------the debug level is set at >>0<<

invalid command name "}"
while executing
"}"
invoked from within
"if {$debuglvl>0} { puts "debug-$numargs argument(s) found"} }"
(file "./dailymail_jazz.tcl" line 211)
bash-2.02# ./dailymail_jazz.tcl

Darren

[del4]

Originally posted by ccwf
Not for the Date: header. That header must be in the format &nbsp;&nbsp;Date:&nbsp;Sat,&nbsp;26&nbsp;May&nbsp;2001&nbsp;11:13:00&nbsp;-0500&nbsp;(EST)
where the day of the week, seconds, and the parenthetical timezone name are optional. See RFC2822 for the details. Of course, some mail readers have the capability to show you the date in a localised format (which you are free to do), but it must be sent in that format.

Interesting, because I modified the Date: header to send what I gave in my earlier post and it works fine...

I'm not so concerned about the Date in the mail header, but rather the dates shown in the generated email, "Here is the TiVo status as of Wednesday, February 25, 2004 09:08AM:"

[ccwf]

The legacy of Jon Postel—lots of formats are often accepted other than the one that is required to be sent.

As for the body, yes, you are free to do what you like there, of course.

[tivo-onion]

Originally posted by ddub
New 0.30 version working well, however get this error if I set debug level to 0 :

------welcome to the jazzed dailymail program - v0.30 (24/02/2004) - starting
------the debug level is set at >>0<<

invalid command name "}"
while executing
"}"
invoked from within
"if {$debuglvl>0} { puts "debug-$numargs argument(s) found"} }"
(file "./dailymail_jazz.tcl" line 211)
bash-2.02# ./dailymail_jazz.tcl

Darren

Bugger, there was one stray "}" in there ... I was surprised it even parsed / ran with it in there at all! I have updated the v0.30 file with the updated dailymail_jazz.tcl. You can get it from the zip file in the original email or get the replacement here. Please note I have not updated the release number for this minor bug fix!

This was only a problem when you set the debugging level to zero for some reason.

apologies and good spot,

cheers

Chris

[sanderton]

All my hacks have the UK spellings; look on it as a small protest at having to work all day with software with "color" menus and "centered" text. :)

[tivo-onion]

Originally posted by sanderton
All my hacks have the UK spellings; look on it as a small protest at having to work all day with software with "color" menus and "centered" text. :)

I agree! Also, working for a US company, and having to write company standardised English in documentation (i.e. American English) - it is pleasant not to have to worry about this kind of issue and pander to the needs of ........ ( I think I'll stop there before I put anyone’s nose out of joint!)

Long live the Queen's English. ;-)

Chris

[PortlandPaw]

I, too, have spent a few minutes with each new version doing some Americanization. Sacrilege, I know, but...

Here's what I've done each time:

# Changed "/var/hack/" to "/var/hack/dailymail/" (where appropriate)
# Changed [clock format [clock seconds] to [clock format [expr [clock seconds]-18000] -- (except in date: and using + $tzoffset is better)
# Changed "Here is the TiVo status as at <i>[clock format [clock seconds] -format {%a, %d %b %H:%M} -gmt true]</i> : " to "Here is the status of your TiVo as of <i>[clock format [expr [clock seconds]-18000] -format {%A, %B %d, %I:%M %p}]</i> : "
# Changed "hrs" to " hours"
# Changed "email" to "E-Mail"
# Changed "programme" to "program"
# Changed "Expiry" to "Expiration"

For the sake of consistency, I would suggest that the /var/hack/ path be added to the .cfg variables. As stability is achieved, it's unlikely that the config file will change greatly and you can highlight any specific changes in your nice new readme. That will save scanning the new .cfg for anything new.

So what will you do when the French and Arabic versions are requested?

Cheers!

[iankb]

Originally posted by PortlandPaw
So what will you do when the French and Arabic versions are requested?I think it's more of a problem when all of those Japanese users work out how to hack their versions of the TiVo.

[tivo-onion]

Originally posted by PortlandPaw

For the sake of consistency, I would suggest that the /var/hack/ path be added to the .cfg variables. As stability is achieved, it's unlikely that the config file will change greatly and you can highlight any specific changes in your nice new readme. That will save scanning the new .cfg for anything new.


Cheers!

Question ... since you need the var/hack path to point to the dailymail.cfg file, how can i put that path into that file? Any ideas,

cheers

Chris

[tivo-onion]

Originally posted by PortlandPaw

# Changed [clock format [clock seconds] to [clock format [expr [clock seconds]-18000] -- (except in date: and using + $tzoffset is better)
# Changed "Here is the TiVo status as at <i>[clock format [clock seconds] -format {%a, %d %b %H:%M} -gmt true]</i> : " to "Here is the status of your TiVo as of <i>[clock format [expr [clock seconds]-18000] -format {%A, %B %d, %I:%M %p}]</i> : "

Cheers!

Portland,

re: the section of code which checks the currency of the endpad log file:


if { [string first $endpadexecfilename $shellmsg] > -1 } {
set nowtime [clock seconds]
set twominbefore "[clock format [expr $nowtime - 120] -format {%b %e %H:%M} -gmt true]"
if {$debuglvl>1} { puts "debug-twominbeforestring: >>$twominbefore<<"}
set oneminbefore "[clock format [expr $nowtime - 60] -format {%b %e %H:%M} -gmt true]"
if {$debuglvl>1} { puts "debug-oneminbeforestring: >>$oneminbefore<<"}
set now "[clock format [expr $nowtime + 0] -format {%b %e %H:%M} -gmt true]"
if {$debuglvl>1} { puts "debug-nowstring: >>$now<<"}
set oneminafter "[clock format [expr $nowtime + 60] -format {%b %e %H:%M} -gmt true]"
if {$debuglvl>1} { puts "debug-oneminafterstring: >>$oneminafter<<"}
if {$debuglvl>1} { puts "debug-perform ls"}

if {[catch { exec $listcmd -ls $endpadlogloc } listmsg]} {
# null
if {$debuglvl>1} { puts "debug-problem with log file existance"}
} else {
if {$debuglvl>1} { puts "debug-ls output : >>$listmsg<<"}
if { [string first "$twominbefore $endpadlogloc" $listmsg] > -1 } {
set endpadrunning "ok"


I noticed that it uses the "-gmt true" switch. Does this work for you, or should I use the tzoffset here also?

cheers

Chris

[sanderton]

Originally posted by tivo-onion
Question ... since you need the var/hack path to point to the dailymail.cfg file, how can i put that path into that file? Any ideas,

cheers

Chris

Use:

set pathname [file dirname [info script]]

to return the directory holding the current script, and do eveything else as relative from there. Then you can make the thing work wherever its put.

[PortlandPaw]

Onion, here's a quick improvement to the section of code that detects the hacks running. Please change "tivoweb" to "httpd-tt.tcl" in the list of keywords. The reason for this is that if TivoWeb is started by one of the init scripts, "tivoweb" shows up in the listing. But if it's shut down and then re-started via telnet, for some reason, the path isn't given, just the app. "httpd-tt.tcl" is common to both startup methods and will therefore (hopefully) work under all conditions.

Keep up the great work!

Dave

[PortlandPaw]

Originally posted by tivo-onion
Portland,

re: the section of code which checks the currency of the endpad log file:

I noticed that it uses the "-gmt true" switch. Does this work for you, or should I use the tzoffset here also?

cheers

Chris

I haven't touched that part of the code as I'm not using endpad. Sorry, but I have no idea what would happen!

Dave

[tivo-onion]

I have a couple of questions re clocks, date and time:

1. I am assuming that the "-gmt" switch for clock related functions always renders the time in the GMT zone. Am I correct with this?

2. if I do an "ls -l" at the bash# prompt, are the times that appear in this directory listing effectively GMT times, or are they attuned to the locality?

The reason I ask, is that when checking the currency of the endpad log I am comparing the time shown as part of a "ls -l" command against the current time specified with the "-gmt" switch. Will this work the world-wide, or should I be using the "tzoffset" with the current time to match against the time specified via the "ls -l" command?

any help re: this would be great,

cheers

Chris

[sanderton]

Chris, I'd suggest you change to using TCL:



file stat /var/log/endpad.log endpadlogstats

puts "The EndPad log was last modified at [clock format $endpadlogstats(ctime)]"



"file stat" populates an array with the name you specify with various info about the file. The ctime element is the last modified time - in TiVo internal format so no translation to worry about!

[PortlandPaw]

We in the States see GMT reported as the time within our TiVos. Screen displays use 12 hour local time, which is what most of us are used to (as opposed to 24 hour format).
Thank you for your continued diligence!
Dave

[tivo-onion]

So, working off the last couple of messages:

What I currently have as:

set nowtime [clock seconds]
set now "[clock format $nowtime -format {%b %e %H:%M} -gmt true]"
if {! [catch { exec $listcmd -ls $endpadlogloc } listmsg]} {
&nbsp;&nbsp;&nbsp;&nbsp;if { [string first "$now $endpadlogloc" $listmsg] > -1 } {
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;set endpadrunning "ok"
&nbsp;&nbsp;&nbsp;&nbsp;}
}

will work across the world, because native TiVo time is GMT and I am comparing a GMT time to the native GMT time from the "ls -l" command.

Alternatively I could do the following:

set nowtime [clock seconds]
set now "[clock format [expr $nowtime + tzoffset] -format {%b %e %H:%M}]"
if { ! [catch {file stat /var/log/endpad.log endpadlogstats} ] } {
&nbsp;&nbsp;&nbsp;&nbsp;if {$now == "[clock format $endpadlogstats(ctime) {%b %e %H:%M}]" } {
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;endpadrunning "ok"
&nbsp;&nbsp;&nbsp;&nbsp;}
}

and this would also work accross the world, as the "ctime" is local time and I have localised the "now" time through using the tzoffset variable?

Can you guys confirm or deny?

thanks for your help,

cheers

Chris

[sanderton]

Still too complicated. :)



if { ! [catch {file stat /var/log/endpad.log endpadlogstats} ] } {
if {[expr [clock seconds] - $endpadlogstats(mtime)] < 120 } {
endpadrunning "ok"
}
}



On thinking about it, mtime (modification time) rather then ctime (change time)would probably be better - although I'm not 100% sure what the difference is!

[tivo-onion]

Cheers for that. The key thing I am trying to understand here though is the different types of time and what I can successfully compare. Although the code may be a tad over complex, are the principles correct re: tivo native time, tzoffset and -gmt switches?

The example you give here seems to be comparing TiVo internal format time ( $endpadlogstats(mtime) ) to TiVo native time ( [clock seconds] ). Is this not comparing tivo adjusted time to gmt time - and therefore would not work?

Prehaps a better way to figure this out is to do a grid of commands with time elements to them:

command >>> format
$endpadlogstats(mtime) >>> local
[clock seconds] >>> gmt
[clock format $nowtime -gmt true] >>> gmt
[clock format [expr $nowtime + tzoffset] ] >>> local
bash# ls- l >>> gmt

are these correct?

thanks for your patience,

cheers

Chris

[sanderton]

You're mixing up the formatting of the text string with the actual numeric time.

TiVo time is measured in seconds from midnight on Jan 1st 1970, GMT. This is true of all TiVos, and is the number you'll see everywhere in the Tivo software and in the TiVo environment..

As long as you keep the code to working in this seconds-based internal format, you only need to worry about time zones and formats at the final output stage.

Looking at the code fragment you posted, it wouldn't work as you've added ina tzoffset to nowtime which won't be there in the modification time of the file.

[sanderton]

Nothing on the TiVo EVER has a local timezone.

[tivo-onion]

Originally posted by sanderton
It's the numbers of seconds since 12 am Jan 1st 1970 .

the number of seconds since 12am Jan 1st 1970 "GMT" wherever you are in the world?

[sanderton]

Yes. As I said, TiVos don't work in local time. Ever.


TiVo time is measured in seconds from midnight on Jan 1st 1970, GMT. This is true of all TiVos


:)

For every TiVo in the world, it is now 1077902102.

[ccwf]

Originally posted by sanderton
On thinking about it, mtime (modification time) rather then ctime (change time)would probably be better - although I'm not 100% sure what the difference is! mtime is only updated when the file's contents have been written/modified. ctime is also updated when information about the file (name, permissions, ownership, …). So, for example, if you rename a file, ctime is updated but mtime is not. If you edit a file, both are updated.

[greenkr]

Error sending DailyMail
I have beed using Tivoweb and endpad for some time – thank you very much Sanderton!
I have just got broadband and am trying to set up Daily Mail (jazz v 0.30). I have had success three times by running dailymail_jazz.tcl (this was immediately after after a Tivo reboot): the email was sent, and received, OK. It worked with endpad started as well. However all other times I have tried, dailymail_jazz.tcl gets stuck at “debug-body ended” and eventually times out (about 5 minutes).
error reading “sock10”: connection timed out
while executing
“gets $chan reply”
(procedure sendmail line 160)
invoked from within
“sendmail $mailserver $domain $recipient “Tivo status e-mail for [clock format [clock seconds] – format {%A %B %d, Y%} –gmt true]” $message”
(file “/var/hack/dailymail_jazz.tcl” line 2753)

If I try to send via Tivoweb it takes several minutes to respond again. The log gives the following error:
debug-body ended
debug-got reply : >>421 ptb-relay02.plus.net SMTP incoming data timeout - closing connection.<<
debug-sending failed

Any help would be much appreciated.

[greenkr]

Error sending DailyMail

An update while waiting hopefully for suggestions:

Tried Stuart’s dailymail.tcl v0.3 – same problem, just timed out eventually.

Tried mailfile.tcl (page 21 of this thread) with a simple text file – this seems to work perfectly every time.

[Blahblah2000]

I get the following error when I try to start cron:

"can't lock /var/hack/cron/cron.pid, otherpid may be 242: Resource temporarily unavailable"

Anyone have any insights for me? When I run the PS command, I don't see any process with PID 242 running...

[sanderton]

Blahblah: Sounds like cron is already running.

greenkr: Difficult to diagnose from the info you've posted I'm afraid.

[Blahblah2000]

Hmm ok, wouldn't that process show up when I run ps though? Any way to test if it is actually running?

* Edit, there is a log in my cron dir that is getting updated (cron.test.out), so I guess it is running already. Weird... Thanks for your help, though :)

[greenkr]

After some experimenting, I have found that if I reduce hoursahead to 18 dailymail.tcl works OK but set to 24 it doesn't.
Is there any other info I can post which will help diagnose the problem?

[sanderton]

You're getting a timeout error from the mailserver and it works if it has less data to send. But it doesn't start sending until it has all the data ready.

Bemused.

[greenkr]

Error sending DailyMail

Just experimenting a little more. I have added “puts [strim $line]” into the loop which creates the message, to try to get an idea of what is happening. It appears to create the message in seconds, up to and including entries due to expire. It then appears to do nothing until it times out about 5 minutes later.

I am new to Linux, and wonder if it would be possible to get it
(a) to put the message output into a text file on the Tivo and
(b) to echo the commands to the screen as it runs,
so that I can check what it is doing.

[PortlandPaw]

greenkr, maybe I'm jumping in here a little late, but if you try tivo-onion's version of sanderton's dailymail, you might have more success tracking the problem, as onion has added in debugging points. I think this will give you the latest version: http://www.tivocommunity.com/tivo-vb/showthread.php?postid=1765550#post1765550. You can look at the debugging from the bash prompt as the program runs, or in the log file created. This program works great for me; good luck!

[greenkr]

Thanks, but I started with that, with full debugging on – it did not really help.

The problem seems to lie with these lines:

puts $chan “.”
flush $chan
gets $chan reply
puts "got reply: $reply"

It gets to this point OK – tested by putting in extra lines eg
puts “some text”
to check where it gets to. It definitely gets to the line “gets $chan reply” but then gets stuck. Sometimes it gives a timeout message, sometimes it just says
“Got reply:
Sending failed”

[tivo-onion]

Originally posted by greenkr
Thanks, but I started with that, with full debugging on – it did not really help.

The problem seems to lie with these lines:

puts $chan “.”
flush $chan
gets $chan reply
puts "got reply: $reply"

It gets to this point OK – tested by putting in extra lines eg
puts “some text”
to check where it gets to. It definitely gets to the line “gets $chan reply” but then gets stuck. Sometimes it gives a timeout message, sometimes it just says
“Got reply:
Sending failed”

My mailserver sometimes sends back the following debugging message:

debug-got reply : >>354 End data with <CR><LF>.<CR><LF><<

It is faily hardy and works anyway, but maybe your mailserver is more dependant on something like this.

Try something like this at the end instead of sending just a ".":

puts $chan “\n.\n”
flush $chan

or prehaps:

puts $chan “\r.\r”
flush $chan

or maybe even:

puts $chan “\n\r.\n\r”
flush $chan

cheers

Chris

[ccwf]

I'm wondering if it's a packet size issue. Misconfigured intermediate routers sometimes do not handle large packets properly, causing symptoms like those you have described. If you have a Windows box, try using ping with the -f and -l options to send a large packet to your mail server. See if ping gets a reply packet (OK) or lets you know that the packet needs to be fragmented (OK) or simply times out (not OK).

[LJ]

If I'm reading the RFC correctly, all SMTP commands should end with CRLF - i.e. "\r\n". If the mailserver is sticking to the RFC it will wait for "\r\n.\r\n" to end the DATA phase.

LJ, avoiding ranting about non-RFC compliant code ;)

[ccwf]

Yes, mail servers in general wait for the CR&nbsp;LF&nbsp;.&nbsp;CR&nbsp;LF sequence (line with nothing but a period) to end the body. It is legal for a line to begin with a period†, so they don't end the body upon reading a CR&nbsp;LF&nbsp;. sequence.

† Specifically, lines that begin with a period are escaped with an additional period.

[greenkr]

Try something like this at the end instead of sending just a ".":

No change I'm afraid.

I'm wondering if it's a packet size issue. Misconfigured intermediate routers sometimes do not handle large packets properly, causing symptoms like those you have described. If you have a Windows box, try using ping with the -f and -l options to send a large packet to your mail server. See if ping gets a reply packet (OK) or lets you know that the packet needs to be fragmented (OK) or simply times out (not OK).

Please can you please give me a bit more to go on? I've no experience of setting up routers (this is my first one, set up on Wednesday). What would be a suitable size for a large packet? This sounds a possibility as mailfile.tcl works with a simple text file and I got dailymail.tcl to work once or twice by reducing hoursahead. All I did to set up my router was to enter my username and password!

[ccwf]

Originally posted by greenkr
No change I'm afraid. Note that it's CR&nbsp;LF&nbsp;.&nbsp;CR&nbsp;LF, which is "\r\n.\r\n" in the code.

[ccwf]

Originally posted by greenkr
Please can you please give me a bit more to go on? I've no experience of setting up routers (this is my first one, set up on Wednesday). If you aren't using custom firewall settings, then, if this is the problem, it would most likely be with an upstream router (or, occasionally, home routers running old, buggy firmware). What would be a suitable size for a large packet? Try 1472 and some other sizes. So, ping -f -l 1472 your.mail.server

[greenkr]

ping -f -l 1472 your.mail.server
Just get "Request timed out "

My router does not have a firewall, I am just using the XP firewall at the moment.

[sanderton]

Originally posted by ccwf
I'm wondering if it's a packet size issue. Misconfigured intermediate routers sometimes do not handle large packets properly, causing symptoms like those you have described. If you have a Windows box, try using ping with the -f and -l options to send a large packet to your mail server. See if ping gets a reply packet (OK) or lets you know that the packet needs to be fragmented (OK) or simply times out (not OK).

The way DailyMail works, it slices the text up into individual words and send them one at a time, so there shouldn't be any large packets.

(Inefficient? Yup. Guaranteed not to hit the character limit of the mailserver. Yup).

[ccwf]

Does the ping work for smaller packet sizes (e.g., when you use plain ping&nbsp;your.mail.server)?

[greenkr]

Does the ping work for smaller packet sizes (e.g., when you use plain ping your.mail.server)?
Yes it does - time around 36 ms

[ccwf]

Originally posted by ccwf
Note that it's CR&nbsp;LF&nbsp;.&nbsp;CR&nbsp;LF, which is "\r\n.\r\n" in the code. But the puts by default outputs "\r\n" for sockets, so puts ""
…
puts "." should be all that is necessary, and DailyMail does that. Originally posted by sanderton
The way DailyMail works, it slices the text up into individual words and send them one at a time, so there shouldn't be any large packets.

(Inefficient? Yup. Guaranteed not to hit the character limit of the mailserver. Yup). Unless the Nagle algorithm is turned off using the TCP_NODELAY socket option (I don't believe it's even possible to set socket options in Tcl), the OS will buffer the socket data in order to send a smaller number of bigger packets. This may be true even across flush statements. (It would be worth sniffing to find out.)

[ccwf]

Originally posted by greenkr
Yes it does [work for smaller packets] Try different sizes to find the cutoff, but it sounds like this is likely your issue. You should be able to use the TTL arguments to find the misconfigured router and complain to the owner of the router to fix it. (Try starting the TTL small and then increase it. You want to find the TTL beyond which no correct responses are received for large packets. That will identify how many hops away the bad router is. You can then find the bad router with a traceroute.)

If the problem is your own router (even TTLs of one or two don't work), then make sure you have the latest firmware for your router.

If your router is not the problem and has an MTU setting, then you can probably get around the problem by reducing the MTU. (You could, of course, also reduce the MTU on the TiVo itself, but it sounds like your Windows box is affected by the problem, too, from the tests you have run.)

[ccwf]

Originally posted by ccwf
Unless the Nagle algorithm is turned off using the TCP_NODELAY socket option (I don't believe it's even possible to set socket options in Tcl), the OS will buffer the socket data in order to send a smaller number of bigger packets. This may be true even across flush statements. (It would be worth sniffing to find out.) I did a packet sniff (with a small Tcl test program, not with DailyMail) and verified this supposition—the OS indeed still consolidates packets despite the Tcl flush calls.

[greenkr]

Try different sizes to find the cutoff, but it sounds like this is likely your issue. You should be able to use the TTL arguments to find the misconfigured router and complain to the owner of the router to fix it. (Try starting the TTL small and then increase it. You want to find the TTL beyond which no correct responses are received for large packets. That will identify how many hops away the bad router is. You can then find the bad router with a traceroute.)
ping -f -l 1200 gives time 92ms and TTL 248.
Sorry for being a nuisance, but could you spell out what I need to do? Could you suggest suitable TTL arguments please?
If your router is not the problem and has an MTU setting, then you can probably get around the problem by reducing the MTU. )
MTU seems to be set to 1492.

[ccwf]

ping -i 1 -f -l 1472 your.mail.server
ping -i 2 -f -l 1472 your.mail.server
ping -i 3 -f -l 1472 your.mail.server
ping -i 4 -f -l 1472 your.mail.server
ping -i 5 -f -l 1472 your.mail.server
ping -i 6 -f -l 1472 your.mail.server
… You want to find the value of -i beyond which all pings fail for you. This isn't the smallest value of -i that fails—if 1&nbsp;through&nbsp;4 work, 5&nbsp;fails, 6&nbsp;works, and 7&nbsp;and up fail, then you are interested in hop #7, not hop #5.

[pahunt]

Maybe I'm missing the obvious but is there anything in dailymail.cfg that will remove a section from the e-mail. Ideally I'd like to be able to take out the expiry section as it isn't that useful to me but I couldn't see an easy way of doing this.

[tivo-onion]

Originally posted by pahunt
Maybe I'm missing the obvious but is there anything in dailymail.cfg that will remove a section from the e-mail. Ideally I'd like to be able to take out the expiry section as it isn't that useful to me but I couldn't see an easy way of doing this.

This is the relevant section in the dailymail.cfg file:

# Update this list to specify the ordering of the main programme information sections
set dmailToDoList 1
set dmailConflicts 3
set dmailExpired 2
set dmailTivoStatus 4

The section you do not want, just set the value to zero.

cheers

Chris

[pahunt]

Originally posted by tivo-onion
This is the relevant section in the dailymail.cfg file:

# Update this list to specify the ordering of the main programme information sections
set dmailToDoList 1
set dmailConflicts 3
set dmailExpired 2
set dmailTivoStatus 4

The section you do not want, just set the value to zero.

cheers

Chris

Thanks :up:

[greenkr]

Originally posted by ccwf
ping -i 1 -f -l 1472 your.mail.server
ping -i 2 -f -l 1472 your.mail.server
ping -i 3 -f -l 1472 your.mail.server
ping -i 4 -f -l 1472 your.mail.server
ping -i 5 -f -l 1472 your.mail.server
ping -i 6 -f -l 1472 your.mail.server
… You want to find the value of -i beyond which all pings fail for you. This isn't the smallest value of -i that fails—if 1&nbsp;through&nbsp;4 work, 5&nbsp;fails, 6&nbsp;works, and 7&nbsp;and up fail, then you are interested in hop #7, not hop #5.
The smallest value NOT to return Request timed out: ping -i 8 -f -l 1464 my.mail.server. This returned time 106ms, TTL 248.
All -i values less than this failed. If I use any bigger packet size than 1464 (even just with ping -f -l 1472 my.mail.server) it always times out.

As this may be relevant I'll mention another problem I'm having since trying to get dailymail working. I can access tivocommunity OK with my broadband ISP, but when I post a reply it does not get through - I get page cannot be displayed - so I am having to use my old dial-up to post messages.

[ccwf]

Originally posted by greenkr
The smallest value NOT to return Request timed out Smallest value of -i (TTL/# hops) or smallest value of -l (packet size)? As this may be relevant I'll mention another problem I'm having since trying to get dailymail working. I can access tivocommunity OK with my broadband ISP, but when I post a reply it does not get through Yes, the apparent router misconfiguration would affect both your computer and your TiVo—this doesn't appear to be a DailyMail issue per se.

[greenkr]

Originally posted by ccwf
Smallest value of -i (TTL/# hops) or smallest value of -l (packet size)? Yes, the apparent router misconfiguration would affect both your computer and your TiVo—this doesn't appear to be a DailyMail issue per se.
The smallest value of -i.
I've put a post on my router forum and been advised to adjust RWIN to 14520 and MTU to 1492. Ping -f -l 1472 mymailserver now gives "Packet needs to be fragmented but DF set".
I can preview this reply so I think I'll be able to post it.
However Dailymail.tcl still times out!!

[ccwf]

Assuming you meant the largest value of -i or the smallest value of -i that does resut in the timeout, you've now identified how many hops away the faulty router is. You can then do a traceroute to your mail server to see the identities of the routers at each hop and send off an email to the owner of the problem router to have it corrected.

In the meantime, you might be able to reduce the MTU on your router to avoid sending out large packets in the first place as I stated up above and as your router forum also advised. If you are still seeing the problem on your TiVo but not your Windows box, then are you sure you set the MTU on the router and not the Windows box? Setting it on Windows would only kludge around the problem for that Windows box. You could also set the MTU far lower—e.g., 576&nbsp;is the typical value used for dial-up. 1492&nbsp;is the recommended value for people using PPPoE (many DSL users).

Now that it's apparent the problem isn't with DailyMail or TiVo, I'm concerned about further cluttering up this thread with off-topic network diagnostic stuff. If you would like to pursue the issue further, it might be a good idea to continue it in a new thread over in the UK General Chit-Chat or Happy Hour forums.

[JonO]

Big thanks to Chris and Stuart for this script (plus anyone else who's contrib.), finally got it running with cron, smartctl and reporting on reddot.
Phew!

Is it possible to get a report of exactly when the last daily call was done. I see it was successful, but sometimes it's useful to know when it was done so I can tell if the EPG data is reasonably up to date?

Is this something I can hack in myself?

[del4]

Originally posted by JonO
Is it possible to get a report of exactly when the last daily call was done. I see it was successful, but sometimes it's useful to know when it was done so I can tell if the EPG data is reasonably up to date?

Is this something I can hack in myself?

Funny you should mention that, as I was in the progress of seeing if I could add that info to the script myself. Looking at phone.itcl, looks like the necessary code is in the proc PHUpdateData, so should be able to get the Last Successful Call or any of the other items listed there?

EDIT: Add the following to proc tempuptime:

global tzoffset
global version3
global db
if {$version3} {
set config "/State/PhoneConfig"
set suffix "SecInDay"
} else {
set config "/Setup"
set suffix ""
}


Retry Transaction {
set config [db $db open $config]
set LSC [dbobj $config get LastSuccessCall$suffix]
set NSC [dbobj $config get NextCallAttempt$suffix]
}
set LastSuccessful Call [clock format [expr $LSC + $tzoffset] -format "%A, %B %d at %I:%M%p"]
set NextScheduledCall [clock format [expr $NSC + $tzoffset] -format "%A, %B %d at %I:%M%p"]
set text "<tr><td class=programme>Last Successful Call: $LastSuccessfulCall<br>"
lappend message $text
set text "Next Scheduled Call: $NextScheduledCall</td></tr>"
lappend message $text

I've also added the 'Program Guide Data to' into my DailyMail

[tivo-onion]

Could you share your modifications? Would be great to bring into the dailymail_jazz module? cheers...

[del4]

Originally posted by tivo-onion
Could you share your modifications? Would be great to bring into the dailymail_jazz module? cheers...

Attached is a modified version of DailyMail_jazz.tcl with the following changes:

-adds Last Successful Call, Next Scheduled Call and Guide Data Through to status section
-adds Endpad to the list of running hacks
-if cron is running, adds list of hacks scheduled to run, e.g., DailyMail!, along with their scheduled times (only recognizes basic schedules, not the more esoteric ones possible with cron)

Also, if I might make a suggestion? I'd like to see this hack go back to its original name of dailymail.tcl as it's clear that it has evolved from sanderton's original version thanks to the contributions/suggestions of several people on this forum, so the _jazz extension is no longer necessary.

EDIT: FYI - I have not edited the heading or anything to include my changes in the 'formal' release, as I assumed tivo-onion would take care of that...

EDIT: Attachment removed

[MonTheFish]

can i just check....version .30 installed and was working fine. Replaced the file posted above, chmod 755 and rebooted tivo, now mail doesn't send....I'm I missing something here??

INTERNAL SERVER ERROR
--cut here--
action_custommail '' 'set "optmsg" "This daily email was generated manually through TiVoWeb.";set "recipient" "myemailaddyhere :)";set "recipient2" "";set "recipient3" "";set "hoursahead" "";set "submit" "Send Email";'
child process exited abnormally
while executing
"exec $preshell $command $recipient > $postcommand 2>&1"
(procedure "::action_custommail" line 44)
invoked from within
"::action_$action $chan $part $env"
("eval" body line 1)
invoked from within
"eval {::action_$action $chan $part $env}"
--cut here--

[tivo-onion]

you really need to post the generated log as that will give us some detail on where the code fell over! There is no context in the snippet you attached.

cheers

Chris

[JonO]

When installing this modified version I noted the file was expecting to be residing in a dailymail sub-dir, and needed the config file to be in a similar sub-dir
IIRC: /var/hack/dailymail/...

However I still got the following problem:

syntax error in expression "08 + 0"
while executing
"expr $h + $tzoffset"
(procedure "gettempuptime" line 154)
invoked from within
"gettempuptime"
(procedure "outputSection" line 33)
invoked from within
"outputSection 4"
(file "./dailymail_jazz.tcl" line 2563)

Seems to be in the section where it's checking the cronfile.
Is it because I don't have Tivotitle.tcl and rsync in my crontab running (line 1477)?
(Still trying to get my head round tcl language.)

[del4]

Originally posted by JonO
When installing this modified version I noted the file was expecting to be residing in a dailymail sub-dir, and needed the config file to be in a similar sub-dir
IIRC: /var/hack/dailymail/...

However I still got the following problem:

syntax error in expression "08 + 0"
while executing
"expr $h + $tzoffset"
(procedure "gettempuptime" line 154)
invoked from within
"gettempuptime"
(procedure "outputSection" line 33)
invoked from within
"outputSection 4"
(file "./dailymail_jazz.tcl" line 2563)

Seems to be in the section where it's checking the cronfile.
Is it because I don't have Tivotitle.tcl and rsync in my crontab running (line 1477)?
(Still trying to get my head round tcl language.)

It doesn't matter if TivoTitle or rsync are in your crontab file, its just that those (in addition to DailyMail) are the only hacks searched for at the moment, similar to the way in which DailyMail only looks for certain hacks to see if they're currently running. Also, the cron parsing doesn't handle all possible schedules, e.g., every third day during even months, so it may not like something in your crontab file. If you want to post it or PM it to me, I'd be happy to take a look and modify that code accordingly. Basically, I assume that the third, fourth and fifth cron parameters are *, so that only the first two matter.

As I stated in my earlier post, I made some changes to the original script to include the modifications I mentioned, but I assumed that tivo-onion would include those in the 'formal release', which people would then download. I probably should have just released a new version and called it 0.31, but didn't want to seem presumptive with my first contribution. As you pointed out, my version of DailyMail expects to find the .cfg file in /var/hack/dailymail, as I prefer to have each of my hacks in their own subdirectory.

Sorry, but I'm relatively new to this and was just trying to make a contribution after all I've learned through reading the many threads on this and other forums; my apologies if I've caused any confusion.

I'll review my script tonight and incorporate my changes better into the last version and release a v0.31 update, if that's okay? Tivo-onion?

[del4]

Has anyone else encountered problems with my modified version? Any special cron schedules that it doesn't currently support that you'd like it to? Let me know, as I'd like to incorporate any needed fixes into a v0.31 release later tonight. Also, if it seems to be working well, feel free to send me a PM to let me know that as well.

-del4

[Fozzie]

Please don't release it as v0.31. We need to have some config control here. If people are going to start making their own changes to someone elses code then unless the author incorporates those changes into the original code, you should call it something else. I'm sure that loads of people have some good ideas but releasing them and just continuing with the version numbers gets too confusing. Also, as we've seen above, custom 'tweaking' can break other things.

Thanks.

[del4]

Originally posted by Fozzie
Please don't release it as v0.31. We need to have some config control here. If people are going to start making their own changes to someone elses code then unless the author incorporates those changes into the original code, you should call it something else. I'm sure that loads of people have some good ideas but releasing them and just continuing with the version numbers gets too confusing. Also, as we've seen above, custom 'tweaking' can break other things.

Thanks.

Thanks for your response and I couldn't agree more. My only interest was in submitting some additions to the latest version for tivo-onion to include in the next release, not in creating something completely different. I think tivo-onion's done a great job documenting/managing his jazz'd version and I'm anxious for him to continue. I've sent a PM with my modifications (probably what I should have done in the first place) and removed the attachment from my previous post to try and mitigate the damage. As you said, there are lots of ideas floating around and we need a process to govern how they are incorporated...

[JonO]

Originally posted by del4
Basically, I assume that the third, fourth and fifth cron parameters are *, so that only the first two matter.
Ah that explains my problem as my cron looks something like:
00 08 * * 0-4 /tvbin/tivosh /var/hack/dailymail/dailymail_jazz.tcl
where the third field is a range and not *


I'll review my script tonight and incorporate my changes better into the last version and release a v0.31 update, if that's okay? Tivo-onion?
The version you seem to have modified was 0.25. I agree with Fozzie, I think it's better to send your mods to Tivo-Oniion for him to incorporate and sort the revision control.

Don't worry about the confusion it's part of the fun of TiVo hacking.
:confused:

BTW: Anyone know location of a diff command for TiVo?

[stuliet]

I have found a missing <TR> in the dailymail_jazz.tcl This stopped it rendering correctly in IE and FireFox when using a web based mail client.

I changed the following in the expiry section;

lappend text "<td class=programme><strong>"

to this;

lappend text "<tr><td class=programme><strong>"

in line 1314

[tivo-onion]

I have got a bit of time to focus on a new release of dailymail_jazz. Other than impovements specified in the last 3-4 pages of this thread (since the last release), has anyone got any wishes or wants that I could consider including,

cheers

Chris

[bradleyem]

howabout a tivoweb module to edit the config file?

[del4]

Here are some I've been thinking of doing:

-Consolidate the View Daily Mail and Send Daily Mail tivoweb modules into a single one called DailyMail

-Modify controlpadding.itcl to include editing the start and end padding values

-Add a new section called Recording History that displays selected items, such as 'Not Recorded', 'Deleted' or 'Won't Record' for the past XX (say 24) hours.

-Make all paths relative so that dailymail can be installed in /var/hack/dailymail or elsewhere without having to update paths in all of the .tcl and .itcl files

[tivo-onion]

follow my progress and comment en-route if you feel the need:

http://www.deepinthejungle.com/Tivo/dailymail.htm

cheers

Chris

[sanderton]

Chris, I can't help thinking that you need to start a new thread on DailyMail, with your current version always available in the first post. There's an awful lot for people to wade through here to try and find your latest version, and much of it no longer applies.

[tivo-onion]

Good idea - I was thinking along similar lines myself. If you are happy with that, it being your thread then I am happy to launch a new thread for the next release. I suspect that the moderators / administrators would have to be happy with this, and I suspect that the ideal approach would be to lock down this thread once the new one was started. Is that possible? and acceptable?

cheers

Chris

[sanderton]

Sounds a good idea to me - Gary/ozsat?

[del4]

Additional changes I've considered making:

1- I, personally, don't like to see the info at the very top of the email, e.g., Your tivo has not rebooted within the last 24 hours, and drives have no detectable problems, unless there is a problem. If the daily call info is included within the status section, there's no need to say that the last daily call was performed without error, unless there WAS an error. In other words, reserve the space at the top for any warnings that need to be brought to the user's attention, like failed calls, drive problems and a reboot.

Maybe a switch in the .cfg file as to whether this section should be verbose or warnings only?

2 - How about breaking up the program listings with a blank line with the day of the week to make it more readable? Looking at several days worth of listings in the ToDo section, it would be nice to be able to find a particular day quickly, especially if you are using the 180 hr option!

[iankb]

I think that the success status also needs to be shown, otherwise you will forget what it is checking.

If the data is broken up by day, the day should start at 6am.

[horwitz]

Originally posted by iankb
If the data is broken up by day, the day should start at 6am.
Could that be a variable?

[del4]

Originally posted by horwitz
Could that be a variable?

I, too, think a variable for the start time would be better, as some might want midnight, some 6am, some 8am...

[del4]

Originally posted by iankb
I think that the success status also needs to be shown, otherwise you will forget what it is checking.

While you want the output as is, I only want to know if something requires my attention, both of which are reasonable alternatives. That's why I suggested there be options like 'verbose' or 'warnings only' to accommodate people's preferences...

[Fozzie]

Originally posted by del4
1- I, personally, don't like to see the info at the very top of the emailI like it as it is. It's a useful quick check of the status of TiVo. If I want detailed info then I'll use Tivoweb.

[sanderton]

Originally posted by del4
I, too, think a variable for the start time would be better, as some might want midnight, some 6am, some 8am...

Most of the functions work in x hours ahead from the time DailyMail is run.

[horwitz]

Originally posted by sanderton
Most of the functions work in x hours ahead from the time DailyMail is run.
I think the "start time" stuff was in response to this:
Originally posted by iankb
If the data is broken up by day, the day should start at 6am.

Just for when to start a new day if data is split by day ...

(Though I could just be babbling ... :) )

[Snoopy]

Originally posted by sanderton
Chris, I can't help thinking that you need to start a new thread on DailyMail, with your current version always available in the first post. There's an awful lot for people to wade through here to try and find your latest version, and much of it no longer applies. It is very difficult to tell where the latest version is posted? Please advise.

[tivo-onion]

Look here (http://deepinthejungle.servehttp.com/TiVo/TiVoIndex.htm) for now.

cheers

Chris

[Snoopy]

That link returns a "cannot find server" page.

[tivo-onion]

sorry .. server went down ... is active now!

cheers

Chris

[Snoopy]

hmmm, I've never installed it and there appear to be no instructions. I guess I just copy the files and folders directly over to /tivoweb-tcl where the rest of my files reside and walla ?? Please advise. I also notice that you seem to be using 3.0b or something? Also do I need ls and ps if they already exist on my TiVo?

[tivo-onion]

Everything you need is in the zip file. There is a datasheet that tells you where to put all the files. The ps and ls files are incuded in the zip file. You do not need ls and ps if they already exist on your tivo - just make sure that you update the .cfg file to point to your ls and ps commands.

cheers

Chris

[Milhouse]

www.nmacleod.com/public/tivo now updated with the latest images from the most recent version of dailymail for anyone who needs it. :)

[gardavis]

It's down again. :confused:

Originally posted by tivo-onion
sorry .. server went down ... is active now!

cheers

Chris

[tivo-onion]

I have a new release of dailymail_jazz on the bubble, which includes features covering almost everything that has been requested over the last 2-3 weeks on this forum.

I am off on holiday v. soon, and have not got a chance to do a proper set of release notes and obviously cannot support it for the next 2 weeks. I am keen to get it out there however, so I am looking for a maximum of 5 capable and geograhically / version spread-out volunteers to beta test the new module for me over the next 2 weeks with no support.

If you could volunteer I would much appreciate it, however - I must stress that there will be little in the way of installation / usage instructions and zero support for two weeks. I am therefore looking for users who are capable, and who have used dailymail_jazz before for a reasonable period of time and are pretty familiar with it. If you could document problems, bugs and suggestions and feed them back to me on this forum then that would be great.

I am looking for a geographically and version diverse beta test team, so please specify...

- your tivo hardware + software versions
- your location ie. country
- your current dailymail_jazz version installed
- your length of time using dailymail_jazz
- your current usage of features of dailymail_jazz

...when you (if you) volunteer. I don't want to disappoint, but I will have to pick and choose to get the diversity I want - so apologies in advance.

Thanks for your assistance on this - much appreciated,

The volunteer window is open

see some of the new features in action here (http://www.deepinthejungle.com/Tivo/dailymail.htm)

cheers

Chris

[Snoopy]

Where can I find the latest beta?

[healeydave]

Crikey, some pages back, Stuart (Sanderton) mentioned he was suprised how popular this had become.

I think that was an under statement, look at this posts statistics, with nearly 23000 views and over 600 replies!
Its rapidly catching up with the generic tivo information sticky @ 39000 views which one would assume most people have and do view when they join the forum.

Thats some interest it a relatively short period of time.

[tivo-onion]

Volunteer Window Closed!

thanks for your interest,

cheers

Chris

[Mark Ward]

I've been trying very hard to get this utility working for me. I've scoured the entire thread many times and made a changes suggest but still don't seem to be able to get it going. My persistant error is:-

debug-index.itcl included
no value given for parameter "source" to "base64dec"
while executing
"base64dec"
("uplevel" body line 11)
invoked from within
"uplevel $body"
invoked from within
"transaction {uplevel $body}"
(procedure "RetryTransaction" line 5)
invoked from within
"RetryTransaction {
if {$::version3} {
set lconfig [db $db open /State/LocationConfig]
set setup [db $db open /State/ServiceConfig]
set tz ..."
(file "/var/hack/dailymail_jazz.tcl" line 2057)

I'm using TivoWebPlus Project v1.0-rc5 installed in the default /var/hack/tivoweb-tcl directory. I telnet via a turbonetcard.

Things I've tried so far:-

Downloaded smartctl, installed in /var/hack/bin & chmodded it

Added my gateway information with "route.tivo add default gw x.x.x.x" to my /etc/rc.net. where x.x.x.x is the IP address of my ISDN router (This line runs fine from the BASH prompt BTW.)

Edited dailymail_jazz.tcl to point to the bin_ppc directory to find get_space.
nosuccess so tried copying get_space to tivoweb-tcl directory and chmod 755 it. Still no success. Currently back at the the bin_ppc directory with modified .tcl.

Edited dailymail_jazz.tcl to replace "socket $mailserver 25" with "socket -myaddr x.x.x.x $mailserver 25" where x.x.x.x is my TiVos' local IP address. I'm not yet configured to connect to my TiVo from the internet as I nee to research the security implications of this, is this a problem? (My Net gateway is via an ISDN router BTW, No DSL round here :().

I used DOS Edit for all editing then dos2unix as Joe really didn't handle the large file in a user-friendly way.

I added the base64 encoded email address & password using the codes generated using the online tools listed in the datasheet.

I pinged smtp.freeserve.co.uk to get the correct smtp mail IP address for freeserve 195.92.195.153. (Freeserve.com gives a different IP address)

I was determined to work this out by myself, but I have to admit that I need a little help here. Please could someone suggest what might be wrong?

Many, many thanks,

Mark Ward.

[lcsneil]

Originally posted by Mark Ward

I pinged smtp.freeserve.co.uk to get the correct smtp mail IP address for freeserve 195.92.195.153. (Freeserve.com gives a different IP address)

Mark Ward.

From the Freeserve web site

The address of the Freeserve SMTP mail server is: smtp.freeserve.com

For what it's worth my DNS resolves both smtp.freeserve.com AND smtp.freeserve.co.uk to 195.92.195.153

Neil

[ccwf]

Hmmm, DNS for smtp.freeserve.co.uk is screwed up. That actually shouldn't affect DailyMail if you just use an IP address, but it might affect the ability of others to send mail to …@freeserve.co.uk mail addresses. $ host -t mx smtp.freeserve.co.uk
smtp.freeserve.co.uk is an alias for smtp.freeserve.net.
smtp.freeserve.net is an alias for smtp.freeserve.com.
smtp.freeserve.com is an alias for relay.pol.net.uk.
relay.pol.net.uk mail is handled by 0 relay.pol.net.uk.
$ host relay.pol.net.uk
relay.pol.net.uk has address 195.92.193.153
relay.pol.net.uk has address 195.92.195.153

[JMB]

Originally posted by Mark Ward

I'm using TivoWebPlus Project v1.0-rc5 installed in the default /var/hack/tivoweb-tcl directory.

I've been running DailyMail fine for a few months and i went and changed to TiVoWebPlus last night and now i get the same error you're getting. I'm not using Freeserve though... Any ideas anyone?!??!

Cheers,

Jason

[sanderton]

Originally posted by Mark Ward
I'm using TivoWebPlus Project v1.0-rc5 installed in the default /var/hack/tivoweb-tcl directory.

DailyMail doesn't work with TWP; check furthur back in the thread for the workaround.

[Mark Ward]

All sorted and working now :) HTML Email sent & Recieved.

Thank you so much everyone, this has added a whole new dimension to my TiVo.

One piece of advice that was really helpful was to edit dailymail_jazz.tcl & dailymail.cfg on the PC (I used the startard DOS "Edit" command) and then use dos2unix to make the .tcl unix compatible. Joe was just impossible with the large files.

If anyone else is stuck getting it going with TWP I'm sure I can now help as it's fresh in my memory.

Now to re-read again to get it going with "Cron"

Thanks again,

Mark.

[PortlandPaw]

I recommend using TextPad for general text usage and the ability to easily go back and forth between DOS and UNIX format: http://www.textpad.com/

And here's the crontab file I use. You'll notice it runs rsync and movie sort, as well as dailymail.

This is a great little hack. Enjoy it and good luck!
Dave

# /etc/crontab: system-wide crontab
# Unlike any other crontab you don't have to run the `crontab'
# command to install the new version when you edit this file.

# for TiVo: This file doesn't use a user field like system-wide crontabs
# normally do. Everything runs at uid 0 (not that it matters for TiVo).

# The following environment variables are needed for many tcl scripts to
# run. Thanks to AlphaWolf for troubleshooting this.

SHELL=/bin/sh
PATH=/sbin:/bin:/usr/sbin:/usr/bin:/var/hack/bin
MFS_DEVICE=/dev/hda10
TIVO_ROOT=""

# m h dom mon dow command
# * * * * * date >> /var/hack/cron.test.out
# Monday=1, Tuesday=2, Wednesday=3, Thursday=4, Friday=5, Saturday=6, Sunday=7

# Times are all expressed in GMT -- Maine is GMT minus 5 hours (EST)

# Five after the hour, every day, push backup of /etc onto PC
5 * * * * rsync -PavzH --numeric-ids --delete --exclude=displayfiles --exclude=apsrunning.sh /etc/. 192.168.1.10::tivo/etc/. > /var/hack/log/rsync 2>&1

# Ten after the hour, every day, push backup of /var/hack onto PC
10 * * * * rsync -PavzH --numeric-ids --delete --exclude=displayfiles --exclude=apsrunning.sh /var/hack/. 192.168.1.10::tivo/var/hack/. > /var/hack/log/rsync 2>&1

# Twenty after three a.m., Maine time, every night, update moviesearch
15 22 * * * /var/hack/bin/moviesort.tcl > /var/hack/log/moviesort 2>&1

# Fifteen after eight a.m., Maine time, every weekday, push dailymail
15 13 * * 1-5 /tvbin/tivosh /var/hack/dailymail/dailymail_jazz.tcl > /var/hack/log/dailymail_jazz 2>&1

[Mark Ward]

Just thought I'd post a summary of what I did to get dailymail working under TivoWebPlus.

All this information is somewhere in this rather extensive thread.

TiVoWebPlus Specific adjustments that worked for me (currently up to version 0.35beta)

1/ Copy the old "index.itcl" and "util.itcl" files from TivoWeb 1.9.4 and place them directly in your "/var/hack" directory.

2/ Now Edit dailymail_jazz.tcl using MS-DOS Edit command or your preferred PC editor as follows:-

3/ Search for "get_space" ... it defaults to the tivoweb-tcl directory. Change it to "/tivoweb-tcl/bin_ppc" (This is where the file is located in TWP.)

4/ Search for "socket $mailserver 25" and replace with "socket -myaddr x.x.x.x $mailserver 25" Where x.x.x.x is the IP address of your TiVo

5/ Search for "index.itcl" & "util.itcl" and amend script to point to those files in your "/var/hack" dir.

6/ Make "dailymail_jazz.tcl" unix compatible using "Dos2Unix.exe". This utility is widely available, do a google search.

I hope this makes life easier for others, it really is worth the effort.

Mark.

[Mark Ward]

@PortlandPaw - Cron script

Thanks for that, I'm sure it'll save me loads of time.

Mark.

[JMB]

Originally posted by Mark Ward
Just thought I'd post a summary of what I did to get dailymail working under TivoWebPlus.


Thanks for that Mark, I'll give it a try later...

Cheers,

Jason

[lcsneil]

Is it possible to add the time of last dial up and time of next dial up to the "Last daily call was performed without error" line in the email?

Are the variables available?

Neil

[thepatrician]

Originally posted by lcsneil
Is it possible to add the time of last dial up and time of next dial up to the "Last daily call was performed without error" line in the email?


This is going to be in the next version which is currently in beta whilst tivo-onion takes a well earned holiday. Check out this link (http://www.deepinthejungle.com/Tivo/dailymail.htm) that he posted earlier in this thread of what the new version should look like.

thepatrician

[Mark Ward]

A suggestion for Mr. TivoOnion Sir....

Would a .cfg option to allow TiVoWebPlus to be used without having to manually adjust the TCL in future versions be at all possible please?

Many thanks,

Also, I'd share & post a few replacement animated images for dailymail_jazz I created.

Some replacement GIFs (http://www.wcarrot.demon.co.uk/files/gifs4dailymail.zip)

Mark.

[alextegg]

You can always do what I did, and install TiVoWeb and TWP together. Dailymail then works with TW, and TWP is available too :D

[ayjayr]

G'day

I've installed the "jazzed dailymail program - v0.30 (24/02/2004)" and it seems to run just fine from within TW, however I get the following error when run by cron or from the command line.

couldn't read file "
": no such file or directory

Yes it appears over two lines. I turned up debuging but this is the only output that is generated.:confused:

My crontab:
SHELL=/bin/sh
PATH=/devbin:/hack/bin:/bin:/sbin:/tvbin

# The following environment variables are needed for many tcl scripts to
# run. Thanks to AlphaWolf for troubleshooting this.

MFS_DEVICE=/dev/hda10
TIVO_ROOT=""

My cron entry:
0 8 * * 1-5 /var/hack/dailymail_jazz.tcl >> /var/log/dailymail_jazz.log 2>&1

Suggestions, other debuging tip or how to trace appreciated.

One other question is EndPadPlus supported or are some modifications required?

Oh, great program by the way :up:

[sanderton]

Sounds like you copied it to your tivo with the FTP client in ASCII/TEXT mode, or possibly edited it on your PC before copying it.

[alextegg]

What's endpadplus? :eek:

[sanderton]

The dual-tuner DTivo version which falcontx developed.

[ayjayr]

Doh! :o

WS_FTP set to auto...

Thanks Sanderton, strange how it didn't appear to look any different in vi. :eek:

Oh, I got endpadplus working in DailyMail_jazz I needed to change "endpadexecfilename" :o

Thanks again

[Snoopy]

Is there a utility that can tell me on an add-hoc basis what conflicts TiVo has run into for say the past week?

[sanderton]

Just look in recording history via Tivoweb.

[del4]

IIRC, episode numbers are available for SA but not DTivos. If they're available, how about including them in the information provided about each show, perhaps between the show name and date/time showing?

[lcsneil]

Is anyone else using dailymail triggered by cron?

It all started fine but on Fri and this morning no sign of my daily email.

The cron logs appear to be OK:-

STARTUP (fork ok)
cron (03/21-06:58:00-216) CMD (/var/hack/dailymail_jazz.tcl &)
cron (03/22-06:58:00-3532) CMD (/var/hack/dailymail_jazz.tcl &)
cron (03/23-06:58:00-6887) CMD (/var/hack/dailymail_jazz.tcl &)
cron (03/24-06:58:00-10516) CMD (/var/hack/dailymail_jazz.tcl &)
cron (03/25-06:58:01-14080) CMD (/var/hack/dailymail_jazz.tcl &)
cron (03/26-06:58:00-17765) CMD (/var/hack/dailymail_jazz.tcl &)
cron (03/27-06:58:00-21301) CMD (/var/hack/dailymail_jazz.tcl &)
cron (03/28-06:58:01-24659) CMD (/var/hack/dailymail_jazz.tcl &)
*system* (03/28-09:12:00-114) RELOAD (/var/hack/etc/crontab)


Does dailymail generate a log for automated emails? If so where do I find it?

I have managed to find the log for when I hit the 'manual email' from the Tivoweb interface; but the auto sent one doesn't seem to be there.

Neil

[PortlandPaw]

I just commented on this...
http://www.tivocommunity.com/tivo-vb/showthread.php?postid=1819685#post1819685

I hope this addresses your problem.

[lcsneil]

Ah yes thanks, the re-direct of output.

I'll give it a go!

Neil

[mbriody]

I'm feeling rather pleased with myself having managed to get DailyMail working at almost the first attempt with TivoWeb Plus rc4, thanks to Mark Ward's summary. I now have a small issue which isn't really a DailyMail or TiVo issue.

I have a dynamic ADSL IP address and use dyndns.org to maintain the external IP. I have my router configured to forward port 80 to the internal IP of my TiVo. This works fine and allows me to access TivoWeb remotely.

My problem is that the dyndns IP doesn't work if I try to access TivoWeb (and hence the links in the DailyMail email) locally i.e. from a PC or laptop on the same subnet as my TiVo.

If I configure DailyMail to use the local IP of my TiVo then I'm sure that would work locally but of course it wouldn't work from a remote PC.

So my question is, is there a way to access TiVoWeb from a local PC but using the external IP? Is there a way to make access to the remote IP use the local address instead? I'm guessing this is something to do with routing but I'm no expert at this.

[LJ]

You should be able to access it by domain name... Assuming you're using a flavour of Windows add an entry into your 'hosts' file. (Lives in C:\windows\system32\drivers\etc on XP).

Add a line similar to this:

192.168.123.999 your.external.domain.name

Should work straight away without rebooting. (Be careful to save the file without any extension)

[lcsneil]

Originally posted by LJ
You should be able to access it by domain name... Assuming you're using a flavour of Windows add an entry into your 'hosts' file. (Lives in C:\windows\system32\drivers\etc on XP).

Add a line similar to this:

192.168.123.999 your.external.domain.name

Should work straight away without rebooting. (Be careful to save the file without any extension)

Yes that should work as I had exactly the same problem and that was the way I solved it by putting the domain name in my hosts file to point at the Tivo. (192.168.0. etc)


Neil

[mbriody]

[LATER]

Now working fine - must have been some sort of cacheing.

Thanks for the help.

--------------

My hosts file says it should be domain then address, is this correct?

Anyway I tried it this way and if I ping xxx.dyndns.org it gives me the local TiVo IP (as I want) but if I enter http://xxx.dyndns.org into my browser it takes me to my router's config page.

Originally posted by LJ
You should be able to access it by domain name... Assuming you're using a flavour of Windows add an entry into your 'hosts' file. (Lives in C:\windows\system32\drivers\etc on XP).

Add a line similar to this:

192.168.123.999 your.external.domain.name

Should work straight away without rebooting. (Be careful to save the file without any extension) t

[LJ]

Try http://xxx.dyndns.org/ - i.e. with a '/' on the end.

If that doesn't work: what version of Windows & version/type of browser are you running and what's your DNS server set to (run 'ipconfig /all')?

[mbriody]

All okay now, see above. Thanks.

Now to tackle cron...

[lcsneil]

My hosts file (winnt/system32/drivers/etc) reads:-
192.168.0.200 tivo
192.168.0.200 xxxx.no-ip.org

and definitely works...

Soooo try clearing your browser cache, closing down your browser and re-open it.

Neil

[mbriody]

Just noticed, if I view the email within TivoWeb I get graphics but in the actual email they are missing.

Any ideas?

[mbriody]

Just noticed, if I view the email within TivoWeb I get graphics but in the actual email they are missing.

Any ideas?

[lcsneil]

Originally posted by mbriody
Just noticed, if I view the email within TivoWeb I get graphics but in the actual email they are missing.

Any ideas?

You need to host the graphics on a publically available server or on your local machine if you are only reading the email locally.

What setting did you use in the dailymail.cfg file for the graphics location?

(Half way down :-

# set web server based variables
set dmailTivoURL "http://xxxxx.no-ip.org" ;# the url of your tivo (no forward slash at end required)
set dmailGraphicsURL "http://www.xxxxxxx.co.uk/tivo/images" ;# the url of where your graphics are (no forward slash at end)

)

Or if you only read it from your own PC then I guess http://localhost/imageslocation


Neil

[mbriody]

Problem found - my webmail client was configured to block graphics.

Now working fine with cron too.

[petestrash]

OK,

Yes I am dumb when it comes to Linux, but I am trying to learn more through playing with TiVo.

I have skimmed through 33 pages of this thread, but I still cannot get dailymail_jazz to run.

I unzipped the file, then FTP'ed everything from the directory to a new directory "/var/hack/dailymail_jazz/" in binary mode.

I edited dailymail.cfg with ms-dos edit.

But my TiVo wont run the dailymail_jazz.tcl file.

[TiVo [p0] /var/hack/dailymail_jazz]# ls
Jazzed Daily Mail Datasheet v0.30.htm dailymail_jazz.tcl
TivoDailyMail senddailymail.itcl
controlpadding.itcl viewdailymail.itcl
dailymail.cfg viewhtml.itcl
[TiVo [p0] /var/hack/dailymail_jazz]# chmod 755 dailymail_jazz.tcl
[TiVo [p0] /var/hack/dailymail_jazz]# dailymail_jazz.tcl petestrash@hotmail.com
bash: dailymail_jazz.tcl: command not found
[TiVo [p0] /var/hack/dailymail_jazz]#

It's 3am here and I'm not thinking straight, I'm sure it's something simple I am not doing. But can't figure it out.

Peter.

[LJ]

Try ./dailymail_jazz.tcl petestrash@hotmail.com - Linux doesn't run commands in the current directory unless it's in the path. :p :D

[lcsneil]

Originally posted by petestrash
OK,

Yes I am dumb when it comes to Linux, but I am trying to learn more through playing with TiVo.

I have skimmed through 33 pages of this thread, but I still cannot get dailymail_jazz to run.

I unzipped the file, then FTP'ed everything from the directory to a new directory "/var/hack/dailymail_jazz/" in binary mode.

I edited dailymail.cfg with ms-dos edit.

But my TiVo wont run the dailymail_jazz.tcl file.

[TiVo [p0] /var/hack/dailymail_jazz]# ls
Jazzed Daily Mail Datasheet v0.30.htm dailymail_jazz.tcl
TivoDailyMail senddailymail.itcl
controlpadding.itcl viewdailymail.itcl
dailymail.cfg viewhtml.itcl
[TiVo [p0] /var/hack/dailymail_jazz]# chmod 755 dailymail_jazz.tcl
[TiVo [p0] /var/hack/dailymail_jazz]# dailymail_jazz.tcl petestrash@hotmail.com
bash: dailymail_jazz.tcl: command not found
[TiVo [p0] /var/hack/dailymail_jazz]#

It's 3am here and I'm not thinking straight, I'm sure it's something simple I am not doing. But can't figure it out.

Peter.

Suggest a couple of things...

Is /var/hack in your path?

Try running it by /var/hack/dailymail_jazz/dailymail_jazz.tcl [email]

The other thing in the back of my mind is that a file I installed recently wasnt unix style

Try finding DOS2UNIX.EXE (use Google) and on you PC run the dos2unix.exe dailymail_jazz.tcl

and then ftp it to your tivo and try again

(also surely it should be ./dailymail_jazz.tcl to run it if you are in the correct directory already?)


Neil

(OK LJ beat me to it! :) )

[petestrash]

Thanks LJ & Icsneil,

Try ./dailymail_jazz.tcl petestrash@hotmail.com - Linux doesn't run commands in the current directory unless it's in the path.

Didn't realise this, thought if in current directory path not needed.

That fixed the non running issue.

The other thing in the back of my mind is that a file I installed recently wasnt unix style. Try finding DOS2UNIX.EXE (use Google) and on you PC run the dos2unix.exe dailymail_jazz.tcl

I needed to do this to the cfg file I edited. Should have just used joe.

That got it running ok, I'll check the rest tomorrow. sleep time now 4:00am

Thanks,

Peter.

[ccwf]

Originally posted by petestrash
Didn't realise this, thought if in current directory path not needed. Linux and UNIX require the current directory to be explicitly in the path if so desired because doing otherwise leaves you open to a certain type of attack. DOS and Windows always assume the current directory is in the path because they are not so concerned with security.

[petestrash]

Thanks for the clarification Charles,

On another point, why can't the graphics files be stored and served from the tivo.

Peter.

[sanderton]

They can, if you have all your proxies etc set up right; but it means you'd have to log in to read the e-mail.

[foddy]

Originally posted by petestrash
I needed to do this to the cfg file I edited. Should have just used joe.

If you're editing Unix files on Windows, I'd recommend PFE32 (Programmer's File Editor). It's free, can be run without installing and maintains the file format which can be clearly seen in the status bar. You can also use it to change from DOS to Unix format with Save As.

It's available at: http://www.lancs.ac.uk/staff/steveb/cpaap/pfe/ - don't be put off by when it was last updated!

[tivo-onion]

Originally posted by foddy
If you're editing Unix files on Windows, I'd recommend PFE32 (Programmer's File Editor). It's free, can be run without installing and maintains the file format which can be clearly seen in the status bar. You can also use it to change from DOS to Unix format with Save As.

It's available at: http://www.lancs.ac.uk/staff/steveb/cpaap/pfe/ - don't be put off by when it was last updated!

My fave editor is textpad - you can save files as UNIX files no problem. Has somenice features too.

You can find it at http://www.textpad.com/ and the "free" evaluation lasts forever!

[lcsneil]

For the last few days my cron generated dailymail hasn't been working and looking at the logs it seems that when trying to send the email via the ISP it is causing the Tivo to reboot. This is repeatable.

However, if I do a manual generate dailmail it works fine.

Any ideas?

The output of the log is as follows:-

debug-subject: >>TiVo status e-mail for Saturday April 03, 2004<<
debug-attempting to open socket 25 to mailserver specified >>62.241.160.73<<
debug-got reply : >>220 colossus.systems.pipex.net ESMTP Postfix<<
debug-connected
debug-got reply : >>250 colossus.systems.pipex.net<<
debug-helo acknowledged
debug-got reply : >>250 Ok<<
debug-from acknowledged
debug-got reply : >>250 Ok<<
debug-to acknowledged
debug-got reply : >>354 End data with <CR><LF>.<CR><LF><<
debug-sending message
debug-building header
debug-about set recipient
debug-recipient set
debug-building content
debug-html starts
debug-body starts
Dumping mempool to /tmp/BlockFailure.3432
Tmk Assertion Failure:
BlockFailure, line 1771 ()
Tmk Fatal Error: Thread tivosh <3432> died due to signal -2



Neil

[LJ]

I saw that happen when I changed to a newer version of the cachecard drivers. The drivers were generating so many warning messages that DailyMail couldn't handle so much data! In my version of DM it was the foreach loops that couldn't deal with counting the numbers of lines in the error string. Not sure if the version of DM you're running uses foreach loops to split strings? Basically something's out of memory somewhere.

[lcsneil]

Originally posted by LJ
I saw that happen when I changed to a newer version of the cachecard drivers. The drivers were generating so many warning messages that DailyMail couldn't handle so much data!

I use Turbonet and haven't updated anything that I am aware of recently. But I get the idea.

So any ideas what I can do about it?

Tried using ps aux to see what was running but using Windoze Telnet it truncates the items beyond the window so I see tivosh /var/hack/tivo... is running but I cant tell what as the characters after the 'tivo' bit are truncated - even if I pipe them to a file.

Mind you not sure quite what I would be looking for anyway from the output of ps aux - things with a lot of memory usage or % CPU ?

Neil

[tivo-onion]

Neil,

can you set debugging to "3" and get a bit more info on where it flops,

cheers

Chris

[tivo-onion]

Neil,

can you set debugging to "3" and get a bit more info on where it flops,

cheers

Chris

[lcsneil]

Chris - have done that - you have a PM

[tivo-onion]

Thanks for the PM. I inspected the log file and discovered exactly where it broke down:

relevant LOG segment:
---------------------------------------------------------------------------

debug-html starts
debug-body starts
Dumping mempool to /tmp/BlockFailure.185
Tmk Assertion Failure:
BlockFailure, line 1771 ()
Tmk Fatal Error: Thread tivosh <185> died due to signal -2

---------------------------------------------------------------------------

relevant CODE segment:
---------------------------------------------------------------------------

if {$debuglvl>1} { puts "[clock format [clock seconds] -format {%H:%M:%S} -gmt true]-debug-body starts" }
puts $chan "<body>"
flush $chan
if {$debuglvl>2} { puts "[clock format [clock seconds] -format {%H:%M:%S} -gmt true]-debug---------------------------------------------------------------------------------------------------------------------" }

---------------------------------------------------------------------------

I have to say that I am stumped. I am assuming it is breaking down on the execution of the puts $chan "<body>" command, and I see no reason for it to error here rather than any other location. I can only think that is some kind of memory probem, but it is happening exceptionally early in the process. I have had the same error previously due to a very very very large email too large as it happens.

Apologies, but it is going to take a more knowledgable person than me to figure this out, especially since it woks fine on a manual tivo-web based invokation,

sorry,

Chris

[lcsneil]

This just re-confirms my BS Standard Idiot classification for guaranteed performance at breaking software.

If you ever want s'ware testing to the extreme - just ask me.

(I'm imfamous for it amongst my suppliers at work!)


Neil
"Bummer said Dougal"

[sanderton]

You could try explicitly setting the buffer for $chan, if you haven't already.

[tivo-onion]

how would we go about doing that?

cheers

Chris

[sanderton]

This will fluch the buffer at ever line ending and/or at 4k max size (from memory, check syntax!)

fconfigure $chan -buffering line -buffersize 4096

[tivo-onion]

Originally posted by lcsneil
This just re-confirms my BS Standard Idiot classification for guaranteed performance at breaking software.

If you ever want s'ware testing to the extreme - just ask me.

(I'm imfamous for it amongst my suppliers at work!)


Neil
"Bummer said Dougal"


Try this beta test version (LINK REMOVED) and see if it is any better. I have added in the buffer related command that Stuart suggested.

cheers

Chris

[Prof. Yaffle]

Chris, I have an admission to make. Out of curiosity I tried the Beta version you posted above just to be nosey. I tried the Config Editor in TiVoweb and couldn't get it to save any changes. When I later rebooted my TiVo it wouldn't run TiVoweb. After much headscratching I by chance looked at the rc.sysinit.author.edit created by Stuart's Startup Editor and found it had been replaced by the modified config file from Dailymail. It's entirely my fault for being nosey and you probably already know about it but I thought I'd let you know just in case.

[lcsneil]

Originally posted by tivo-onion
Try this beta test version (http://deepinthejungle.servehttp.com/TiVo/dailymail v0.34 beta test.zip) and see if it is any better. I have added in the buffer related command that Stuart suggested.

cheers

Chris

Nope :(

Rebooted - have PMed you the log file Tivo-Onion


Neil

[lcsneil]

Originally posted by Prof. Yaffle
Chris, I have an admission to make. Out of curiosity I tried the Beta version you posted above just to be nosey. I tried the Config Editor in TiVoweb and couldn't get it to save any changes. When I later rebooted my TiVo it wouldn't run TiVoweb. After much headscratching I by chance looked at the rc.sysinit.author.edit created by Stuart's Startup Editor and found it had been replaced by the modified config file from Dailymail. It's entirely my fault for being nosey and you probably already know about it but I thought I'd let you know just in case.

Not sure I understand what you're saying. I presume you mean startup editor?

I can save OK with it (thought this was independent of Dailymail)

This beta version seems to work same as previous versions for me.

Neil

[tivo-onion]

Neil,

I have inspected the log, and I am again stumped. The code seems to have errored at a completely unrelated point than the last time it fell over:

06:16:48-debug-permitted item found in line : >>dailymail_jazz.tcl<<
06:16:48-about to split cron line into parameter items
06:16:48-debug-cron split successfully into individual items
06:16:48-debug-this item is valid - not comment
06:16:48-debug-minute parameter : >>25<<
06:16:48-debug-hour parameter : >>18<<
06:16:48-debug-day of month parameter : >>*<<
06:16:48-debug-month parameter : >>*<<
06:16:48-debug-day of week parameter : >>*<<
06:16:48-debug-checkpoint 001
06:16:48-debug-checkpoint 006
06:16:48-debug-checkpoint 008
06:16:48-debug-compiling to do list
06:16:48-debug-starting main to-do loop
Dumping mempool to /tmp/BlockFailure.263
Tmk Assertion Failure:
BlockFailure, line 1771 ()
Tmk Fatal Error: Thread tivosh <263> died due to signal -2

This time it fell over whilst parsing the cron file? I have no idea why - but it looks like some kind of memory related issue again. Could it be related to the creation of the log file? The only other thing I can think of is to take the logging level down to "0" in the cfg file and try that. Otherwise, I have no idea!

cheers,

Chris

[tivo-onion]

Originally posted by Prof. Yaffle
Chris, I have an admission to make. Out of curiosity I tried the Beta version you posted above just to be nosey. I tried the Config Editor in TiVoweb and couldn't get it to save any changes. When I later rebooted my TiVo it wouldn't run TiVoweb. After much headscratching I by chance looked at the rc.sysinit.author.edit created by Stuart's Startup Editor and found it had been replaced by the modified config file from Dailymail. It's entirely my fault for being nosey and you probably already know about it but I thought I'd let you know just in case.

Prof.,

naughty naughty! But thanks anyway ... it seems that I was accidentally overloading the same "edit_save" procedure the Stuart (Sanderton) was using for the other update script. I have updated the relevant scripts - so thanks for that! I did not have the other edit script installed at the time, so I did not get the same problem!

cheers

Chris

[sanderton]

Memory is most likely, but don't rule out a HD fault either.

[mbriody]

Is this Startup Editor a new feature in this beta or have I missed something? I don't have any menu item for this in my TivoWeb.

Anyway it sounds useful!

Originally posted by lcsneil
Not sure I understand what you're saying. I presume you mean startup editor?

I can save OK with it (thought this was independent of Dailymail)

This beta version seems to work same as previous versions for me.

Neil

[tivo-onion]

Well, my hand has been forced - mostly my own fault for posting a link to a beta version. I should make it availble to the world at large, and so here it is: Version (beta) 0.35 of Dailymail_Jazz and associated files.

All the detailed are in the readme in the zip file, but the main new features and fixes are:
[list=1]
new 'managedailymail.itcl' module that replaces all previous tivoweb modules except 'controlpadding.itcl' which is optional. This module is a lot more sophisticated, and allows you to edit the config file as well as provides other key capabilities, including picking up default values from the config file, as long as it is placed on one of the permitted directory structures.
a more sohisticated 'controlpadding.itcl' module.
a revamped config file with more detailed information and a better structure.
american spelling / date option - see 'yankspeak' variable in the confile file.
fixed some spelling mistakes
times on debugging lines
added stuliet's <tr> expiry section fix
added debugging when sending message body if deguglvl is bigger than 2
added "httpd-tt.tcl" for tivoweb running hacks suggestion by PortlandPaw
added sandertons pathname function so the directory of the .cfg file need not be specified and other local files - as long as in same directory
endpad and noreddot added to running hacks view
added view cron task list courtesy of del4
addded extra daily call functions courtesy of del4
added record list (rejection list) options section- via variable in .cfg file
added daily list seperator capability with offset - via variable in .cfg file
added verbose vs alert only bulletin options - via variable in .cfg file
shortened name on manage daily status email function
added in max buffer length / buffer configuration for email sending
made cron reading and display of schedule optional - via variable in .cfg file
added in more debugging around endpad routines
added optionality on previous and future sections in rejected recording list - via variable in .cfg file
fixed editor save / edit issues found in beta test
[/list=1]

The file is available for download here. (http://deepinthejungle.servehttp.com/TiVo/dailymail v0.35.6 beta.zip)

Remember - read the README for installation and update information!

Enjoy & please feed any further comments back,

cheers

Chris

[mbriody]

Getting a crc error on extract. Tried the latest Winzip and WinRar.

Forget that, just redownloaded it and all is well.

[tivo-onion]

cannot replicate that error - seems to unzip and extract fine. Is zipped using winzip 8.0. Try downloading it again,

cheers

Chris

[Prof. Yaffle]

Originally posted by tivo-onion
Well, my hand has been forced - mostly my own fault for posting a link to a beta version.

Sorry :D

[mbriody]

I'm using TWP v1.0 and made the same mod's as for last version of DailyMail which are detailed here (http://www.tivocommunity.com/tivo-vb/showthread.php?s=&postid=1819709)

This time I got this error:

10:02:56-debug-need to look for overlapping programs with endpad
10:02:59-debug-29 items to investigate for endpad programme overlapping
10:02:59-debug-starting main to-do loop
10:03:02-debug-compiling expiration list
10:03:05-debug-compiling conflicts list
10:03:27-debug-started record history procedure
10:03:27-debug-mintime >>1081073007<<
10:03:27-debug-maxtime >>1081245807<<
can't read "cancelreasons": no such variable
while executing
"lindex $cancelreasons [expr $creason - 1]"
("default" arm line 1)
invoked from within
"switch $creason {
2 { set reason "Duplicate" }
5 { set reason "Power Was Off" ; set findalt 1 }
12 { set reason "Deleted" }
14 { set r..."
("uplevel" body line 50)
invoked from within
"uplevel $body"
invoked from within
"ForeachMfsFile fsid name type "/Recording/History" "" {
set recdate [split $name ":"]
regsub {^(-?)0+([1-9])} [lindex $recdate 1] {\1\2} rectime
..."
(procedure "recordhistory" line 37)
invoked from within
"recordhistory"
(procedure "outputSection" line 79)
invoked from within
"outputSection 4"
(file "./dailymail_jazz.tcl" line 3523)
bash-2.02#

The variable "cancelreasons" looks new from the previous version and I can't find reference to it anywhere else. Any ideas?

[tivo-onion]

Fixed, just updated 0.35 beta zip file in the previous post. Try again - only the dailymail_jazz.tcl file has changed.

cheers

Chris

[Prof. Yaffle]

Chris,

If I run the Beta with the Cron list switched on I get this :-

13:15:06-debug-perform ls
13:15:06-debug-the command being executed is >>exec /var/hack/bin/ls -ls /var/log/endpad.log<<
13:15:06-debug-ls output : >> 23 -rw-r--r-- 1 0 0 22507 Apr 6 13:15 /var/log/endpad.log<<
13:15:06-debug-log file found
13:15:06-debug-endpad logfile status : >>ok<<
13:15:06-debug-checking for new messages in tivo central
13:15:06-debug-reading the temperature, calculating uptime, checking what's running
13:15:06-debug-about to run thermal check
13:15:07-debug-thermal check run
13:15:07-debug-about to run uptime check
13:15:07-debug-uptime check run
13:15:07-debug-about to run ps
13:15:08-debug-ps run
13:15:08-debug-hack found >>tnlited<<
13:15:08-debug-hack found >>httpd-tt.tcl<<
13:15:08-debug-hack found >>tivoftp<<
13:15:08-debug-hack found >>cron<<
13:15:08-debug-hack found >>endpad.tcl<<
13:15:08-debug-about to parse crontab file
13:15:08-debug-line : >>## /etc/crontab: system-wide crontab<<
13:15:08-debug-line : >># Unlike any other crontab you don't have to run the `crontab'<<
13:15:08-debug-line : >># command to install the new version when you edit this file.<<
13:15:08-debug-line : >><<
13:15:08-debug-line : >># for TiVo: This file doesn't use a user field like system-wide crontabs<<
13:15:08-debug-line : >># normally do. Everything runs at uid 0 (not that it matters for TiVo).<<
13:15:08-debug-line : >><<
13:15:08-debug-line : >>SHELL=/bin/sh<<
13:15:08-debug-line : >>PATH=/sbin:/bin:/usr/sbin:/usr/bin:/var/hack/bin<<
13:15:08-debug-line : >><<
13:15:08-debug-line : >># The following environment variables are needed for many tcl scripts to<<
13:15:08-debug-line : >># run. Thanks to AlphaWolf for troubleshooting this.<<
13:15:08-debug-line : >><<
13:15:08-debug-line : >>MFS_DEVICE=/dev/hda10<<
13:15:08-debug-line : >>TIVO_ROOT=""<<
13:15:08-debug-line : >><<
13:15:08-debug-line : >># Actual crontab entries below. This sample should append a date to<<
13:15:08-debug-line : >># a file every ten minutes.<<
13:15:08-debug-line : >><<
13:15:08-debug-line : >># m h dom mon dow command<<
13:15:08-debug-line : >>11 08 * * 1-7 /var/hack/dailymail_jazz.tcl > /var/log/dailymail 2>&1 &<<
13:15:08-debug-permitted item found in line : >>dailymail_jazz.tcl<<
13:15:08-about to split cron line into parameter items
13:15:08-debug-cron split successfully into individual items
13:15:08-debug-this item is valid - not comment
13:15:08-debug-minute parameter : >>11<<
13:15:08-debug-hour parameter : >>08<<
13:15:08-debug-day of month parameter : >>*<<
13:15:08-debug-month parameter : >>*<<
13:15:08-debug-day of week parameter : >>1-7<<
13:15:08-debug-checkpoint 001
13:15:08-debug-checkpoint 006

If I run it from bash I get the above with this on the end:- www.karl.tracey.dsl.pipex.com/dmerror.JPG

If I run it with Cron list set to false it works perfectly.

Also, when I use the Manage E-mail section of TiVoweb in Internet Explorer, after running the generate email option it duplicates the menu at the top but inverts the colours. If I try it in Mozilla it duplicates the menu but leaves the colours as is.

Example :- www.karl.tracey.dsl.pipex.com/dailymail.JPG

[PortlandPaw]

I saw the same thing (split screen). It comes from not terminating the html block properly and starting a new one. Easily fixed.

[tivo-onion]

Prof,

sorry ... do you mean that with that with the cron stuff switch on it errors?

If so, please could you run dailymail_jazz at the tivo BASH# prompt and tell me what errors you get out ... if there is any more detail,

cheers

Chris

[tivo-onion]

Ahhh! a String To Number conversion error! I have a pathetic request : I do not know how to do a string to number conversion in tcl? Can anyone help with this. Sorry for my stupidity here!

[mbriody]

Tried the 2nd beta with TWP (after edits) and the last problme is fixed but now I get this:

14:11:16-debug-29 items to investigate for endpad programme overlapping
14:11:16-debug-starting main to-do loop
14:11:19-debug-compiling expiration list
14:11:23-debug-compiling conflicts list
14:11:49-debug-started record history procedure
14:11:49-debug-mintime >>1081087909<<
14:11:49-debug-maxtime >>1081260709<<
can't scan path (0x00070009)

while executing
"mfs scan $dirName -start $prefix -count 50"
("uplevel" body line 1)
invoked from within
"uplevel $body"
invoked from within
"transaction {uplevel $body}"
(procedure "RetryTransaction" line 5)
invoked from within
"RetryTransaction {
if { [catch {mfs scan $dirName -start $prefix -count 50} batch] } {
global errorCode errorInfo
if {..."
(procedure "ForeachMfsFile" line 9)
invoked from within
"ForeachMfsFile recfsid name type "/Recording/Active" "4:$date:$timestr:" {
RetryTransaction {
set rec [db $db openid $recfsid]
set show [db..."
(procedure "alt_showing" line 12)
invoked from within
"alt_showing $id $id2"
("uplevel" body line 70)
invoked from within
"uplevel $body"
invoked from within
"ForeachMfsFile fsid name type "/Recording/History" "" {
set recdate [split $name ":"]
regsub {^(-?)0+([1-9])} [lindex $recdate 1] {\1\2} rectime
..."
(procedure "recordhistory" line 41)
invoked from within
"recordhistory"
(procedure "outputSection" line 79)
invoked from within
"outputSection 4"
(file "./dailymail_jazz.tcl" line 3528)
bash-2.02#

[tivo-onion]

mbriody,

see if you can perform this on your version of tivoweb:

http://###.###.###.###/history/list/all

where ###.###.###.### is you tivo's ip!

this is the standard recording history function that I have nabbed the code from to do the rejected recording list, so I would be interested if it works!

let me know,

Is anyone else having the same problem,

cheers

Chris

[Prof. Yaffle]

Originally posted by tivo-onion
Prof,

sorry ... do you mean that with that with the cron stuff switch on it errors?

If so, please could you run dailymail_jazz at the tivo BASH# prompt and tell me what errors you get out ... if there is any more detail,

cheers

Chris

Yeap, with set cronlistrequired true

set to true it bombs out and judging by the Ahhh! above I assume you've seen the edited post with a screen grab in of it running from Bash?

[tivo-onion]

No worries prof., working on a fix!

Are you having any problems with the rejected recordings / recording history list at all?

cheers

Chris

[mbriody]

Nope, I get this:

INTERNAL SERVER ERROR
--cut here--
action_history '/list/all' ''
no such object: {CONFLICT err=errTmActiveLockConflict}
while executing
"dbobj $series fsid"
(procedure "history_showinfo" line 21)
invoked from within
"history_showinfo $show inf"
("uplevel" body line 5)
invoked from within
"uplevel $body"
invoked from within
"transaction {uplevel $body}"
(procedure "RetryTransaction" line 5)
invoked from within
"RetryTransaction {
set rec [db $db openid $fsid ]
set creason [dbobj $rec get CancelReason]
set show [dbobj $rec get Showing]
..."
("uplevel" body line 6)
invoked from within
"uplevel $body"
invoked from within
"ForeachMfsFile fsid name type "/Recording/History" "" {
set recdate [split $name ":"]
regsub {^(-?)0+([1-9])} [lindex $recdate 1] {\1\2} recti..."
(procedure "::action_history" line 69)
invoked from within
"::action_$action $chan $part $env"
("eval" body line 1)
invoked from within
"eval {::action_$action $chan $part $env}"
--cut here--



Originally posted by tivo-onion
mbriody,

see if you can perform this on your version of tivoweb:

http://###.###.###.###/history/list/all

where ###.###.###.### is you tivo's ip!

this is the standard recording history function that I have nabbed the code from to do the rejected recording list, so I would be interested if it works!

let me know,

Is anyone else having the same problem,

cheers

Chris

[Prof. Yaffle]

It seems to be picking the info up okay. I've only tried it a couple of times though. I'll try it a bit more tonight.

[tivo-onion]

Originally posted by mbriody
Nope, I get this:

INTERNAL SERVER ERROR
--cut here--
action_history '/list/all' ''
no such object: {CONFLICT err=errTmActiveLockConflict}
while executing....................


Hmm...

it looks like you have a more serious problem here, and I am not sure what the answer is I am afraid. Could this be related to your earlier problem with running from the cron, and be caused by some kind of disk error as sanderton suggested.

What version on tivoweb are you using?

Can you navigate to Home >> User Interface >> Recording History at all in tivoweb, and what happend if you select any of the options here?

It could also be related to tivowebplus which I do not have, so if you have a slightly different module in tivowebplus to get recording history, can you send me the file that tivowebplus uses to generate it so I can take a look!

cheers

Chris

[tivo-onion]

Originally posted by Prof. Yaffle
Chris,

If I run the Beta with the Cron list switched on I get this :-

13:15:06-debug-perform ls
13:15:06-debug-the command being executed is >>exec /var/hack/bin/ls -ls /var/log/endpad.log<<
........
13:15:08-debug-checkpoint 001
13:15:08-debug-checkpoint 006

If I run it with Cron list set to false it works perfectly.


Prof,

I have updated the beta with fixes to your problems .. .download from the same post as before. You will need to replace all .itcl files and the dailymail_jazz.tcl file.

let me know if it solves your cron related problems and your double header problems,

cheers

Chris

[sanderton]

Originally posted by mbriody
Nope, I get this:

INTERNAL SERVER ERROR
--cut here--
action_history '/list/all' ''
no such object: {CONFLICT err=errTmActiveLockConflict}
while executing
"dbobj $series fsid"


Do a Full Reload of TiVoWeb; repeat until fixed.

TivoWeb loads a ton of data into memory from MFS when it loads, but it doesn't validate it very well - so if there was a harmless Active Lock (ie, database busy) error it stores the error message instead of the data.

Most common when TW loads from startup as the db is often busy at boot time.

[mbriody]

Something screwy going on here. I think the last History failure may have been a red herring.

I am using TivoWebPlus v1.0. I think you're thinking of someone else re: the cron/disk problem.

All of the other History commands work by the way. I've very rarely used them though.

What I've just experienced is this:

Reboot TiVo
Perform History/List/All - no problem.
Run DailMail - get the same error as above.
Perform History/List/All - no problem.

DailyMail still exhibiting the same issue and TiVoWeb History is now working okay but it does take a long time to come back - my history goes back to December (is this usual?).

Originally posted by tivo-onion
Hmm...

it looks like you have a more serious problem here, and I am not sure what the answer is I am afraid. Could this be related to your earlier problem with running from the cron, and be caused by some kind of disk error as sanderton suggested.

What version on tivoweb are you using?

Can you navigate to Home >> User Interface >> Recording History at all in tivoweb, and what happend if you select any of the options here?

It could also be related to tivowebplus which I do not have, so if you have a slightly different module in tivowebplus to get recording history, can you send me the file that tivowebplus uses to generate it so I can take a look!

cheers

Chris

[tivo-onion]

Apologies, I am getting mixed up ... the cron / disk problem is nothing to do with you. I am juggling too many balls today :-)

can you send, or provide me with a link to, the the tivowebplus .itcl module that contains your history function so I can inspect, identify any differences and update dailymail_jazz if necessary,

cheers

Chris

[sanderton]

The "can't scan path 00x" etc error is mfs scan's versions of "database is busy"

If that code comes hard on the heels of a major bit of database access on a machine with a lot of stuff going on in /Recordings/Active then you might well get it. If your History goes back to December then its a fair bet there's a lot in it! (It will go back to the oldest item you have deleted in the last 28 days).

I've found on code which slaps the db hard, putting a few "after 10" s in in strategic places just to put the brakes on the code a bit can give the previous db access time to finish up.

[Krypt Keeper]

Hello, first let me say this is a great program & thanks!

Basics - I am running this on a HDVR2, S/W 3.1.1b, TWP in a non-standard location, TW 1.9.4 final in /var/hack/tivoweb-tcl not running but just there for DailyMail, and this is Dailymail v35.

I noticed during the general output (debug level 2) that the dtivo variable was set to 0. Towards the end of dailymail_jazz.tcl I had to add 151 into the

if { [lsearch "001 011 031" $suffix] >= 0 } {

line. Then it got set correctly. However, the free space reported is now less than it was before, which is still different than it shows in TWP. (it is about 5% lower in the dailymail)

Also, the temperature ranges reported in the dailymail email are a little low for a DTiVo, as mine runs about @ 47C which is normal, mid 60's is the "too hot" mark.

[ccwf]

Originally posted by tivo-onion
Neil,

I have inspected the log, and I am again stumped. The code seems to have errored at a completely unrelated point than the last time it fell over:

…
Tmk Fatal Error: Thread tivosh <263> died due to signal -2 This line is immediately suspicious since there is no signal -2.

[sanderton]

I've seen plenty (too many!) "died due to signal -2" s.

[Prof. Yaffle]

Originally posted by tivo-onion
Prof,

I have updated the beta with fixes to your problems .. .download from the same post as before. You will need to replace all .itcl files and the dailymail_jazz.tcl file.

let me know if it solves your cron related problems and your double header problems,

cheers

Chris

Afraid not Chris. Now when I run it from Bash I get -

18:09:57-debug-hack found >>tivoftp<<
18:09:57-debug-hack found >>cron<<
18:09:57-debug-hack found >>endpad.tcl<<
18:09:57-debug-about to parse crontab file
18:09:57-debug-line : >>## /etc/crontab: system-wide crontab<<
18:09:57-debug-line : >># Unlike any other crontab you don't have to run the `crontab'<<
18:09:57-debug-line : >># command to install the new version when you edit this file.<<
18:09:57-debug-line : >><<
18:09:57-debug-line : >># for TiVo: This file doesn't use a user field like system-wide crontabs<<
18:09:57-debug-line : >># normally do. Everything runs at uid 0 (not that it matters for TiVo).<<
18:09:57-debug-line : >><<
18:09:57-debug-line : >>SHELL=/bin/sh<<
18:09:57-debug-line : >>PATH=/sbin:/bin:/usr/sbin:/usr/bin:/var/hack/bin<<
18:09:57-debug-line : >><<
18:09:57-debug-line : >># The following environment variables are needed for many tcl scripts to<<
18:09:57-debug-line : >># run. Thanks to AlphaWolf for troubleshooting this.<<
18:09:57-debug-line : >><<
18:09:57-debug-line : >>MFS_DEVICE=/dev/hda10<<
18:09:57-debug-line : >>TIVO_ROOT=""<<
18:09:57-debug-line : >><<
18:09:57-debug-line : >># Actual crontab entries below. This sample should append a date to<<
18:09:57-debug-line : >># a file every ten minutes.<<
18:09:57-debug-line : >><<
18:09:57-debug-line : >># m h dom mon dow command<<
18:09:57-debug-line : >>11 08 * * 1-7 /var/hack/dailymail_jazz.tcl > /var/log/dailymail 2>&1 &<<
18:09:57-debug-permitted item found in line : >>dailymail_jazz.tcl<<
18:09:57-about to split cron line into parameter items
18:09:57-debug-cron split successfully into individual items
18:09:57-debug-this item is valid - not comment
18:09:57-debug-minute parameter : >>11<<
18:09:57-debug-hour parameter : >>08<<
18:09:57-debug-day of month parameter : >>*<<
18:09:57-debug-month parameter : >>*<<
18:09:57-debug-day of week parameter : >>1-7<<
18:09:57-debug-checkpoint 001
18:09:57-debug-checkpoint 006
syntax error in expression "08+(3600/3600)"
while executing
"expr $h+($tzoffset/3600)"
(procedure "gettempuptime" line 216)
invoked from within
"gettempuptime"
(procedure "outputSection" line 53)
invoked from within
"outputSection 1"
(file "/var/hack/dailymail_jazz.tcl" line 3531)
bash-2.02#

The double header problem is sorted now though. Thanks.

[ccwf]

Originally posted by sanderton
I've seen plenty (too many!) "died due to signal -2" s. This is true—I've seen plenty of those in my logs, too. And I've never seen an explanation of their meaning.

Thoughts: My guess is that the process is actually exiting with exit code&nbsp;126; which is being misreported as signal&nbsp;-2 (126=128&minus;2).
Often, such messages are logged after an assertion failure, as this one was. So, tivosh probably has a handler that catches the signal (I assume one is generated by the assertion failure) and exits with code&nbsp;126 instead.

[ccwf]

Originally posted by tivo-onion
Ahhh! a String To Number conversion error! I have a pathetic request : I do not know how to do a string to number conversion in tcl? Can anyone help with this. Sorry for my stupidity here! I didn't look to see what the specific error is here, so I'll just answer generally.

As long as the string looks somewhat number-like, string to number conversions should happen automatically. For example, [expr&nbsp;"000.00"] yields 0.0. Explicit conversion is possible using scan. scan "000.00" "%f" var

[mbriody]

Have sent you a PM and link to the file.

Originally posted by tivo-onion
Apologies, I am getting mixed up ... the cron / disk problem is nothing to do with you. I am juggling too many balls today :-)

can you send, or provide me with a link to, the the tivowebplus .itcl module that contains your history function so I can inspect, identify any differences and update dailymail_jazz if necessary,

cheers

Chris

[tivo-onion]

I think I have fixed most things, other than mbriody's problem with the rejected recording, which I continue to work on. I have updated the download from the previous post, which can be found here (http://www.tivocommunity.com/tivo-vb/showthread.php?postid=1857001#post1857001). I think I have fixed your problem Prof - give it a go!

replace all .itcl files, the dailymail_jazz.tcl file and the dailymail.cfg file.

any more issues let me know,

Goodnight!

cheers

Chris

[mbriody]

One point to note is that the previous version was working fine until this morning when I moved to the new beta.

Originally posted by tivo-onion
I think I have fixed most things, other than mbriody's problem with the rejected recording, which I continue to work on. I have updated the download from the previous post, which can be found here (http://www.tivocommunity.com/tivo-vb/showthread.php?postid=1857001#post1857001). I think I have fixed your problem Prof - give it a go!

replace all .itcl files, the dailymail_jazz.tcl file and the dailymail.cfg file.

any more issues let me know,

Goodnight!

cheers

Chris

[tivo-onion]

Yeah, but the piece that is going wrong for you is a new piece. If you are not bothered with the rejected recording list, which is a new part, then just set the (6.5) dmailRecHistory variable to 0 in the .cfg file i.e.

set dmailRecHistory 0

It should them most probably work just fine. The code had been pretty stable for me for about 8 days, so it is obviously some kind of tivowebplus compatibility issue. There will always be a few issues on a beta test of a new module!

I will inspect the code you sent me in the meanwhile,

Chris

[Prof. Yaffle]

Thanks Chris, that's sorted it. everythings working perfectly now, Rejected Recordings and all. :up: :up: :up:

[tivo-onion]

Originally posted by Prof. Yaffle
Thanks Chris, that's sorted it. everythings working perfectly now, Rejected Recordings and all. :up: :up: :up:

Good stuff Prof! Glad to hear it!

cheers

Chris

[mbriody]

Originally posted by tivo-onion

set dmailRecHistory 0

It should them most probably work just fine. The code had been pretty
Chris [/B]

Did this and got another error:

21:44:02-debug-compiling conflicts list
21:44:33-debug-reading the temperature, calculating uptime, checking what's running
21:44:33-debug-about to run thermal check
21:44:34-debug-thermal check run
21:44:34-debug-about to run uptime check
21:44:34-debug-uptime check run
can't open object (0x00030007)

while executing
"db $db open $config"
("uplevel" body line 2)
invoked from within
"uplevel $body"
invoked from within
"transaction {uplevel $body}"
(procedure "RetryTransaction" line 5)
invoked from within
"RetryTransaction {
set config [db $db open $config]
set LSC [dbobj $config get LastSuccessCall$suffix]
set NSC [dbobj $config get NextCallAttemp..."
(procedure "gettempuptime" line 67)
invoked from within
"gettempuptime"
(procedure "outputSection" line 53)
invoked from within
"outputSection 5"
(file "./dailymail_jazz.tcl" line 3529)
bash-2.02#

I also set the next section dmailTivoStatus to 0 and it got a lot further but then died horribly:

21:50:50-debug-recipient set
21:50:50-debug-building content
21:50:50-debug-html starts
21:50:50-debug-body starts
Dumping mempool to /tmp/BlockFailure.189
Tmk Assertion Failure:
BlockFailure, line 1771 ()
Tmk Fatal Error: Thread tivosh <189> died due to signal -2
1a344ec 1a32a44 1a2ed70 1b95e0c 1c4d5e8 1c891d0 1c858b4 1c85158 1c7aee0 1c61a10 1c8e4e0 1c77e7c 1c61a10 1c849c0 1c85ec8
1c4d248 1c28cac 1800134

[sanderton]

mbriody, I think you have a sick TiVo. Or at the very least, a highly stressed one. How many entries do you have in Now Playing?

[mbriody]

I have about 90 entries in Now Showing.

I haven't had any problems with my TiVo, TivoWeb or any TiVo modules until today's version of DailyMail...

[Snoopy]

I am just checking in. As yet, I have been unable to get dailymail to work for me. I understand there is now I homepage for this project? What version are we at. I see many different download links.

[tivo-onion]

Originally posted by mbriody
Did this and got another error:

21:44:02-debug-compiling conflicts list
21:44:33-debug-reading the temperature, calculating uptime, checking what's running
21:44:33-debug-about to run thermal check
21:44:34-debug-thermal check run
21:44:34-debug-about to run uptime check
21:44:34-debug-uptime check run
can't open object (0x00030007)

while executing
"db $db open $config"
("uplevel" body line 2)
invoked from within
"uplevel $body"
invoked from within
"transaction {uplevel $body}"
(procedure "RetryTransaction" line 5)
invoked from within
"RetryTransaction {
set config [db $db open $config]
set LSC [dbobj $config get LastSuccessCall$suffix]
set NSC [dbobj $config get NextCallAttemp..."
(procedure "gettempuptime" line 67)
invoked from within
"gettempuptime"
(procedure "outputSection" line 53)
invoked from within
"outputSection 5"
(file "./dailymail_jazz.tcl" line 3529)
bash-2.02#

I also set the next section dmailTivoStatus to 0 and it got a lot further but then died horribly:

21:50:50-debug-recipient set
21:50:50-debug-building content
21:50:50-debug-html starts
21:50:50-debug-body starts
Dumping mempool to /tmp/BlockFailure.189
Tmk Assertion Failure:
BlockFailure, line 1771 ()
Tmk Fatal Error: Thread tivosh <189> died due to signal -2
1a344ec 1a32a44 1a2ed70 1b95e0c 1c4d5e8 1c891d0 1c858b4 1c85158 1c7aee0 1c61a10 1c8e4e0 1c77e7c 1c61a10 1c849c0 1c85ec8
1c4d248 1c28cac 1800134

mbriody,

not a nice suggestion I am afraid, but if the previous version was working well for you, it may be worthwhile reverting back to it for the meanwhile. There are obviously a whole set of issues being thrown up that are either specific to tivowebplus or your specific tivo / setup which seemed to be varied and that I cannot get a handle on. The first error in identified in your latest endeavour has been stable for quite some time, so I am surprised it is falling over here. The second error is memory related, and I have thrown every safety precaution, suggested by sanderton and the like, into the code to avoid this happening!

I checked the new code in the dailymail module against the code in the tivowebplus ui.itcl module and I could spot no difference. Wierd!

Can somebody let me know what a "Tmk Assertion Failure" actualy is and why it occurs?

Had anyone with tivowebplus got this new 0.35 version working? Would love to hear from you,

cheers

Chris

[tivo-onion]

Originally posted by Snoopy
I am just checking in. As yet, I have been unable to get dailymail to work for me. I understand there is now I homepage for this project? What version are we at. I see many different download links.

See my signature for the link to the latest version,

cheers

Chris

[sanderton]

Originally posted by tivo-onion
Can somebody let me know what a "Tmk Assertion Failure" actualy is and why it occurs?

It just means that the TCL interpreter has crashed. As for why, you'd have to be able to interpret the memory dump to figure it out!

[tivo-onion]

Originally posted by sanderton
It just means that the TCL interpreter has crashed. As for why, you'd have to be able to interpret the memory dump to figure it out!

I found this in the "other place":

when trying to execute the following command in tcl:

puts $chan [exec $source_dir/mfs_stream -s $filename]

the person gets a mempool error and the cause is given as:

It tries to alloc more memory in it's pool. but since it's exec method must copy the whole stack, it runs out of room and reboots.

So it seems that the mempool is too full. Any "puts" command could cause a crash in this case. Is there any way of expanding the mempool somehow? Why would a mempool be too full, too many processes running at the same time?

cheers

Chris

[mbriody]

Reverted and working fine,

I'm going to install vanilla TivoWeb and try the latest version with that, to prove (or not) that its a TWP issue.

[tivo-onion]

Originally posted by mbriody
Reverted and working fine,

I'm going to install vanilla TivoWeb and try the latest version with that, to prove (or not) that its a TWP issue.

Which version have you reverted to?

cheers

Chris

[Snoopy]

Originally posted by tivo-onion
See my signature for the link to the latest version.Thanks Chris. Ok I've gotten a little farther this time. It might be a good idea to put the fact that you can manage the cfg file "AFTER" it is installed inside the text file. That's a really nice feature. I got the following debugging information after trying to send email.

------welcome to the jazzed dailymail program - v0.35 (6th April 2004) - starting
------the debug level is set at >>2<<
------started at 10:06:54 (debugging times specified in gmt)

10:06:54-debug-global variable definition complete
10:06:54-debug-commence fooling tivoweb modules
10:06:54-debug-completed fooling tivoweb modules
10:06:54-debug-completed other preperation
10:06:54-debug-argument 1 passed in ::: >><<
10:06:54-debug-argument 2 passed in ::: >><<
10:06:54-debug-argument 3 passed in ::: >><<
10:06:54-debug-argument 4 passed in ::: >><<
10:06:54-debug-0 argument(s) found
10:06:54-debug-argument handling complete
10:06:54-debug-start optional message handling
10:06:54-debug-no message file found
10:06:54-debug-end optional message handling
10:06:54-debug-about to start version setting
10:06:54-debug-version3 : >>1<<
10:06:54-debug-uktivo : >>0<<
10:06:54-debug-dtivo : >>1<<
10:06:54-debug-version (for tivowebplus) : >>3<<
10:06:54-debug-completed version setting
10:06:54-debug-about to include util.itcl
10:06:54-debug-util.itcl included - about to include index.itcl
10:06:54-debug-index.itcl included

I am using 64.164.98.8 (mail.swbell.net) as my outgoing mail server and swbell.net is what i put in the domain area (xxx.xxxxxxxxxx)? I am not sure if that is correct. I'm on DSL so I wasn't sure what domain you were talking about there. Do I put in 64.164.98.8 again there? I am not sure what went wrong and have verified the cfg file.

Please advise?

[tivo-onion]

snoopy,

can you run at the bash prompt via telnet and send me the detailed error messages that arise,

thanks

Chris

[Snoopy]

Originally posted by tivo-onion
snoopy, can you run at the bash prompt via telnet and send me the detailed error messages that arise, thanks Chris I have turbonet so telneting to my TiVo is not a problem. I'm just not sure what you mean. The only way I know to run the daily mail stuff runs from within TiVoWeb, not from the command line. Tell me what to type in to the command line 'specifically' and I'll do that. Thanks for the help.

Please advise.

[tivo-onion]

Snoopy,

surely you must have chmod'd your code once you FTP'ed it down to your tivo?

just telnet into your tivo by typing:

telnet xxx.xxx.xxx.xxx [enter]

from a command window on your pc, where xxx.xxx.xxx.xxx is the ip of your tivo.

once successfully telnetted in to your tivo type the following commands:

cd /var/hack [enter]

chmod 755 *[enter]

dailymail_jazz.tcl [enter]

this should run dailymail_jazz in the telnet session. You should see the same information appearing as in the log file, however when it errors you should see more detailed information at the crash. It is this information I need to get more details on the breakdown. If you can cut and paste that into a post that would be great.

it would be worthwhile executing a "chmod 755" in all other directories you have copies dailymail related code to.

cheers

Chris

[Snoopy]

My chat address in case it would make it easier is tivosnoopy@hotmail.com on msn messenger.

/var/hack/dailymail# chmod 755 dailymail_jazz.tcl
/var/hack/dailymail# ./dailymail_jazz.tcl


------welcome to the jazzed dailymail program - v0.35 (6th April 2004) - startin
g
------the debug level is set at >>2<<
------started at 10:57:26 (debugging times specified in gmt)

10:57:26-debug-global variable definition complete
10:57:26-debug-commence fooling tivoweb modules
10:57:26-debug-completed fooling tivoweb modules
10:57:26-debug-completed other preperation
10:57:26-debug-argument 1 passed in ::: >><<
10:57:26-debug-argument 2 passed in ::: >><<
10:57:26-debug-argument 3 passed in ::: >><<
10:57:26-debug-argument 4 passed in ::: >><<
10:57:26-debug-0 argument(s) found
10:57:26-debug-argument handling complete
10:57:26-debug-start optional message handling
10:57:26-debug-no message file found
10:57:26-debug-end optional message handling
10:57:26-debug-about to start version setting
10:57:27-debug-version3 : >>1<<
10:57:27-debug-uktivo : >>0<<
10:57:27-debug-dtivo : >>1<<
10:57:27-debug-version (for tivowebplus) : >>3<<
10:57:27-debug-completed version setting
10:57:27-debug-about to include util.itcl
10:57:27-debug-util.itcl included - about to include index.itcl
10:57:27-debug-index.itcl included
couldn't execute "/var/hack/tivoweb-tcl/get_space": no such file or directory
while executing
"error $error"
(procedure "get_totalsizes" line 9)
invoked from within
"get_totalsizes "
(file "./dailymail_jazz.tcl" line 2852)
/var/hack/dailymail#

Thanks for looking into it.

[sanderton]

Originally posted by tivo-onion
I found this in the "other place":

when trying to execute the following command in tcl:

puts $chan [exec $source_dir/mfs_stream -s $filename]

the person gets a mempool error and the cause is given as:

It tries to alloc more memory in it's pool. but since it's exec method must copy the whole stack, it runs out of room and reboots.

So it seems that the mempool is too full. Any "puts" command could cause a crash in this case. Is there any way of expanding the mempool somehow? Why would a mempool be too full, too many processes running at the same time?


It's the exec not the puts which is causing the problem in that case.

There are commands which control pool memory allocation; however I don't know if they work with the main mempool.

Another approach is to make sure that you explicitly unset all variables once you are done with them; some of the ones the TivoWeb modules create are very large.

[tivo-onion]

Snoopy,

you are evidently missing a program necessary called "get_space". This code can be downloaded from here (http://deepinthejungle.servehttp.com/TiVo/get_space.zip) if you do not already have it.

You should extract it from the zip file on your PC and then ftp (binary) it to the /var/hack/tivoweb-tcl directory on your tivo, then chmod it 755. The commands you will need are:

cd /var/hack/tivoweb-tcl

chmod 755 *

then try running dailymail_jazz.tcl again from the tivo bash prompt, not forgetting to change directories first.

cheers

Chris

[tivo-onion]

Originally posted by sanderton
It's the exec not the puts which is causing the problem in that case.

There are commands which control pool memory allocation; however I don't know if they work with the main mempool.

Another approach is to make sure that you explicitly unset all variables once you are done with them; some of the ones the TivoWeb modules create are very large.

Stuart,

how does one "unset" a variable? Is that "flush" ?

cheers

Chris

[sanderton]

Originally posted by tivo-onion
Stuart,

how does one "unset" a variable? Is that "flush" ?

cheers

Chris

Nope, it's....


unset varname


flush sends the contents of the buffer to the network socket.

[Snoopy]

Originally posted by tivo-onion
Snoopy, you are evidently missing a program necessary called "get_space". Still getting an error,
/var/hack/dailymail# ./dailymail_jazz.tcl


------welcome to the jazzed dailymail program - v0.35 (6th April 2004) - startin
g
------the debug level is set at >>2<<
------started at 11:19:08 (debugging times specified in gmt)

11:19:08-debug-global variable definition complete
11:19:08-debug-commence fooling tivoweb modules
11:19:08-debug-completed fooling tivoweb modules
11:19:08-debug-completed other preperation
11:19:08-debug-argument 1 passed in ::: >><<
11:19:08-debug-argument 2 passed in ::: >><<
11:19:08-debug-argument 3 passed in ::: >><<
11:19:08-debug-argument 4 passed in ::: >><<
11:19:08-debug-0 argument(s) found
11:19:08-debug-argument handling complete
11:19:08-debug-start optional message handling
11:19:08-debug-no message file found
11:19:08-debug-end optional message handling
11:19:08-debug-about to start version setting
11:19:09-debug-version3 : >>1<<
11:19:09-debug-uktivo : >>0<<
11:19:09-debug-dtivo : >>1<<
11:19:09-debug-version (for tivowebplus) : >>3<<
11:19:09-debug-completed version setting
11:19:09-debug-about to include util.itcl
11:19:09-debug-util.itcl included - about to include index.itcl
11:19:09-debug-index.itcl included
no value given for parameter "source" to "base64dec"
while executing
"base64dec"
("uplevel" body line 11)
invoked from within
"uplevel $body"
invoked from within
"transaction {uplevel $body}"
(procedure "RetryTransaction" line 5)
invoked from within
"RetryTransaction {
if {$::version3} {
set lconfig [db $db open /State/LocationConfig]
set setup [db $db open /State/ServiceConfig]
set tz ..."
(file "./dailymail_jazz.tcl" line 2865)
/var/hack/dailymail#

There is no password needed where it talked about base64. I'll just send you the configuration file. I am certain something isn't right. Note that there are no instructions on how to obtain a base64 version of a username and password if you did need one. I'm glad I don't but even so, I still get the error.

[tivo-onion]

Question:

I was inspecting some of LJ's code in dailymail_jazz and came accross:

if {$::version3} {
set lconfig [db $db open /State/LocationConfig]
set setup [db $db open /State/ServiceConfig]
set tz [dbobj $lconfig get TimeZoneOld]
set summertime [dbobj $lconfig get DaylightSavingsPolicy]
} else {
set setup [db $db open /Setup]
set tz [dbobj $setup get TimeZone]
set summertime [dbobj $setup get DaylightSavingsPolicy]
} ;[base64dec]


can anyone tell me what the ;[base64dec] actually does in this piece of code, as it seems to be erroring for snoopy?

cheers

Chris

[sanderton]

It's part of TivoWeb's somewhat obscure anti-hacking code.

I'm pretty sure in this case you can remove it with impunity.

[tivo-onion]

Stuart,

thanks for the information.

-------------------------------------------------------------

Snoopy,

I have removed the possible offending code. Please download the latest version from the same post as before (see my signature) and exchange the dailymail_jazz.tcl file with the new one in the zip file. Then try again!

Chin up! :-)

cheers

Chris

[mbriody]

Right, I installed TivoWeb 1.9.4 beta 5 (the latest?) and moved TivoWebPlus to its own directory so I can run them in parallel. A happy consequence of this is that DailyMail works fine without edits.

I unloaded endpad, irblast and cron so I have the minimum running apps. I then configured DailyMail to do the minimum processing and added the 6.5 sections back in one by one.

From a clean boot in the above configuration DailyMail worked fine with all section 6 options enabled EXCEPT for history on both TW and TWP.

I got the original error on both TW and TWP when I enabled history.

Sometimes I get an error in TW and TWP when trying to do History | All but from a reboot it works okay. I have around 800 history items and I suspect this may be the problem.

I've searched and cannot find any way to clear out or reduce the history. There was a module in the other place called EditTitle which claims to do the job but it doesn't seem to support SA's.

I think the other crashes were a consequence of memory problems whilst trying to process the history. I have performed all the above tests with reboots in between.

After re-enabling irblast I have had two tmk crashes whilst running DailyMail but it doesn't happen every time.

My conclusion is that I almost certainly have a problem with the size of my history (any ideas?) and that there may be an intermittent conflict between irblast and DailyMail. It appears that TivoWebPlus isn't a problem.

[sanderton]

1.9.4 final is the latest TW, not beta whatever.

This will wipe out you Recording History if you're feeling brave:


#!/tvbin/tivosh

set db [dbopen]
ForeachMfsFile fsid name type "/Recording/History" "" {
RetryTransaction {
set item [db $db openid $fsid]
set state [dbobj $item get State]
if {$state == 2} {
dbobj $item MarkAsRubbish
}
}
}
dbclose $db


(untested; may take a while to appear to do anything; running a daily call can provoke a grarbage collection if nothing happens, will probably reset the 28-day rule too)

[mbriody]

Originally posted by sanderton
1.9.4 final is the latest TW, not beta whatever.

I'll update it for completeness but doesn't now appear relevant.


This will wipe out you Recording History if you're feeling brave:

Is there any way to make it selective for say anything over a week or a month?

[managerxxx]

Having been very happy with V.30 I thought I'd try out .35.

Seeing the following from the bash prompt:

bash-2.02# /var/hack/dailymail_jazz.tcl


------welcome to the jazzed dailymail program - v0.35 (6th April 2004) - startin
g
------the debug level is set at >>3<<
------started at 19:47:03 (debugging times specified in gmt)

19:47:03-debug-global variable definition complete
19:47:03-debug-commence fooling tivoweb modules
19:47:03-debug-completed fooling tivoweb modules
19:47:04-debug-completed other preperation
19:47:04-debug-argument 1 passed in ::: >><<
19:47:04-debug-argument 2 passed in ::: >><<
19:47:04-debug-argument 3 passed in ::: >><<
19:47:04-debug-argument 4 passed in ::: >><<
19:47:04-debug-0 argument(s) found
19:47:04-debug-argument handling complete
19:47:04-debug-start optional message handling
19:47:04-debug-no message file found
19:47:04-debug-end optional message handling
19:47:04-debug-about to start version setting
19:47:04-debug-version3 : >>0<<
19:47:04-debug-uktivo : >>1<<
19:47:04-debug-dtivo : >>0<<
19:47:04-debug-version (for tivowebplus) : >>2.5<<
19:47:04-debug-completed version setting
19:47:04-debug-about to include util.itcl
19:47:04-debug-util.itcl included - about to include index.itcl
19:47:04-debug-index.itcl included
wrong # args: extra words after "else" clause in "if" command
while compiling
"if {$::version3} { ..."
("uplevel" body line 2)
invoked from within
"uplevel $body"
invoked from within
"transaction {uplevel $body}"
(procedure "RetryTransaction" line 5)
invoked from within
"RetryTransaction {
if {$::version3} {
set lconfig [db $db open /State/LocationConfig]
set setup [db $db open /State/ServiceConfig]
set tz ..."
(file "/var/hack/dailymail_jazz.tcl" line 2865)
bash-2.02#
bash-2.02#

Any ideas as to what might be the cause? I've had quick comb through but can't see anything obvious....

Thanks

[managerxxx]

Removed

#;[base64dec]

from line 2875 and things look better now.

[Fozzie]

tivo-onion - does the controlpadding module take into account endpad's switches (-s, -e, -sugqual, and -sugeq). If not, could you modify it to?

Thanks.

[bobnick]

Bit annoyed that no-one has put the graphics on their webserver; so I had to set up my blueyonder web space account and do it myself ;)

You're very welcome to use my links, but don't blame me if I switch ISP's sometime in the future!

Stick this link in your cfg file (and make sure there's no / at the end!)

http://www.dmj.pwp.blueyonder.co.uk


All of my jazzed up mails warn me that endpad isn't running, despite the fact I've started the padding daemon in Tivoweb, have the latest endpad version running, and indeed have padded programmes!
All the endpad files have their normal names and appear to be in the normal place. Don't think I have an endpad.log file anywhere though.
Any tips as to what I should be searching for?
ps aux shows tivosh /var/hack/endp... as the name of the process.

[Milhouse]

Originally posted by bobnick
Bit annoyed that no-one has put the graphics on their webserver; so I had to set up my blueyonder web space account and do it myself ;)


Searching this thread and finding two posts (here (http://www.tivocommunity.com/tivo-vb/showthread.php?s=&postid=1803883#post1803883) and here (http://www.tivocommunity.com/tivo-vb/showthread.php?s=&postid=1714867#post1714867)) from me would have saved you from such annoyances!. :rolleyes: ;)

Edit: Added links to cheer up bobnick :)

[bobnick]

Double grrr ! ;)

[tivo-onion]

Originally posted by managerxxx
Removed

#;[base64dec]

from line 2875 and things look better now.


Removed this from main code also, and updated.

cheers

Chris

[mbriody]

Sanderton, is it possible to make this code selective on date please?

Originally posted by sanderton
1.9.4 final is the latest TW, not beta whatever.

This will wipe out you Recording History if you're feeling brave:


#!/tvbin/tivosh

set db [dbopen]
ForeachMfsFile fsid name type "/Recording/History" "" {
RetryTransaction {
set item [db $db openid $fsid]
set state [dbobj $item get State]
if {$state == 2} {
dbobj $item MarkAsRubbish
}
}
}
dbclose $db


(untested; may take a while to appear to do anything; running a daily call can provoke a grarbage collection if nothing happens, will probably reset the 28-day rule too)

[Mike Laskey]

Hi Chris,

I'm running the latest beta of the DailyMail_jazz which I installed last night. Works great.

I wondered if you had plans for variables that would store multiple recipient names, rather than using command line passing ?

Also, is there a way to configure the free space indicator so that the calculation ignores suggestions? Now that my 160Gb system is showing full, it will probably stay above 90% as the suggestions are recycled.

Great work, and I only ask for cosmetics that don't really matter.
Cheers
Mike.

[sanderton]

Originally posted by mbriody
Sanderton, is it possible to make this code selective on date please?

Something like:


#!/tvbin/tivosh
set today [expr [clock seconds] / 86400]
set db [dbopen]
ForeachMfsFile fsid name type "/Recording/History" "" {
RetryTransaction {
set item [db $db openid $fsid]
set state [dbobj $item get State]
if {$state == 2} {
set date [dbobj $item get StartDate]
if {[expr $today - $date] > 7} {
dbobj $item MarkAsRubbish
}
}
}
}
dbclose $db




Should remove stuff over a week old. In theory. I have not attempted to run this code!

[bobnick]

Does no-one else suffer from the false endpad warning then?

[sanderton]

I think it checks enpad.log, which is in /var/log

[Disconnect]

Boom. The strange thing was, it worked great yesterday. Now the older beta doesn't work, and the newest aborts. When run in debug 3 it rebooted my tivo (grr) but I have that log if you want it (500k.. pm me). In debug 2 it just reports:

16:20:26-debug-started record history procedure
16:20:26-debug-mintime >>1081268426<<
16:20:26-debug-maxtime >>1081441226<<
no such object: {CONFLICT err=0x30007}
while executing
"dbobj $station fsid"
("foreach" body line 10)
invoked from within
"foreach channel $channels2 {
regexp {([0-9]*)/(.*)} $channel junk id subid
(clipped for brevety)