NMTDVR rc1: Automated Tv and Movie Downloads via Usenet and Torrents

[jhmiller]

I did say this was a problem for me also. Seems as if lighttpd can sometimes stop then crontab entries from being added. to get around this (untill a fix is found) add the following to the daemon.sh file

Code:

crontab -l >/share/tmp/tw.cron.tmp
                if ! grep -q "NMTDVR" "/share/tmp/tw.cron.tmp"
                    then
                    echo "20,50 * * * * su nobody /share/Apps/NMTDVR/crontab.sh" >> /share/tmp/tw.cron.tmp
                    crontab /share/tmp/tw.cron.tmp
                fi

when i do a crontab -l now i get

Code:

30 * * * * /etc/cron.hourly
02 4 * * * /etc/cron.daily
22 4 * * 0 /etc/cron.weekly
*/5 * * * * /bin/disktriger.sh
#bt
20,50 * * * * su nobody /share/Apps/NMTDVR/crontab.sh

I can tell that the crontab entry for NMTDVR is set from the daemon.sh file and not from the CSI as that would have two forward slashes in front of NMTDVR (Apps//NMTDVR/ ect..)

This is a major problem with lighttpd (all versions i think) I belive oversight,Torrentwatch-X and feed time have stopped using CSI for there crontab entries.

Miller

[wizard66]

I try to install this tru SCI and it installed oke.
But I can't logon demo/demo or admin/admin is not working
I get a page error.
Anybody else have this problem, I can't log on to it..
version: 0.9-rc1inside CSI

[JuStAdsor]

Hi I have NMTDVR installed properly.
The problem is that it works for a while, but after that, the database crushes:
\

Code:

Description

CDbCommand failed to execute the SQL statement: CDbCommand failed to prepare the SQL statement: SQLSTATE[HY000]: General error: 11 database disk image is malformed
Source File

/opt/sybhttpd/localhost.drives/SATA_DISK/Apps/NMTDVR/protected/components/BaseController.php(96)

00084:    */
00085:   public function getResolution() {
00086:     return $this->_resolution;
00087:   }
00088:
00089:   /**
00090:    * Point the imageRoot and layout to the appropriate pages for this request
00091:    * @return none
00092:    */
00093:   public function init() {
00094:     error_reporting(E_ERROR);
00095:     $app = Yii::app();
00096: date_default_timezone_set(Yii::app()->dvrConfig->timezone);
00097:
00098:     $this->_resolution = 'hd';
00099:     if(isset($_SERVER['HTTP_USER_AGENT']))
00100:     {
00101:       // if the user agent is an NMT load images with file://, otherwise relative url
00102:       if(stristr($_SERVER['HTTP_USER_AGENT'], 'Syabas') === False)
00103:       { // Not A Syabas browser delivering request
00104:         $this->imageRoot = dirname($_SERVER['SCRIPT_NAME']).'/images/';
00105:         $app->setTheme($app->dvrConfig->webuiTheme);
00106:       }
00107:       else
00108:       {

Stack Trace

#0 /opt/sybhttpd/localhost.drives/SATA_DISK/Apps/NMTDVR/protected/components/SqliteCommand.php(44): CDbCommand->queryInternal('fetchAll', 2, Array)
#1 /opt/sybhttpd/localhost.drives/SATA_DISK/Apps/NMTDVR/yii_framework/db/CDbCommand.php(265): SqliteCommand->queryInternal('fetchAll', 2, Array)
#2 /opt/sybhttpd/localhost.drives/SATA_DISK/Apps/NMTDVR/protected/components/dvrConfig.php(345): CDbCommand->queryAll()
#3 /opt/sybhttpd/localhost.drives/SATA_DISK/Apps/NMTDVR/yii_framework/base/CModule.php(357): dvrConfig->init()
#4 /opt/sybhttpd/localhost.drives/SATA_DISK/Apps/NMTDVR/yii_framework/base/CModule.php(91): CModule->getComponent('dvrConfig')
#5 /opt/sybhttpd/localhost.drives/SATA_DISK/Apps/NMTDVR/protected/compone

If I delete the .db file, and restart from scratch, it works again.
Can someone help me?

Thank you.

PS. I have a C200 running latest firmware.

[jhmiller]

(04-03-2010 09:47 AM)JuStAdsor Wrote:  Hi I have NMTDVR installed properly.
The problem is that it works for a while, but after that, the database crushes:
\

Code:

Description

CDbCommand failed to execute the SQL statement: CDbCommand failed to prepare the SQL statement: SQLSTATE[HY000]: General error: 11 database disk image is malformed
Source File

/opt/sybhttpd/localhost.drives/SATA_DISK/Apps/NMTDVR/protected/components/BaseController.php(96)

00084:    */
00085:   public function getResolution() {
00086:     return $this->_resolution;
00087:   }
00088:
00089:   /**
00090:    * Point the imageRoot and layout to the appropriate pages for this request
00091:    * @return none
00092:    */
00093:   public function init() {
00094:     error_reporting(E_ERROR);
00095:     $app = Yii::app();
00096: date_default_timezone_set(Yii::app()->dvrConfig->timezone);
00097:
00098:     $this->_resolution = 'hd';
00099:     if(isset($_SERVER['HTTP_USER_AGENT']))
00100:     {
00101:       // if the user agent is an NMT load images with file://, otherwise relative url
00102:       if(stristr($_SERVER['HTTP_USER_AGENT'], 'Syabas') === False)
00103:       { // Not A Syabas browser delivering request
00104:         $this->imageRoot = dirname($_SERVER['SCRIPT_NAME']).'/images/';
00105:         $app->setTheme($app->dvrConfig->webuiTheme);
00106:       }
00107:       else
00108:       {

Stack Trace

#0 /opt/sybhttpd/localhost.drives/SATA_DISK/Apps/NMTDVR/protected/components/SqliteCommand.php(44): CDbCommand->queryInternal('fetchAll', 2, Array)
#1 /opt/sybhttpd/localhost.drives/SATA_DISK/Apps/NMTDVR/yii_framework/db/CDbCommand.php(265): SqliteCommand->queryInternal('fetchAll', 2, Array)
#2 /opt/sybhttpd/localhost.drives/SATA_DISK/Apps/NMTDVR/protected/components/dvrConfig.php(345): CDbCommand->queryAll()
#3 /opt/sybhttpd/localhost.drives/SATA_DISK/Apps/NMTDVR/yii_framework/base/CModule.php(357): dvrConfig->init()
#4 /opt/sybhttpd/localhost.drives/SATA_DISK/Apps/NMTDVR/yii_framework/base/CModule.php(91): CModule->getComponent('dvrConfig')
#5 /opt/sybhttpd/localhost.drives/SATA_DISK/Apps/NMTDVR/protected/compone

If I delete the .db file, and restart from scratch, it works again.
Can someone help me?

Thank you.

PS. I have a C200 running latest firmware.

The same thing is happening with me too. Strange as it has not happened before. Ive resetup my favs and stored a copy of the database in another place.

Hopfully J with be able to sort this error out.

[Jayman007]

I'm pretty new to the NMT scene and my linux knowledge is somewhat limited.

When I run the crontab -l I see the entry

Code:

20,50 * * * * su nobody /share/Apps/NMTDVR//crontab.sh #APPINIT_NMTDVR#

What does the 20,50 mean? If I run su nobody /share/Apps/NMTDVR//crontab.sh manually then everything gets updated correctly but I never see this happening on its own. How often is this set to run? How do I set it up to run every 12 hours?

thanks for the help using this wonderful app.

EDIT:
After further research into the crontab file it seems to me that the 20,50 indicates it will run at every 20 and 50 mins after the hour (so every 30 mins). But shouldn't there be only * * * * following the entry and not 5*? Still confused so any help would be greatly appreciated. They way it's setup now it doesn't seem to be running the crontab.sh at all.

[lordy]

Not 100% sure what your asking but the syntax for su should be

su user -c "command args"

ie
su nobody -c /share/Apps/NMTDVR//crontab.sh

[Jayman007]

What is showing up in my crontab file as is passed from the appinfo.json file is

Code:

20,50 * * * * su nobody /share/Apps/NMTDVR//crontab.sh #APPINIT_NMTDVR#

That is how it is after I installed it. I have done nothing to change it. I am trying to figure out why it seems that the crontab.sh is never run. Maybe the syntax is incorrect in the appinfo.json file. If so, then that is a bug that needs to be fixed.

So I guess my question is, "Is that syntax correct as stated above? With the given entry, how often will the NMTDVR/crontab.sh be run?"

I tested the

Code:

cmd su nobody /share/Apps/NMTDVR//crontab.sh

from telnet and it runs fine. So I still can't figure out why it's not updating the NMTDVR feeds on a schedule. Maybe the crontab isn't being executed.

It's my understanding that the entry was created via the NMT community installer.

[matros86]

I have some problem with feeds list: I've set bt-chat and in the configuration i get "update successful" but the list remain blank.
I still have Torrentwatch installed, could it be a problem?

[jhmiller]

@JuStAdsor, It looks like TVNZB.COM is down but NMTDVR is still trying to get its feed data thus malforming the database (i take it you are using tvnzb?) Another good nzb site is http://www.nzbs.org, sign up there and add its rss link instead of tvnzb.

@matros86, Uninstall both Torrentwatch and NMTDVR, restart PCH then reinstall NMTDVR.

@Jayman007, If the crontab entries are there it should update. When you run

Code:

su nobody /share/Apps/NMTDVR//crontab.sh

from telnet, what output i shown in the telnet window.

@lordy, What does the -c switch do? and what happens if its omitted? as it runs fine without it. Is it the default action for su nobody?

[Djiest]

Hi
i'm using http://tvnzbrss.com/ as feed.
What do I enter in the favorites section. I can not get NMTDVR to see any new NZB's.

Thanks
Joost

---

Besides that, NZBGet en NMTDVR are really slow, even with lighthttpd and on a cabled network connection

What can I do to fix this?

Thanks Joost

[lordy]

(04-05-2010 11:30 AM)jhmiller Wrote:  @lordy, What does the -c switch do? and what happens if its omitted? as it runs fine without it. Is it the default action for su nobody?

My mistake. Looks like su works without '-c' ! Just ignore me

[matros86]

(04-05-2010 11:30 AM)jhmiller Wrote:  @matros86, Uninstall both Torrentwatch and NMTDVR, restart PCH then reinstall NMTDVR.

Thanks for the reply.
Because I don't see torrentwatch in CSI installed services, should be enough deleting the .torrents directory or it's better reinstalling CSI apps?

[jhmiller]

@matros86, Yes delete the folder then reinstall NMTDVR.

@Djiest, Not sure what you mean, are you are seeing a list of nzb's from tvnzbrss.com but that list is not being updated? If that is the case then its due to lighttpd stopping crontab entries(tells NMTDVR when to update) from getting written. You have 3 options

1. Uninstall lighttpd

2. Add the following to NMTDVR deamon.sh file

Code:

crontab -l >/share/tmp/tw.cron.tmp
                if ! grep -q "NMTDVR" "/share/tmp/tw.cron.tmp"
                    then
                    echo "20,50 * * * * su nobody /share/Apps/NMTDVR/crontab.sh" >> /share/tmp/tw.cron.tmp
                    crontab /share/tmp/tw.cron.tmp
                fi

3. In CSI un-tick the box that says start on boot for lighttpd and add

Code:

/share/Apps/AppInit/appinit.cgi start lighttpd

to the start_app.sh file.

What do you mean slow, the interface speeds or the downloading speeds? My interface speeds are ok and my downloads speeds are between 10-13 Mbs. Whats your connection speed?

[JuStAdsor]

(04-05-2010 11:30 AM)jhmiller Wrote:  @JuStAdsor, It looks like TVNZB.COM is down but NMTDVR is still trying to get its feed data thus malforming the database (i take it you are using tvnzb?) Another good nzb site is http://www.nzbs.org, sign up there and add its rss link instead of tvnzb.

Can something be done in order to avoid this?
and also keep TVNZB.com (the tv series are more structured there) and I believe that is also more updated.

[Djiest]

(04-06-2010 05:23 AM)jhmiller Wrote:  1. Uninstall lighttpd


What do you mean slow, the interface speeds or the downloading speeds? My interface speeds are ok and my downloads speeds are between 10-13 Mbs. Whats your connection speed?

When I uninstall lighttpd, which port do I use then? I can not get NMTDVR to run on port 9999 then.
The UI is really slow.

eg. just clicked on a NZB to start downloading: i'm looking at the loading animation for 5 minutes now...

Thanks for replying...
Joost