[CSI] Community Software Installer 2.6.1 (OLD THREAD)

[Ger Teunis]

(05-28-2009 08:03 AM)lundman Wrote:  Strange, I was having problems with CSI yesterday, in particular that app_init.cgi was put in / rather than in Appinit directory etc, and could not install anything. I wrote a post about it, but I must have forgotten to push Submit or something, cos I sure can't find it today

So, did anyone work out my problem with ESP? No?

During install appinit.cgi will be placed in / and will be executed. appinit.cgi will move itself to /share/Apps/AppInit during execution.
Perhaps a folder permission issue? If you have more info about this: please contact me.

[lundman]

I most certainly did have, but its gone. Anyway, am I right in assuming that I can rename my Apps to something else, and CSI will set everything up as if it was a new installation?

[Ger Teunis]

(05-28-2009 08:49 AM)lundman Wrote:  I most certainly did have, but its gone. Anyway, am I right in assuming that I can rename my Apps to something else, and CSI will set everything up as if it was a new installation?

Correct. It should create the folder /share/Apps/AppInit and move itself there and create all profile files there. I will try if this still works this evening.

[dob73]

Good afternoon.
At me the same problem as well as at lundman and rterblanche post:# 1083. In additives CSI puts in a root empty! appinit.cgi.
I used CSI 2.1.5. With the pregoing version result same.
There are any ways of the decision of this problem?
Thanks.

P.S. NMT it is not connected to internet.

[Ger Teunis]

(05-28-2009 10:08 AM)dob73 Wrote:  Good afternoon.
At me the same problem as well as at lundman and rterblanche post:# 1083. In additives CSI puts in a root empty! appinit.cgi.
I used CSI 2.1.5. With the pregoing version result same.
There are any ways of the decision of this problem?

There we go, the NMT will try to download the appinit.cgi itself. That is why the NMT must have an internet connection. In a future CSI release I will change this. For the time being having a internet connection on the NMT is an requirement of CSI.

Now: how to solve this by hand:
download: http://repository.nmtinstaller.com/appinit.cgi
Store the file in /share
the via telnet execute the cgi script and it will install itself.

[lundman]

The wget thing made little difference, I'm trying to install "llink". True, I do end up with appinit.cgi in the right place.

Here is tcpdump, well, snippets. Sorry for the garbage, its tcpdump

Code:

@STOR installprepare.cgi
226 0.014 seconds (measured here), 338.28 Kbytes per second
STOR llink.tar
226 1.426 seconds (measured here), 3.74 Mbytes per second
GSITE chmod 777 installprepare.cgi
.{200 Permissions changed on installprepare.cgi
GET /HARD_DISK/installprepare.cgi?autostart_add=&webservice_name=&webservice_url= HTTP/1.1
Host: localhost.drives:8883
TTP/1.1 200 OK
.|cannot stat '4%
.|/tmp/.starter.tmpjnY
.|:
.|Invalid argument>3
SITE chmod 777 Apps/AppInit/appinit.cgi
200 Permissions changed on Apps/AppInit/appinit.cgi
GET /HARD_DISK/Apps/AppInit/appinit.cgi?install&llink.tar HTTP/1.1
Host: localhost.drives:8883
HTTP/1.1 200 OK
Installing application from file /share/llink.tar: 9~
/opt/sybhttpd/localhost.drives/HARD_DISK/Apps/AppInit/appinit.cgi
cannot open /share/Apps//appinfo.json
: -)
Invalid argument
DELE installprepare.cgi

It would be my guess that it should have /share/Apps/llink/appinfo.json


Info about my HDD, it is a mess:

Code:

drwxrwxrwx   15 nmt      nmt          4096 May 28 19:54 /share/
drwxrwxrwx   14 nmt      nmt          4096 May 27 20:45 Apps
-rwxrwxrwx    1 nmt      nmt           757 May 27 20:35 start_apps.sh

drwxrwxrwx    3 nmt      nmt          4096 May 28 19:59 AppInit

-rwxrwxrwx    1 nmt      nmt         24029 May 27 20:20 appinit.cgi
-rw-rw-rw-    1 nmt      nmt           447 May 27 20:19 httpd.conf
-rw-rw-rw-    1 nmt      nmt             4 May 27 20:19 version
-rw-rw-rw-    1 root     root            3 May 28 19:59 version_online
drwxrwxrwx    2 nmt      nmt          4096 May 27 20:19 websites

Tried from Windows laptop, same issue.

[Ger Teunis]

I've seen that one before, I think the tar file has "invalid tar magic".
Could you try to upload the tar by hand and untar it on the NMT yourself? Some tar clients seem to create a tar which cannot be extracted by the default busybox's tar but seems to work on users with my busybox.

I've to add an additional error message to appinit.cgi.
When it is displaying /share/Apps//appinit.json error it really is telling you that it wasn't able to unextract the llink.tar OR the llink.tar doesn't contain a (valid) appinfo.json file.

(05-28-2009 12:06 PM)lundman Wrote:  The wget thing made little difference, I'm trying to install "llink". True, I do end up with appinit.cgi in the right place.

Here is tcpdump, well, snippets. Sorry for the garbage, its tcpdump

[lundman]

I most certainly can. Where is it?
(On related note, can I get CSI to tell me the URL for the package of the selected item?)

[Ger Teunis]

(05-28-2009 02:05 PM)lundman Wrote:  I most certainly can. Where is it?
(On related note, can I get CSI to tell me the URL for the package of the selected item?)

Easiest way:
During install in the temp folder in the CSI folder.
Copy the tar to your desktop or so.

All download url's are available in the Main_Repository.xml in Repositories folder.

You can tell CSI to install from a local file, in windows a URL also should work as well if you enter the complete http url in the open location. Do not know if Linux or OSX would accept that as well.

[lundman]

Ah of course.

The tarball itself is fine, and untars ok. Most annoyingly, it untars to cwd! Bah, haven't had a tar do that to me since 1998

Anyway, manually trying the GET to install after uploading tar file, and untaring, I get:

Code:

telnet 192.168.11.11 8883
Trying 192.168.11.11...
Connected to 192.168.11.11.
Escape character is '^]'.
GET /HARD_DISK/Apps/AppInit/appinit.cgi?install&llink.tar HTTP/1.1
Host: localhost.drives:8883

HTTP/1.1 200 OK
Server: Syabas NMT


Application Initializer version 1.9
---------------------------------------
Checking for new version: up to date
Checking Application Initializer profile: Valid
Installing application from file /share/llink.tar: /opt/sybhttpd/localhost.drives/HARD_DISK/Apps/AppInit/appinit.cgi: line 1: cannot open /share/Apps//appinfo.json: Invalid argument
Failed
Connection closed by foreign host.

So, I upload the file again, and simply run the shell script by hand:

Code:

# ./appinit.cgi install llink.tar


Application Initializer version 1.9
---------------------------------------
Checking for new version: up to date
Checking Application Initializer profile: Valid
Installing application from file /share/llink.tar: Done
Starting LLink: Done

Neat.

I turn on sh -x, and do it via GET again:

Stand back, this is verbose:

Code:

GET /HARD_DISK/Apps/AppInit/appinit.cgi?install&llink.tar HTTP/1.1
Host: localhost.drives:8883

HTTP/1.1 200 OK
Server: Syabas NMT
+ APPS_FOLDER=/share/Apps
+ APPS_MINIMAL_APPINFO_VERSION=1
+ APPINIT_NAME=Application Initializer
+ APPINIT_FILENAME=appinit.cgi
+ APPINIT_PROFILE=/share/Apps/AppInit
+ APPINIT_VERSION=1.9
+ APPINIT_VERSION_URL=http://repository.nmtinstaller.com/appinit_version
+ APPINIT_UPGRADE_URL=http://repository.nmtinstaller.com/appinit.cgi
+ APPINIT_AUTOSTART_STATE=/tmp/appinit_state
+ CRONTAB_RELOAD=0
+ APPINIT_APPS_AUTOSTART=0
+ APPINIT_APPS_BOOTSTART=1
+ UNRAR=/mnt/syb8634/bin/unrar
+ TAR=/bin/tar
+ echo

+ echo

+ echo Application Initializer version 1.9
Application Initializer version 1.9
+ echo ---------------------------------------
---------------------------------------
+ process=1
+ appinit_prepare install&llink.tar
+ appinit_auto_upgrade install&llink.tar
+ echo -n Checking for new version:
Checking for new version: + [ ! -d /share/Apps/AppInit ]
+ rm /share/Apps/AppInit/version_online
+ wget -q -O /share/Apps/AppInit/version_online http://repository.nmtinstaller.com/appinit_version
+ [ -f /share/Apps/AppInit/version_online ]
+ cat /share/Apps/AppInit/version_online
+ [ -n 1.9 ]
+ cat /share/Apps/AppInit/version_online
+ [ 1.9 != 1.9 ]
+ echo up to date
up to date
+ appinit_profile_create
+ echo -n Checking Application Initializer profile:
Checking Application Initializer profile: + [ ! -d /share/Apps/AppInit ]
+ [ ! -f /share/Apps/AppInit/version ]
+ cat /share/Apps/AppInit/version
+ [ 1.9 != 1.9 ]
+ echo Valid
Valid
+ appinit_webserver_add
+ cat /mnt/syb8634/server/php5server/httpd.conf
+ grep /share/Apps/AppInit/httpd.conf
+ TEST=Include /share/Apps/AppInit/httpd.conf
+ [ -z Include /share/Apps/AppInit/httpd.conf ]
+ grep -v grep
+ ps
+ grep /httpd -d /mnt/syb8634/server/php5server/
+ [ -z   984 nobody    39320 S   ./httpd -d /mnt/syb8634/server/php5server/ -f /mnt/sy
  994 nobody    39344 S   ./httpd -d /mnt/syb8634/server/php5server/ -f /mnt/sy
  995 nobody    39344 S   ./httpd -d /mnt/syb8634/server/php5server/ -f /mnt/sy
1000 nobody    39344 S   ./httpd -d /mnt/syb8634/server/php5server/ -f /mnt/sy
1001 nobody    39344 S   ./httpd -d /mnt/syb8634/server/php5server/ -f /mnt/sy
1002 nobody    39344 S   ./httpd -d /mnt/syb8634/server/php5server/ -f /mnt/sy ]
+ [ 0 == 1 ]
+ appinit_autostart_remove
+ crontab -l
+ grep appinit.cgi
+ [ -n  ]
+ [ 1 == 1 ]
+ appinit_bootstart_add
+ cat /mnt/syb8634/etc/ftpserver.sh
+ grep appinit.cgi
+ [ -z /share/Apps/AppInit/appinit.cgi "$1"  > /tmp/start.out 2>&1 ]
+ [ -n install&llink.tar ]
+ [ -z  ]
+ echo install&llink.tar
+ grep &
+ [ -n install&llink.tar ]
+ string_replace install&llink.tar &  
+ STRING=install&llink.tar
+ FIND=&
+ REPLACE=
+ RIGHT=llink.tar
+ LEFT=install
+ [ install != install&llink.tar ]
+ [ llink.tar != install&llink.tar ]
+ STRING=install llink.tar
+ echo install llink.tar
+ vars=install llink.tar
+ echo install llink.tar
+ set install llink.tar
+ url_decode install
+ url=install
+ string_replace install \%2F /
+ STRING=install
+ FIND=\%2F
+ REPLACE=/
+ RIGHT=install
+ LEFT=install
+ [ install != install ]
+ echo install
+ url=install
+ string_replace install \%22 "
+ STRING=install
+ FIND=\%22
+ REPLACE="
+ RIGHT=install
+ LEFT=install
+ [ install != install ]
+ echo install
+ url=install
+ string_replace install \%20  
+ STRING=install
+ FIND=\%20
+ REPLACE=
+ RIGHT=install
+ LEFT=install
+ [ install != install ]
+ echo install
+ url=install
+ string_replace install +  
+ STRING=install
+ FIND=+
+ REPLACE=
+ RIGHT=install
+ LEFT=install
+ [ install != install ]
+ echo install
+ url=install
+ echo install
+ command=install
+ url_decode llink.tar
+ url=llink.tar
+ string_replace llink.tar \%2F /
+ STRING=llink.tar
+ FIND=\%2F
+ REPLACE=/
+ RIGHT=llink.tar
+ LEFT=llink.tar
+ [ llink.tar != llink.tar ]
+ echo llink.tar
+ url=llink.tar
+ string_replace llink.tar \%22 "
+ STRING=llink.tar
+ FIND=\%22
+ REPLACE="
+ RIGHT=llink.tar
+ LEFT=llink.tar
+ [ llink.tar != llink.tar ]
+ echo llink.tar
+ url=llink.tar
+ string_replace llink.tar \%20  
+ STRING=llink.tar
+ FIND=\%20
+ REPLACE=
+ RIGHT=llink.tar
+ LEFT=llink.tar
+ [ llink.tar != llink.tar ]
+ echo llink.tar
+ url=llink.tar
+ string_replace llink.tar +  
+ STRING=llink.tar
+ FIND=+
+ REPLACE=
+ RIGHT=llink.tar
+ LEFT=llink.tar
+ [ llink.tar != llink.tar ]
+ echo llink.tar
+ url=llink.tar
+ echo llink.tar
+ parameter=llink.tar
+ [ -z llink.tar ]
+ [ 1 == 1 ]
+ [ install == install ]
+ application_install llink.tar
+ app_install_fromfile llink.tar
+ file=llink.tar
+ echo llink.tar
+ grep ^/
+ [ -z  ]
+ [ -f /share/llink.tar ]
+ file=/share/llink.tar
+ [ ! -f /share/llink.tar ]
+ echo -n Installing application from file /share/llink.tar:
Installing application from file /share/llink.tar: + rm -Rf /share/Apps/AppInit/temp
+ mkdir -p /share/Apps/AppInit/temp
+ cd /share/Apps/AppInit/temp
+ tolower /share/llink.tar
+ echo /share/llink.tar
+ sed y/ABCDEFGHIJKLMNOPQRSTUVWXYZ/abcdefghijklmnopqrstuvwxyz/
+ eval /bin/tar -x appinfo.json -vf "/share/llink.tar"
+ [ ! -f appinfo.json ]
+ eval /bin/tar -x "./appinfo.json" -vf "/share/llink.tar"
+ [ -f /share/Apps/AppInit/temp/appinfo.json ]
+ rm -Rf /share/Apps/AppInit/temp
+ app_appinfo_parse /share/Apps//appinfo.json
+ appinfo_format=
+ name=
+ version=
+ enabled=0
+ daemon_script=
+ path=/share/Apps//
+ crontab=
+ setup_script=
+ gayaui_path=
+ webui_path=
/opt/sybhttpd/localhost.drives/HARD_DISK/Apps/AppInit/appinit.cgi: line 1: cannot open /share/Apps//appinfo.json: Invalid argument
+ [ -n  ]
+ echo Failed
Failed
+ exit 1
Connection closed by foreign host.

[Ger Teunis]

That is very weird, is you sybhttpd started as root?
To get an indication where this might go wrong:
1. Are you able to install other applications
2. Does this error occur on Windows as well as OSX?

Could you try the following using telnet or so?

Code:

/share/Apps/AppInit/appinit.cgi "install&llink.tar"

[lundman]

"/bin/tar -x appinfo.json -vf "/share/llink.tar"

That is not correct syntax. (-x does not take arguments so it would be the real first argument, and -fv switches may not follow first argument)

Code:

# tar -tf llink.tar appinfo.json
# echo $?
0
# tar -tf llink.tar appinfo.json2
# echo $?
1

You can use -xf to extract it too, but since you delete it right after, I assume it is a test for existence?
But fixing that doesn't fix the problem either..

---

I could blow away my HDD area and try .. but not sure what bits in there might still be useful. I'll play around some more tomorrow.

[Ger Teunis]

(05-28-2009 02:34 PM)lundman Wrote:  "/bin/tar -x appinfo.json -vf "/share/llink.tar"

That is not correct syntax. (-x does not take arguments so it would be the real first argument, and -fv switches may not follow first argument)

Code:

# tar -tf llink.tar appinfo.json
# echo $?
0
# tar -tf llink.tar appinfo.json2
# echo $?
1

You can use -xf to extract it too, but since you delete it right after, I assume it is a test for existence?
But fixing that doesn't fix the problem either..

---

I could blow away my HDD area and try .. but not sure what bits in there might still be useful. I'll play around some more tomorrow.

No, that is not it. You can specify which file to extract the file from the tar. All other users including myself do not see this problem. CSI is used a lot, around 2+GB on installation traffic per day so it has to be something specific on your NMT. If this was a problem that big a lot more users would have complained

Also, installing using a terminal worked for ya. so the tar is going right there. Same code is executed using terminal install as via sybhttpd.

The first untar will only extract the appinfo.json, interpret it and then will do the real untarring to the new location. It is more then just a check if the file is there. This is an enhancement for faster installation of large-number-of-files packages like DownloadManager and so.

Still interested why executing the appinit.cgi is different from sybhttpd then by hand in the terminal.

Code:

# tar cvf test.tar start_app.sh
start_app.sh
# /bin/tar -x start_app.sh -vf test.tar
start_app.sh
# echo $?
0

[Asha]

IM SOOO HAPPY!

Thanks!!!

[lundman]

(05-28-2009 02:40 PM)Ger Teunis Wrote:  No, that is not it. You can specify which file to extract the file from the tar. All other users including myself do not see this problem. CSI is used a lot, around 2+GB on installation traffic per day so it has to be something specific on your NMT. If this was a problem that big a lot more users would have complained

I didn't bother changing the tar, since that syntax works, I was just pointing out it is technically not legal

Code:

tar [[-]bundled-options Args] [gnu-style-flags]
         [filenames | -C directory-name] ...

As you can see, the "..." is last (list of filenames) and options should not follow it. Now, we all know it uses getopt() so it will just work. Anyway, merely semantics.

I'll debug more when I'm at work, since I can trigger the bug from telnet pasting the GET line.