[m-dev.] diff: move htdig index creation to /var/spool/htdig

[Tyson Dowd]

Hi,

The web page search has been flakey for the last few weeks.
This should help it become independent of NFS.

===================================================================


Estimated hours taken: 1

Move the htdig process off the NFS partition, as this was very slow.

We can store these files locally on hydra (hydra is the only machine
running htsearch anyway).

bin/install_webpages:
	Add the change that someone had made to the checked out copy
	but not the CVS copy (add -i to htdig).
	Work in /var/spool/htdig instead.
	
htdig/htdig-mercury.conf:
	Work in /var/spool/htdig instead.
	

Index: bin/install_webpages
===================================================================
RCS file: /home/mercury1/repository/w3/bin/install_webpages,v
retrieving revision 1.16
diff -u -r1.16 install_webpages
--- bin/install_webpages	2000/07/26 16:15:46	1.16
+++ bin/install_webpages	2000/08/07 03:25:26
@@ -55,12 +55,13 @@
 umask 002
 
     # Index the web-site for searching.
-htdig -c /etc/htdig/htdig-mercury.conf -a
+htdig -c /etc/htdig/htdig-mercury.conf -a -i
 htmerge -c /etc/htdig/htdig-mercury.conf -a
 
     # Replace the work files with their alternate versions.
-cd /home/mercury5/htdig
+cd /var/spool/htdig
 for file in `ls *.work`
 do
     mv $file `basename $file .work`
 done
+
Index: htdig/htdig-mercury.conf
===================================================================
RCS file: /home/mercury1/repository/w3/htdig/htdig-mercury.conf,v
retrieving revision 1.3
diff -u -r1.3 htdig-mercury.conf
--- htdig/htdig-mercury.conf	2000/03/10 01:57:04	1.3
+++ htdig/htdig-mercury.conf	2000/08/07 03:24:23
@@ -18,7 +18,10 @@
 # plenty of free disk space available for the databases.  They can get
 # pretty big.
 #
-database_dir:		/home/mercury5/htdig/
+#database_dir:		/home/mercury5/htdig/
+#
+# NFS slows down the process significantly. 
+database_dir:		/var/spool/htdig/
 
 #
 # This specifies the URL where the robot (htdig) will start.  You can specify


-- 
       Tyson Dowd           # 
                            #  Surreal humour isn't everyone's cup of fur.
     trd at cs.mu.oz.au        # 
http://www.cs.mu.oz.au/~trd #
--------------------------------------------------------------------------
mercury-developers mailing list
Post messages to:       mercury-developers at cs.mu.oz.au
Administrative Queries: owner-mercury-developers at cs.mu.oz.au
Subscriptions:          mercury-developers-request at cs.mu.oz.au
--------------------------------------------------------------------------