Hello,
The problem you face is known. Memory leaks have been created in a
previous version. As a consequence, there OS refuses to allocate more
memory to your indexing process.
There are several way to solve or bypass it:
- create multiple indexes and then search on all of them. inconvenient:
need to merge results with post-processing when searching.
- create indexes and then merge them. I did it ok for 11'000 files.
- patch the indexer with information given from the website under patches:
memoryleak2- I have not had a chance to test it though. It is probably
your best chance and requires less work.
Good luck,
Stephane Meier
stephane_meier@non-hp-switzerland-om1.om.hp.com
-----Original Message-----
From: Simon.Baumberg@ComConsult.de [mailto:Simon.Baumberg@ComConsult.de]
Sent: 9 juillet 1999 12:53
To: swish-e@sunsite.berkeley.edu
Cc: Simon.Baumberg@ComConsult.de
Subject: [SWISH-E] size limitations or...
Hello,
I have begun to configure and use Swish-e on our intranet for the first
time
and have run into the following error message while trying to create an
index file.
/usr/local/bin/swish-e -i /mnt/htmldocs/ -c /opt/swish/src/user.config -f
./search/swish/index -v 3 > swishindex.log
swish: Ran out of memory (could not allocate enough)!
I have roughly over 20,000 files (including .gifs etc, although I have
opted
not to index them in the config file) using roughly 330MB space on the hd.
I
have roughly 310MB free space on the hd.
server harddisk
Used : ~330 MB
Available : ~310
Total : ~640 MB
Has anybody experienced problems with similar amounts of files to index?
Since I have no idea how to proceed with this problem except blindly
testing
different configurations and go from there, I would appreciate if somebody
with more experience with swish-e could point me in the general direction
of
the problem/solution.
Thanks in advance
S. Baumberg
simon.baumberg.comconsult.de