This is one of the first problems I ran into as well. I solved it by making
the search string in swishspider less strict. From:
if ($response->header("content-type") eq "text/html") {
I changed it into:
if ($response->header("content-type") =~ /text\/html/i) {
That way it accounts for any additional text in the Content-Type. Solved.
- Mark
System Administrator Asarian-host.org
----- Original Message -----
From: "David Norris" <dave@webaugur.com>
To: "Multiple recipients of list" <swish-e@sunsite.berkeley.edu>
Sent: Monday, June 12, 2000 1:14 PM
Subject: [SWISH-E] Re: HTTP spidering - zero results
> Angel Parn wrote:
> > Lynx response:
> > Content-Type: text/html
> > Seems bad. What I have to do ?
>
> Well, I am stumped. Hopefully someone else will have a good answer.
> I'm not extremely familiar with the spider. (other than wanting to rip
> out my hair every time I try to use it ;-)
>
> Half of the errors seem to be related to PERL being brain-dead and the
> other half minor config errors. At this point I'd hate to guess which.