Hello
I have a tricky problem I can't solve:
I have pages like this:
www.blabla.com/tutu/index.html
www.blabla.com/index.html
Basically, it's the same page, except for some content that I don't want
to index. So I want those two pages to be indexed as one.
Sadly, the content is slightly different, so the MD5 function is not
working. So I was wondering if it would be possible to give some rules to
the spider to tell him
"link "/tutu/index.html" is OK, but follow "/index.html" instead, please,
will you?"
Thanks in advance for your help!
François