We appreciate the enormous support that our ABestWeb community has experienced over the many years it has served its members and sponsors. We have decided to exit this business and have placed the property up for sale and we are actively entertaining interest.

In the meantime, community members will be able to read but not post to ABestWeb beginning on Jan. 18.

We want to thank you for your numerous contributions and your ongoing support. If you have any questions, please let us know.

I use cPanel but just to check logs, etc. Otherwise I use CuteFTP. I did contact host and this was the reply I got:
>Our system use our logs, so you can be sure about your Bandwich.I have checked it and as I see our log is not hacked, so your Bandwich is correct.<

I use cPanel but just to check logs, etc. Otherwise I use CuteFTP. I did contact host and this was the reply I got:
>Our system use our logs, so you can be sure about your Bandwich.I have checked it and as I see our log is not hacked, so your Bandwich is correct.<

This make sense to You?

That's interesting. My host calculates the bandwidth separately and said there was a big difference between what they were seeing and what cpanel was reporting. That's when they mentioned the cpanel bandwidth bug. Google "cpanel bandwidth bug" and you'll see what I'm talking about. You should probably point your host's tech support team to some of those search results.

-Don't criticize anyone til you've walked a mile in their shoes. Then when you do criticize them, you'll be a mile away and have their shoes.
- Silence is golden. Duct Tape is silver.

Can you (or anyone) recommend a host that handles ALL scripts like GoldenCan, PopShops and the eBay "EasyNicheStore" without changing their PHP rules all the time, caching your directories, and on and on! When I wasn't looking for a new host I'd see recommendations all the time and now can't find any.
I don't care if it's an affiliate recommendation - just a host that's kind to dumbells!

FastNext.com might have their ABW special still going. Nothing wrong with clicking your own GoDaddy or Dotster creative ( on CJ) and using their low cost hosting services. I about flipped when I saw my monthly EPC at CJ over 1450.00 so I know those 2 report.... LOL

Webmaster's... Mike and Charlie

"What have you done today to put real value into a referral click...from a shoppers viewpoint!"

My bandwidth used goes through the roof when I get hit with the scraping bots from Europe, they can 40-100 hits/minute @ 10K/ - when they decide to go after me it goes for several hours - I had to incorporate a 'trap' to block them at the start of my index.php - blocking them at .htaccess ... won't work because they change IP every couple of minutes

In cPanel in Latest Hits, this morning I'm using over 3GB and a directory using GoldenCan with thousands and thousands of little links of Overstock items have this ..http://www.cuill.com/twiceler/robot.html
When I followed the above link it says on the page

>Webmaster Information
Twiceler is an experimental robot. The user-agent is “twiceler.” It could take 24-48 hours for us to re-read your robots.txt file. If you need something blocked immediately, please let us know. <

So this is what's causing it, right? Would you tell them to stop (before they get to my Walmart directory! oh my! ) or keep an eye on your bandwidth and let it go?

In cPanel in Latest Hits, this morning I'm using over 3GB and a directory using GoldenCan with thousands and thousands of little links of Overstock items have this ..http://www.cuill.com/twiceler/robot.html
When I followed the above link it says on the page

>Webmaster Information
Twiceler is an experimental robot. The user-agent is “twiceler.” It could take 24-48 hours for us to re-read your robots.txt file. If you need something blocked immediately, please let us know. <

So this is what's causing it, right? Would you tell them to stop (before they get to my Walmart directory! oh my! ) or keep an eye on your bandwidth and let it go?

Thanks for all the replies in this thread BTW!

Karin

Twiceler is a bad bot. It WILL NOT obey your robots.txt file.

Put the following in your .htacess file on your server.

Code:

SetEnvIfNoCase User-Agent .*Twiceler.* bad_bot
order allow,deny
deny from env=bad_bot
allow from all

It will block the bot and send it a 403.

You can block any bot you want to by just adding it to your .htacess file by adding a new line for it.

Thank you, Burger Boy! Did it. I have some other sites on the same server so will do that on the others . Shucks, I thought it might be a new search engine. Many many years ago when Google started up I'd see Google in my hits and wonder "What's a Google".

SetEnvIfNoCase User-Agent .*Twiceler.* bad_bot
order allow,deny
deny from env=bad_bot
allow from all

It will block the bot and send it a 403.

You can block any bot you want to by just adding it to your .htacess file by adding a new line for it.

Example:

Code:

SetEnvIfNoCase User-Agent .*Exabot.* bad_bot

You just add the

Code:

order allow,deny
deny from env=bad_bot
allow from all

once.

After that add a new line for each bot that you want blocked.

Thanks so much for that, BurgerBoy. One question, though, for those of us who are pretty ".htaccess impaired" about these things:

Does it matter WHERE in the order of lines in .htaccess I put this code?

I'm never sure when adding stuff to .htaccess just where I should put it. Most of my sites are WordPress installs, and I know WordPress puts several lines of code in the .htaccess file -- do you know where these commands would go in relation to the WP lines?

Also -- my webhost had me put this in the .htaccess file:

php_value register_globals 1

Any ideas about how THAT line fits into the mix?

Did I say "one question"? Hmmm ... need to work on my basic counting skills, I guess.

As I find new bad bots on my sites I just add a new line banning them also.

Thank you, thank you, thank you, BurgerBoy. Very helpful. I'll give it a shot. I have a couple of sites that are getting a lot of bot activity, now I'll give 'em a closer look and see what I want to do. Great!

I did put your instructions in the .htaccess file, Burgerboy, but Twiceler is still grinding away through all those GoldenCan datafeed links this morning.

I wrote to Jim per the message on their website - so far my bandwidth this morning has used 76% - and asked him to make it stop and keep the bot from moving on to the other sites on this server - one of them has PopShops along With GoldenCan.

Yesterday was probably too late to stop it .. locking the barn afer the horse. Probly today will keep it from starting fresh on other site.

WriterGuy - It took a day to get it off my site - and I did also write to Jim of Twiceler per that websites instructions. http://www.cuill.com/twiceler/robot.html
>Webmaster Information
Twiceler is an experimental robot. The user-agent is “twiceler.” It could take 24-48 hours for us to re-read your robots.txt file. If you need something blocked immediately, please let us know. <