This comment has been minimized.

There's been a bunch of scrapers ripping Giant Bomb and hosting that ripped content at their domains and serving their own ads and sometimes malware and messing with our SEO. As of now all scrapers that are not coming from known addresses of legitimate search engines (I have a detailed list, I know who is valid and who is not) will be quickly IP banned.

If this is from aggressive API usage, as long as you have logged into the site from the same address you use the API from you were not banned and you received a message from me asking for more information about what you're doing. If you're doing something cool then you'll be perfectly fine with crazy usage and I may even offer help.

If there is no record of a login from an address that's hitting us with A LOT of requests then that address is now IP banned. If you're legitimate and got caught up in that, I apologize. Clearly you're here on another IP address, so send me a message explaining what you're doing and tell me the IP address you're coming from.

We may have to require that you login from the same IP address you're using the API from.

There's a few exceptions that I know about and didn't get caught up, Kodi (XMBC), Roku etc. for example. To have triggered the ban you would have had to have done 2 - 3x the requests that Google does. Yeah, that crazy.

This comment has been minimized.

Update 0.4.1 is live. Crawler is now recording platforms a game is on when it updates a game's cache. Once this has crawled all the games currently in the db, the game page can be updated to read entirely from the database (when the game exists in db).

This comment has been minimized.

This is done and merged into dev branch. Game pages now default to loading from the database, and fall back to the GB API if the game can't be found. I did significant restructuring at the same time to split out a lot of the functionality in the Game model into a Collections model. It makes a lot more sense now.