Category Archives: Month of OSM

Bit of a gap since day 18 I know, but work and organising openstreetmap stuff got in the way of working on openstreetmap. So, today lets try to get some rails done in the calm between bugfixes;

Moved the planet generation back to 1am rather than 4am which was for db problems last night

uploading new planet in to the (mapnik) tile server. For some reason it’s not putting rendered tiles in the db since the engine change from myisam ti innodb, investigating. Hrm the filesystem has millions of directories for the temporary files… deleting…. new planet now imported… tiles seem to be rendering but there’s a backlog.

getting stevecam back up, waiting for tile server to load up new planet. Quick recompile, stevecam back up!

So it turns out the tile weirdness is because people have been trying to spider all the tiles. But, since many tiles don’t exist they get entered in the dirty queue to render.. which just expands… and expands. I’ve blocked the ips responsible and am now implementing a limit. 🙁

lunch

Limit implemented. It’s now 2,500 tiles / day / ip. Also, tiles which havn’t been viewed in more than a month (28 days) are deleted every day. See stuff over here for implementation. Cool all seems to be working.

replying to a ton of mail, organising various conferences and stuff I’m speaking at for OSM…. Added to wiki events page

Some final food for thought. Here’s a histogram with number of ip addresses on the y axis, number of tiles downloaded for the past 5 or 10 hours. As you can see the vast majority of people download under 2,000 tiles. But we get the odd person grabbing 10,000 or so. What should the limit be?

Spent the morning trying to build ruby bindings for mapnik, didn’t get anywhere, mailed mapnik-devel. update short debate on mailing list, looks easy if you know C++, mapnik, swig and python well enough but I don’t. Someone please make swig bindings for this and I’ll have your babies.

brought back stevecam. It was pointing out my window and I forgot about it sorry

What a morning! Spent it all organising various parties and the up coming conference. There’s now a party mailing list – if you want to help organise or run a mapping party please subscribe there. It’s a transitory list so feel free to just subscribe for the period of organising the party you are interested in! I’ve deprecated the old talk-london/midlands and iow lists. I’ve done some tile stuff too – they’re rendering now whilst I do other things.

Told list maintainers that they can change the language of their list pages (result of yesterdays stuff)

Doing tile stuff (they’re getting out of date, time to fix them)

Various party organising things (we have a room for sheffield thanks to sheflug it looks like!)

Went out and did some mapping whilst waiting for some tiles to generate (see below). Accidentally deleted the trace off the GPS. d’oh!

Tile stuff done for today. There’s a new layer on the map, ‘Mapnik db’, which is todays planet dump. All the tiles come from a database and 3 CPUs are rendering every tile from zoom 0-18 as I type. Currently it’s good down to about zoom 11, we’ll see where it is tomorrow.