I'm interested in sending Apache2 access logs directly to CouchDB or some other document storage system. Do you know of any Apache2 modules that do this, or what options there would be to write one myself?

What you may wish to look at in logs may change over time, so why tie down a schema? Also log events are typically not tied together relationally at log event time, but through analysis in reporting.
–
Scott MarkwellAug 2 '09 at 22:22

I guess it's the same reasons why they exist for other uses :). No everything needs to be normalized and key/value dbs have other advantages.
–
chmeeeAug 1 '09 at 9:10

Sure they do -- but taking perfectly good normalized data and denormalizing it to toss into a blob that you would need to unnormalize later doesn't seem like a great use case for them :).
–
SirStanAug 1 '09 at 16:37

why do you assume it would be denormalized? My intention would be to generate one document per log event, with each document containing each piece of information in the log. The desire to use such a system is because the data is write heavy, doesn't need transactions, and will be used primarily for data analysis, all things couchdb (and similar systems) excel at. Not that MySQL can't be setup the same way, just this is where my curiosity currently is.
–
Scott MarkwellAug 2 '09 at 22:20

I've started writing a module which does this it's still at an alpha stage at the moment but you can take a look, I can't confirm it will compile on anything other than Linux at the moment though!
https://sourceforge.net/p/mod-log-couchdb/