Highlights

GZip reader/validator

Gives the ability to read a GZip file comprising of one or more concatenated GZip entries. Each entry's header is validated against the RFC specifications and the entries compressed data is made available though an InputStream. Will be refactored for v1.0.

ARC reader/validator

Read and validate v1.0 and v2.0 ARC files

v1.0 and v2.0 files are parsed and validated according to the specification.

v1.1 extension supported.

The semi-official v1.1 format is also supported.

Payload wrapper

Payload is supported and exposed to the end-user by means of a wrapper.

HttpResponse supported

HttpResponses are detected and parsed/validated and exposed to the end-user.

WARC reader/validator

Reads and validates WARC version 1.0 files. (Not all parts of the ISO are covered yet)

Multi-line headers are supported

Multi-line headers are parses and validated with the exception of UTF-8, quoted-strings and encoded words.