Aggregate Operations

You can now add your own on-the-fly aggregate operations. This can be done by creating an instance of AggregateReader.AggregateOperation (anonymous or subclass) and then adding it to AggregateReader.add(AggregateOperation ... operations). You’ll then be able to collect and compile stats about your data as it streams by.

XPath Debugging

All XPath-based readers (XmlReader, JsonReader, and JavaBeanReader) now support a debug flag.

Setting the flag forces the readers to log all XPaths they can see from your data stream in real-time. Regardless of whether or not they match your field and break rules.

This allows you to quickly build new data extraction jobs or fix broken ones by seeing exactly what the engine sees.