JVM JIT is an awesome piece of Software craftsmanship. JIT compiles Java byte code to native platform code. The natively compiled code is stored in CodeCache, which is outside Java Heap and PermGen space. Watching this process can help in tuning CodeCache size if needed. Add the following parameter to JVM to see when a […]

Flume ships with a set of existing interceptors. Following are the interceptors that ship with Flume release Timestamp Interceptor Host Interceptor Static Interceptor UUID Interceptor Morpline Interceptor Regex Filtering Interceptor Regex Extractor Interceptor Let’s look at them briefly Timestamp Interceptor Inserts the timestamp header in the Event, representing the time at which Event was processed. […]

Update: The functionality is now officially part of Flume release. Zookeeper based configuration is not officially available as part of Flume distribution. If you want to enable it, need to apply the patch from FLUME-1491 Please refer Understanding Config file format for details on how config file is organized Applying the patch Download the patch […]

We already played with starting Flume Agent in Chapter 1. Let’s look at different options available. Flume Agent needs certain parameters to configure itself, which are passed from the command line. Lets see again how we started the Flume agent $ bin/flume-ng agent -n agent-name -c conf -f path/to/conf-file The initialization process is handled by […]