I was trying to debug a memory leak and it doesn't seem like there isa good way to generate workload for Flume at a configurable rate, orwith configurable characteristics like payload size and header size.The sequence source is something like this, but you can't control therate of event generation at all.

What do people do now when benchmarking or debugging Flume? I wasthinking of writing a source that generates event streams withconfigurable properties. Would that be useful? Or is this need alreadymet somehow else?

> Hi All,>> I was trying to debug a memory leak and it doesn't seem like there is> a good way to generate workload for Flume at a configurable rate, or> with configurable characteristics like payload size and header size.> The sequence source is something like this, but you can't control the> rate of event generation at all.>> What do people do now when benchmarking or debugging Flume? I was> thinking of writing a source that generates event streams with> configurable properties. Would that be useful? Or is this need already> met somehow else?>> - Patrick>

>________________________________> From: Patrick Wendell <[EMAIL PROTECTED]>>To: [EMAIL PROTECTED] >Sent: Tuesday, July 17, 2012 12:28 AM>Subject: Does Flume need a workload generator?> >Hi All,>>I was trying to debug a memory leak and it doesn't seem like there is>a good way to generate workload for Flume at a configurable rate, or>with configurable characteristics like payload size and header size.>The sequence source is something like this, but you can't control the>rate of event generation at all.>>What do people do now when benchmarking or debugging Flume? I was>thinking of writing a source that generates event streams with>configurable properties. Would that be useful? Or is this need already>met somehow else?>>- Patrick>>>

NEW: Monitor These Apps!

All projects made searchable here are trademarks of the Apache Software Foundation.
Service operated by Sematext