problem is that pressure is mounting for adoption and GA of sqrrl is some time away. thx> Date: Fri, 3 May 2013 14:36:50 -0400> Subject: Re: peformance> From: [EMAIL PROTECTED]> To: [EMAIL PROTECTED]> > Does sqrrl provide an example framework to play around with?> > > On Fri, May 3, 2013 at 2:20 PM, Adam Fuchs <[EMAIL PROTECTED]> wrote:> > > Hey Drew,> >> > This could be a very broad question, so I'll give a partial answer and> > encourage you to come back for more details.> >> > Impala is a mechanism that sits on top of HBase or HDFS that is design to> > filter and process large quantities of data. People generally like Impala> > because it supports a subset of SQL and because it is optimized to reduce> > the latency that might be incurred by starting up a job in a bulk> > synchronous processing framework. Instead, it uses a series of daemon> > processes and a custom API to reduce overhead.> >> > With Accumulo, our approach to low-latency queries is generally to use a> > table structure that incorporates some type of index. With appropriate> > indexing techniques, Accumulo can achieve sub-second query latencies even> > over multi-petabyte sized corpuses. Some of these table designs are> > described in the manual:> > http://accumulo.apache.org/1.4/user_manual/Table_Design.html> >> > Regarding the SQL piece, Accumulo does not natively support an SQL> > interface. For that you would need to wrap it in a processing framework,> > like Hive (https://issues.apache.org/jira/browse/ACCUMULO-143). To make a> > shameless plug, Sqrrl (www.sqrrl.com) also offers that functionality.> >> > Cheers,> > Adam> >> >> >> > On Fri, May 3, 2013 at 12:39 PM, Drew Pierce <[EMAIL PROTECTED]> wrote:> >> > > does anyone have any anecdotal results (nothing formal) for queries to> > > speak to the likes of impala and near low-latency.> > > Sent from my Android> > >> > > Sorry if brief> > >> > >> >

problem is that pressure is mounting for adoption and GA of sqrrl is some time away. thx> Date: Fri, 3 May 2013 14:36:50 -0400> Subject: Re: peformance> From: [EMAIL PROTECTED]> To: [EMAIL PROTECTED]> > Does sqrrl provide an example framework to play around with?> > > On Fri, May 3, 2013 at 2:20 PM, Adam Fuchs <[EMAIL PROTECTED]> wrote:> > > Hey Drew,> >> > This could be a very broad question, so I'll give a partial answer and> > encourage you to come back for more details.> >> > Impala is a mechanism that sits on top of HBase or HDFS that is design to> > filter and process large quantities of data. People generally like Impala> > because it supports a subset of SQL and because it is optimized to reduce> > the latency that might be incurred by starting up a job in a bulk> > synchronous processing framework. Instead, it uses a series of daemon> > processes and a custom API to reduce overhead.> >> > With Accumulo, our approach to low-latency queries is generally to use a> > table structure that incorporates some type of index. With appropriate> > indexing techniques, Accumulo can achieve sub-second query latencies even> > over multi-petabyte sized corpuses. Some of these table designs are> > described in the manual:> > http://accumulo.apache.org/1.4/user_manual/Table_Design.html> >> > Regarding the SQL piece, Accumulo does not natively support an SQL> > interface. For that you would need to wrap it in a processing framework,> > like Hive (https://issues.apache.org/jira/browse/ACCUMULO-143). To make a> > shameless plug, Sqrrl (www.sqrrl.com) also offers that functionality.> >> > Cheers,> > Adam> >> >> >> > On Fri, May 3, 2013 at 12:39 PM, Drew Pierce <[EMAIL PROTECTED]> wrote:> >> > > does anyone have any anecdotal results (nothing formal) for queries to> > > speak to the likes of impala and near low-latency.> > > Sent from my Android> > >> > > Sorry if brief> > >> > >> >

The performance characteristics of Accumulo should be assumed to beawe-inspiring. Actual performance depends on too many factors for any giventest to be meaningful to you. You won't have the same hardware. You won'thave the same network. You won't have the same data. Your data format willbe different. Your query patterns will be different. The list ofdifferences go on and on.

true David. was just looking for any feedback. thx btw for the work on the stackscript.

Sent from my Android

Sorry if brief> Date: Fri, 3 May 2013 16:53:59 -0400> Subject: Re: performance> From: [EMAIL PROTECTED]> To: [EMAIL PROTECTED]> > The performance characteristics of Accumulo should be assumed to be> awe-inspiring. Actual performance depends on too many factors for any given> test to be meaningful to you. You won't have the same hardware. You won't> have the same network. You won't have the same data. Your data format will> be different. Your query patterns will be different. The list of> differences go on and on.

NEW: Monitor These Apps!

All projects made searchable here are trademarks of the Apache Software Foundation.
Service operated by Sematext