Could you please help me interpret this.How do I set space for Java heap.I am looking at archive on this topic, but didn't see anything similar.(most of those talk about UDF, but I am simply doing a read/write).

More explicitly: we can't help debug a pig script we haven't seen :).Send your code, and some sample data if possible.

D

On Fri, Apr 20, 2012 at 8:25 PM, Thejas Nair <[EMAIL PROTECTED]> wrote:> Which version of pig are you using ?> Does your query have just a load and store statement ?> What load and store functions are you using ?> What would be the largest size of a single tuple in your data ?>> Thanks,> Thejas>>>> On 4/20/12 1:18 PM, shan s wrote:>>>> I am simply reading 1.5 gb file with 2458220 records, and storing it back.>>>> I am getting Java Heap space error>>>> The current setting is mapred.child.java.opts -Xmx1073741824>>>>>>>> Below is the error from log.>>>> 2012-04-20 15:03:15,769 INFO>> org.apache.pig.impl.util.SpillableMemoryManager: first memory handler>> call->> Usage threshold init = 350617600(342400K) used = 522736064(510484K)>> committed = 596443136(582464K) max = 715849728(699072K)>>>>>>>> Could you please help me interpret this.How do I set space for Java heap.>> I am looking at archive on this topic, but didn't see anything similar.>> (most of those talk about UDF, but I am simply doing a read/write).>>>> Thanks, Prashant.>>>

NEW: Monitor These Apps!

All projects made searchable here are trademarks of the Apache Software Foundation.
Service operated by Sematext