[scm-users] Hive-server 2 throwing OutOfMemory Error

Iam running hive server 2 with heapsize of 6GB in hadoop-env.sh, 

But it is still throwing OutOfMemory Exception and still there is free memory,

The trace is 

Exception in thread "pool-7-thread-48" java.lang.OutOfMemoryError: Java heap space

java.lang.OutOfMemoryError: Java heap space

at java.util.Arrays.copyOf(Arrays.java:2367)

at java.lang.AbstractStringBuilder.expandCapacity(AbstractStringBuilder.java:130)

at java.lang.AbstractStringBuilder.ensureCapacityInternal(AbstractStringBuilder.java:114)

at java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:415)

at java.lang.StringBuffer.append(StringBuffer.java:237)

at java.io.StringWriter.write(StringWriter.java:112)

at java.io.PrintWriter.write(PrintWriter.java:456)

at java.io.PrintWriter.write(PrintWriter.java:473)

at java.io.PrintWriter.print(PrintWriter.java:603)

at java.io.PrintWriter.println(PrintWriter.java:756)

at java.lang.Throwable$WrappedPrintWriter.println(Throwable.java:764)

at java.lang.Throwable.printStackTrace(Throwable.java:658)

at java.lang.Throwable.printStackTrace(Throwable.java:721)

at org.apache.log4j.DefaultThrowableRenderer.render(DefaultThrowableRenderer.java:60)

at org.apache.log4j.spi.ThrowableInformation.getThrowableStrRep(ThrowableInformation.java:87)

at org.apache.log4j.spi.LoggingEvent.getThrowableStrRep(LoggingEvent.java:413)

at org.apache.log4j.WriterAppender.subAppend(WriterAppender.java:313)

at org.apache.log4j.DailyRollingFileAppender.subAppend(DailyRollingFileAppender.java:369)

at org.apache.log4j.WriterAppender.append(WriterAppender.java:162)

at org.apache.log4j.AppenderSkeleton.doAppend(AppenderSkeleton.java:251)

at org.apache.log4j.helpers.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:66)

at org.apache.log4j.Category.callAppenders(Category.java:206)

at org.apache.log4j.Category.forcedLog(Category.java:391)

at org.apache.log4j.Category.log(Category.java:856)

at org.slf4j.impl.Log4jLoggerAdapter.error(Log4jLoggerAdapter.java:575)

at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:41)

at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)

at org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:55)

at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:206)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

at java.lang.Thread.run(Thread.java:745)

Please check this and anyone help me on this,

It sounds like you're trying to set the memory in hadoop-env.sh, but you should set the relevant memory parameter for HiveServer2 in the CM UI instead. You can find it by clicking on Hive, Configuration, click on the HiveServer2 group on the left, then expand the subcategories and look for Resource Management. The parameter name is "Java Heap Size of HiveServer2 in Bytes". You can also search for this in the upper right search bar, or if you're already on the configuration page, in the left search bar.

Note that scm-users is for Cloudera Manager users.

I think if you are not using Cloudera Manager then you need to modify /etc/hive/conf/hive-env.sh and add an entry for HADOOP_CLIENT_OPTS with whatever JVM options you like, including heap size.