At last, we found these messages in "/opt/SPECvirt/logs/20150529-164529/ client-100.0.54.8_1091.log" in client machine, 100.0.54.8 is our APP server's IP:Messages from: 100.0.54.8:1091-> May 23, 2015 12:11:40 PM com.sun.corba.ee.impl.encoding.CDRInputStream_1_0 readRMIIIOPValueType-> WARNING: "IOP00810211: (MARSHAL) Exception from readValue on ValueHandler in CDRInputStream"-> org.omg.CORBA.MARSHAL: vmcid: SUN minor code: 211 completed: Maybe-> at com.sun.corba.ee.impl.logging.ORBUtilSystemException.valuehandlerReadException(ORBUtilSystemException.java:8888)-> at com.sun.corba.ee.impl.encoding.CDRInputStream_1_0.readRMIIIOPValueType(CDRInputStream_1_0.java:1076)-> at com.sun.corba.ee.impl.encoding.CDRInputStream_1_0.read_value(CDRInputStream_1_0.java:1175)-> at com.sun.corba.ee.impl.encoding.CDRInputObject.read_value(CDRInputObject.java:655)-> at com.sun.corba.ee.impl.io.IIOPInputStream.inputObjectField(IIOPInputStream.java:2298)-> at com.sun.corba.ee.impl.io.IIOPInputStream.inputClassFields(IIOPInputStream.java:2552)-> at com.sun.corba.ee.impl.io.IIOPInputStream.inputObject(IIOPInputStream.java:1310)-> at com.sun.corba.ee.impl.io.IIOPInputStream.simpleReadObject(IIOPInputStream.java:449)-> at com.sun.corba.ee.impl.io.ValueHandlerImpl.readValueInternal(ValueHandlerImpl.java:364)-> at com.sun.corba.ee.impl.io.ValueHandlerImpl.readValue(ValueHandlerImpl.java:320)-> at com.sun.corba.ee.impl.encoding.CDRInputStream_1_0.readRMIIIOPValueType(CDRInputStream_1_0.java:1066)-> at com.sun.corba.ee.impl.encoding.CDRInputStream_1_0.read_value(CDRInputStream_1_0.java:1175)-> at com.sun.corba.ee.impl.encoding.CDRInputStream_1_0.read_value(CDRInputStream_1_0.java:986)-> at com.sun.corba.ee.impl.encoding.CDRInputObject.read_value(CDRInputObject.java:646)-> at com.sun.corba.ee.impl.servicecontext.UEInfoServiceContextImpl.<init>(UEInfoServiceContextImpl.java:65)-> at com.sun.corba.ee.spi.servicecontext.ServiceContextDefaults$5.create(ServiceContextDefaults.java:200)-> at com.sun.corba.ee.impl.servicecontext.ServiceContextsImpl.unmarshal(ServiceContextsImpl.java:265)-> at com.sun.corba.ee.impl.servicecontext.ServiceContextsImpl.get(ServiceContextsImpl.java:448)-> at com.sun.corba.ee.impl.protocol.CorbaClientRequestDispatcherImpl.processResponse(CorbaClientRequestDispatcherImpl.java:559)-> at com.sun.corba.ee.impl.protocol.CorbaClientRequestDispatcherImpl.marshalingComplete(CorbaClientRequestDispatcherImpl.java:369)-> at com.sun.corba.ee.impl.protocol.CorbaClientDelegateImpl.invoke(CorbaClientDelegateImpl.java:235)-> at com.sun.corba.ee.impl.presentation.rmi.StubInvocationHandlerImpl.privateInvoke(StubInvocationHandlerImpl.java:187)-> at com.sun.corba.ee.impl.presentation.rmi.StubInvocationHandlerImpl.invoke(StubInvocationHandlerImpl.java:147)-> at com.sun.corba.ee.impl.presentation.rmi.codegen.CodegenStubBase.invoke(CodegenStubBase.java:225)-> at org.spec.jappserver.mfg.workorderses.ejb._WorkOrderSes_DynamicStub.scheduleWorkOrder(org/spec/jappserver/mfg/workorderses/ejb/_WorkOrderSes_DynamicStub.java)-> at org.spec.jappserver.driver.PlannedLine.createVehicle(PlannedLine.java:416)-> at org.spec.jappserver.driver.PlannedLine.createVehicle(PlannedLine.java:375)-> at org.spec.jappserver.driver.PlannedLine.run(PlannedLine.java:193)-> Caused by: java.io.IOException: Mismatched serialization UIDs : Source (Rep. IDRMI:javax.ejb.EJBException:958C33FAE8798D83:E573C8C3FC5EB5E2) = E573C8C3FC5EB5E2 whereas Target (Rep. ID RMI:javax.ejb.EJBException:958C33FAE8798D83:0B0EB2FF36CB22F6) = 0B0EB2FF36CB22F6-> at com.sun.corba.ee.impl.util.RepositoryId.useFullValueDescription(RepositoryId.java:675)-> at com.sun.corba.ee.impl.util.RepositoryId.useFullValueDescription(RepositoryId.java:635)-> at com.sun.corba.ee.impl.io.ValueHandlerImpl.useFullValueDescription(ValueHandlerImpl.java:420)-> at com.sun.corba.ee.impl.io.IIOPInputStream.simpleReadObject(IIOPInputStream.java:446)-> at com.sun.corba.ee.impl.io.ValueHandlerImpl.readValueInternal(ValueHandlerImpl.java:364)-> at com.sun.corba.ee.impl.io.ValueHandlerImpl.readValue(ValueHandlerImpl.java:320)-> at com.sun.corba.ee.impl.encoding.CDRInputStream_1_0.readRMIIIOPValueType(CDRInputStream_1_0.java:1066)-> ... 26 more

We guess our APP server may have some error, but we can't find it. Does anyone meet it? If you can give us some hint, we will always appreciate you^_^

We would need more information to determine the cause of this issue. - Was this setup working before? Could you please share a html report confirming this, to give us an idea of the QoS?- If you repeat the run, do you run into the same issue every time?- Was GlassFish or Java version recently updated in the App Server VM, or on the client?

Please check the disk usage on the App Server VM, DB Server VM, and the clients. It is possible that Atomicity.html was not written as client disk was full.