We have a 8 node cassandra cluster running 1.0.1. After running a load
test for a day we are seeing this exception in system.log file. At
this time we are also seeing messages getting dropped. Any one has
any ideas on this?
ERROR [EXPIRING-MAP-TIMER-1] 2011-11-01 13:20:45,350
AbstractCassandraDaemon.java (line 133) Fatal exception in thread
Thread[EXPIRING-MAP-TIMER-1,5,main]
java.lang.AssertionError: /10.19.102.12
at org.apache.cassandra.service.StorageProxy.scheduleLocalHint(StorageProxy.java:339)
at org.apache.cassandra.net.MessagingService.scheduleMutationHint(MessagingService.java:201)
at org.apache.cassandra.net.MessagingService.access$500(MessagingService.java:64)
at org.apache.cassandra.net.MessagingService$2.apply(MessagingService.java:175)
at org.apache.cassandra.net.MessagingService$2.apply(MessagingService.java:152)
at org.apache.cassandra.utils.ExpiringMap$1.run(ExpiringMap.java:89)
at java.util.TimerThread.mainLoop(Timer.java:512)
at java.util.TimerThread.run(Timer.java:462)
We are also seeing the same exception in our 1.0.0 cassandra environment.
ERROR [EXPIRING-MAP-TIMER-1] 2011-10-31 14:32:57,007
AbstractCassandraDaemon.java (line 133) Fatal exception in thread
Thread[EXPIRING-MAP-TIMER-1,5,main]
java.lang.AssertionError: /10.19.101.11
at org.apache.cassandra.service.StorageProxy.scheduleLocalHint(StorageProxy.java:337)
at org.apache.cassandra.net.MessagingService.scheduleMutationHint(MessagingService.java:199)
at org.apache.cassandra.net.MessagingService.access$500(MessagingService.java:62)
at org.apache.cassandra.net.MessagingService$2.apply(MessagingService.java:173)
at org.apache.cassandra.net.MessagingService$2.apply(MessagingService.java:150)
at org.apache.cassandra.utils.ExpiringMap$1.run(ExpiringMap.java:89)
at java.util.TimerThread.mainLoop(Timer.java:512)
at java.util.TimerThread.run(Timer.java:462)
Attached is the system.log file.
thanks
Ramesh