{"action":"created","issue":{"url":"https://api.github.com/repos/dianping/cat/issues/987","repository_url":"https://api.github.com/repos/dianping/cat","labels_url":"https://api.github.com/repos/dianping/cat/issues/987/labels{/name}","comments_url":"https://api.github.com/repos/dianping/cat/issues/987/comments","events_url":"https://api.github.com/repos/dianping/cat/issues/987/events","html_url":"https://github.com/dianping/cat/issues/987","id":147332429,"node_id":"MDU6SXNzdWUxNDczMzI0Mjk=","number":987,"title":"cat problem heartbeat每秒都会报个错，帮忙看看这个错误。","user":{"login":"MichaelMaGG","id":6170926,"node_id":"MDQ6VXNlcjYxNzA5MjY=","avatar_url":"https://avatars3.githubusercontent.com/u/6170926?v=4","gravatar_id":"","url":"https://api.github.com/users/MichaelMaGG","html_url":"https://github.com/MichaelMaGG","followers_url":"https://api.github.com/users/MichaelMaGG/followers","following_url":"https://api.github.com/users/MichaelMaGG/following{/other_user}","gists_url":"https://api.github.com/users/MichaelMaGG/gists{/gist_id}","starred_url":"https://api.github.com/users/MichaelMaGG/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/MichaelMaGG/subscriptions","organizations_url":"https://api.github.com/users/MichaelMaGG/orgs","repos_url":"https://api.github.com/users/MichaelMaGG/repos","events_url":"https://api.github.com/users/MichaelMaGG/events{/privacy}","received_events_url":"https://api.github.com/users/MichaelMaGG/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":2,"created_at":"2016-04-11T06:56:49Z","updated_at":"2019-01-02T11:12:41Z","closed_at":"2016-04-13T03:30:21Z","author_association":"NONE","body":"这个错误信息是因为什么报出来的，或者有没有什么解决的思路。\n\n<thread count=\"403\" daemon-count=\"398\" peek-count=\"462\" total-started-count=\"41981\" cat-thread-count=\"0\" pigeon-thread-count=\"0\" http-thread-count=\"0\"> \n<dump>1: \"C3P0PooledConnectionPoolManager[identityToken-&gt;1k5vyud9f1s26nvgl1oubf|47fbeb99]-AdminTaskTimer\" Id=71 TIMED_WAITING on java.util.TaskQueue@5cfff913 \nat java.lang.Object.wait(Native Method) \n- waiting on java.util.TaskQueue@5cfff913 \n  at java.util.TimerThread.mainLoop(Timer.java:552) \n  at java.util.TimerThread.run(Timer.java:505) \n\n2: \"C3P0PooledConnectionPoolManager[identityToken-&gt;1k5vyud9f1s26nvgl1oubf|47fbeb99]-HelperThread-#0\" Id=20848 TIMED_WAITING on com.mchange.v2.async.ThreadPoolAsynchronousRunner@218fbbbd \nat java.lang.Object.wait(Native Method) \n- waiting on com.mchange.v2.async.ThreadPoolAsynchronousRunner@218fbbbd \n  at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:683) \n\n...\n\n8: \"C3P0PooledConnectionPoolManager[identityToken-&gt;1k5vyud9f1s26nvgl1oubf|5244292a]-AdminTaskTimer\" Id=473 TIMED_WAITING on java.util.TaskQueue@2dbd9301 \nat java.lang.Object.wait(Native Method) \n- waiting on java.util.TaskQueue@2dbd9301 \n  at java.util.TimerThread.mainLoop(Timer.java:552) \n  at java.util.TimerThread.run(Timer.java:505) \n\n...\n\n15: \"C3P0PooledConnectionPoolManager[identityToken-&gt;1sxczk1na2luj1vn7pyq|19fc1ad2]-AdminTaskTimer\" Id=510 TIMED_WAITING on java.util.TaskQueue@5faa6c90 \nat java.lang.Object.wait(Native Method) \n- waiting on java.util.TaskQueue@5faa6c90 \n  at java.util.TimerThread.mainLoop(Timer.java:552) \n  at java.util.TimerThread.run(Timer.java:505) \n\n16: \"C3P0PooledConnectionPoolManager[identityToken-&gt;1sxczk1na2luj1vn7pyq|19fc1ad2]-HelperThread-#0\" Id=511 TIMED_WAITING on com.mchange.v2.async.ThreadPoolAsynchronousRunner@3307cc21 \nat java.lang.Object.wait(Native Method) \n- waiting on com.mchange.v2.async.ThreadPoolAsynchronousRunner@3307cc21 \n  at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:683) \n\n...\n\n22: \"C3P0PooledConnectionPoolManager[identityToken-&gt;1sxczk1na2luj1vn7pyq|382966]-AdminTaskTimer\" Id=208 TIMED_WAITING on java.util.TaskQueue@23fc4d18 \nat java.lang.Object.wait(Native Method) \n- waiting on java.util.TaskQueue@23fc4d18 \n  at java.util.TimerThread.mainLoop(Timer.java:552) \n  at java.util.TimerThread.run(Timer.java:505) \n\n23: \"C3P0PooledConnectionPoolManager[identityToken-&gt;1sxczk1na2luj1vn7pyq|382966]-HelperThread-#0\" Id=209 TIMED_WAITING on com.mchange.v2.async.ThreadPoolAsynchronousRunner@6707d57c \nat java.lang.Object.wait(Native Method) \n- waiting on com.mchange.v2.async.ThreadPoolAsynchronousRunner@6707d57c \n  at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:683) \n\n...\n\n28: \"C3P0PooledConnectionPoolManager[identityToken-&gt;1sxczk1na2luj1vn7pyq|382966]-HelperThread-#5\" Id=20849 TIMED_WAITING on com.mchange.v2.async.ThreadPoolAsynchronousRunner@6707d57c \nat java.lang.Object.wait(Native Method) \n- waiting on com.mchange.v2.async.ThreadPoolAsynchronousRunner@6707d57c \n  at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:683) \n\n29: \"Cat-ModelService-0\" Id=303 WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@30ec25df \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@30ec25df \n  at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) \n  at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) \n  at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) \n  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) \n  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) \n  at java.lang.Thread.run(Thread.java:745) \n  ... \n\n... ... ... \n\n146: \"Cat-RealtimeConsumer-TransactionAnalyzer-14-1\" Id=41866 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@ff3f111 \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@ff3f111 \n  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) \n  at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) \n  at com.dianping.cat.message.io.DefaultMessageQueue.poll(DefaultMessageQueue.java:49) \n  at com.dianping.cat.analysis.AbstractMessageAnalyzer.analyze(AbstractMessageAnalyzer.java:40) \n  at com.dianping.cat.analysis.PeriodTask.run(PeriodTask.java:80) \n  at java.lang.Thread.run(Thread.java:745) \n  ... \n\n147: \"ContainerBackgroundProcessor[StandardEngine[Catalina]]\" Id=287 TIMED_WAITING \nat java.lang.Thread.sleep(Native Method) \nat org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1508) \nat java.lang.Thread.run(Thread.java:745) \n\n148: \"Finalizer\" Id=3 WAITING on java.lang.ref.ReferenceQueue$Lock@20e3be49 \nat java.lang.Object.wait(Native Method) \n- waiting on java.lang.ref.ReferenceQueue$Lock@20e3be49 \n  at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135) \n  at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:151) \n  at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209) \n\n149: \"GC Daemon\" Id=10 TIMED_WAITING on sun.misc.GC$LatencyLock@1f382c4a \nat java.lang.Object.wait(Native Method) \n- waiting on sun.misc.GC$LatencyLock@1f382c4a \n  at sun.misc.GC$Daemon.run(GC.java:117) \n\n150: \"Keep-Alive-SocketCleaner\" Id=42000 WAITING on sun.net.www.http.KeepAliveStreamCleaner@2f9f1c0f \nat java.lang.Object.wait(Native Method) \n- waiting on sun.net.www.http.KeepAliveStreamCleaner@2f9f1c0f \n  at sun.net.www.http.KeepAliveStreamCleaner.run(KeepAliveStreamCleaner.java:101) \n  at java.lang.Thread.run(Thread.java:745) \n\n151: \"Reference Handler\" Id=2 WAITING on java.lang.ref.Reference$Lock@47e1bb7d \nat java.lang.Object.wait(Native Method) \n- waiting on java.lang.ref.Reference$Lock@47e1bb7d \n  at java.lang.Object.wait(Object.java:503) \n  at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:133) \n\n152: \"Signal Dispatcher\" Id=4 RUNNABLE \n\n153: \"Thread-15\" Id=202 RUNNABLE (in native) \nat sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) \nat sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) \nat sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) \nat sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) \nat sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) \nat io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:622) \nat io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:310) \nat io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116) \n... \n\n154: \"Thread-4\" Id=65 RUNNABLE (in native) \nat sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) \nat sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) \nat sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) \nat sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) \nat sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) \nat io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:622) \nat io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:310) \nat io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116) \n... \n\n155: \"cat-Aggreation-Config-Reload\" Id=126 TIMED_WAITING \nat java.lang.Thread.sleep(Native Method) \nat com.dianping.cat.config.web.js.AggregationConfigManager$ConfigReloadTask.run(AggregationConfigManager.java:179) \nat java.lang.Thread.run(Thread.java:745) \nat org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n156: \"cat-App\" Id=139 TIMED_WAITING \nat java.lang.Thread.sleep(Native Method) \nat com.dianping.cat.report.alert.app.AppAlert.run(AppAlert.java:257) \nat java.lang.Thread.run(Thread.java:745) \nat org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n157: \"cat-App-Config-Reload\" Id=122 TIMED_WAITING \nat java.lang.Thread.sleep(Native Method) \nat com.dianping.cat.config.app.AppConfigManager$ConfigReloadTask.run(AppConfigManager.java:567) \nat java.lang.Thread.run(Thread.java:745) \nat org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n158: \"cat-App-Rule-Config-Reload\" Id=150 TIMED_WAITING \nat java.lang.Thread.sleep(Native Method) \nat com.dianping.cat.config.app.command.CommandFormatConfigManager$ConfigReloadTask.run(CommandFormatConfigManager.java:184) \nat java.lang.Thread.run(Thread.java:745) \nat org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n159: \"cat-App-Speed-Config-Reload\" Id=123 TIMED_WAITING \nat java.lang.Thread.sleep(Native Method) \nat com.dianping.cat.config.app.AppSpeedConfigManager$ConfigReloadTask.run(AppSpeedConfigManager.java:214) \nat java.lang.Thread.run(Thread.java:745) \nat org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n160: \"cat-Business\" Id=133 TIMED_WAITING \nat java.lang.Thread.sleep(Native Method) \nat com.dianping.cat.report.alert.BaseAlert.run(BaseAlert.java:176) \nat java.lang.Thread.run(Thread.java:745) \nat org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n161: \"cat-Cache\" Id=144 TIMED_WAITING \nat java.lang.Thread.sleep(Native Method) \nat com.dianping.cat.report.alert.storage.AbstractStorageAlert.run(AbstractStorageAlert.java:306) \nat java.lang.Thread.run(Thread.java:745) \nat org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n162: \"cat-Config-Reload\" Id=121 TIMED_WAITING \nat java.lang.Thread.sleep(Native Method) \nat com.dianping.cat.report.page.ConfigReloadTask.run(ConfigReloadTask.java:74) \nat java.lang.Thread.run(Thread.java:745) \nat org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n163: \"cat-Database\" Id=131 TIMED_WAITING \nat java.lang.Thread.sleep(Native Method) \nat com.dianping.cat.report.alert.BaseAlert.run(BaseAlert.java:176) \nat java.lang.Thread.run(Thread.java:745) \nat org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n164: \"cat-Event\" Id=142 TIMED_WAITING \nat java.lang.Thread.sleep(Native Method) \nat com.dianping.cat.report.alert.event.EventAlert.run(EventAlert.java:269) \nat java.lang.Thread.run(Thread.java:745) \nat org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n165: \"cat-Exception\" Id=134 TIMED_WAITING \nat java.lang.Thread.sleep(Native Method) \nat com.dianping.cat.report.alert.exception.ExceptionAlert.run(ExceptionAlert.java:134) \nat java.lang.Thread.run(Thread.java:745) \nat org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n166: \"cat-FrontEnd\" Id=135 TIMED_WAITING \nat java.lang.Thread.sleep(Native Method) \nat com.dianping.cat.report.alert.exception.FrontEndExceptionAlert.run(FrontEndExceptionAlert.java:74) \nat java.lang.Thread.run(Thread.java:745) \nat org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n167: \"cat-Heartbeat\" Id=136 TIMED_WAITING \nat java.lang.Thread.sleep(Native Method) \nat com.dianping.cat.report.alert.heartbeat.HeartbeatAlert.run(HeartbeatAlert.java:377) \nat java.lang.Thread.run(Thread.java:745) \nat org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n168: \"cat-LocalMessageBucketManager-BlockDumper\" Id=79 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@4b03a7d6 \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@4b03a7d6 \n  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) \n  at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) \n  at com.dianping.cat.consumer.dump.BlockDumper.run(BlockDumper.java:47) \n  at java.lang.Thread.run(Thread.java:745) \n  at org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n169: \"cat-LocalMessageBucketManager-OldMessageMover\" Id=80 TIMED_WAITING \nat java.lang.Thread.sleep(Native Method) \nat com.dianping.cat.consumer.dump.LogviewUploader.run(LogviewUploader.java:217) \nat java.lang.Thread.run(Thread.java:745) \nat org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n170: \"cat-Message-Gzip-0\" Id=81 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@3f0a8297 \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@3f0a8297 \n  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) \n  at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) \n  at com.dianping.cat.consumer.dump.LocalMessageBucketManager$MessageGzip.run(LocalMessageBucketManager.java:325) \n  at java.lang.Thread.run(Thread.java:745) \n  at org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n171: \"cat-Message-Gzip-1\" Id=82 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@5dafc666 \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@5dafc666 \n  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) \n  at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) \n  at com.dianping.cat.consumer.dump.LocalMessageBucketManager$MessageGzip.run(LocalMessageBucketManager.java:325) \n  at java.lang.Thread.run(Thread.java:745) \n  at org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n172: \"cat-Message-Gzip-10\" Id=91 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7a6967db \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7a6967db \n  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) \n  at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) \n  at com.dianping.cat.consumer.dump.LocalMessageBucketManager$MessageGzip.run(LocalMessageBucketManager.java:325) \n  at java.lang.Thread.run(Thread.java:745) \n  at org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n173: \"cat-Message-Gzip-11\" Id=92 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@65bf6c74 \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@65bf6c74 \n  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) \n  at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) \n  at com.dianping.cat.consumer.dump.LocalMessageBucketManager$MessageGzip.run(LocalMessageBucketManager.java:325) \n  at java.lang.Thread.run(Thread.java:745) \n  at org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n174: \"cat-Message-Gzip-12\" Id=93 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@17804341 \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@17804341 \n  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) \n  at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) \n  at com.dianping.cat.consumer.dump.LocalMessageBucketManager$MessageGzip.run(LocalMessageBucketManager.java:325) \n  at java.lang.Thread.run(Thread.java:745) \n  at org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n175: \"cat-Message-Gzip-13\" Id=94 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@c148659 \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@c148659 \n  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) \n  at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) \n  at com.dianping.cat.consumer.dump.LocalMessageBucketManager$MessageGzip.run(LocalMessageBucketManager.java:325) \n  at java.lang.Thread.run(Thread.java:745) \n  at org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n176: \"cat-Message-Gzip-14\" Id=95 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@26d391f9 \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@26d391f9 \n  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) \n  at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) \n  at com.dianping.cat.consumer.dump.LocalMessageBucketManager$MessageGzip.run(LocalMessageBucketManager.java:325) \n  at java.lang.Thread.run(Thread.java:745) \n  at org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n177: \"cat-Message-Gzip-15\" Id=96 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@2ea4552b \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@2ea4552b \n  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) \n  at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) \n  at com.dianping.cat.consumer.dump.LocalMessageBucketManager$MessageGzip.run(LocalMessageBucketManager.java:325) \n  at java.lang.Thread.run(Thread.java:745) \n  at org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n178: \"cat-Message-Gzip-16\" Id=97 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@3584ff88 \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@3584ff88 \n  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) \n  at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) \n  at com.dianping.cat.consumer.dump.LocalMessageBucketManager$MessageGzip.run(LocalMessageBucketManager.java:325) \n  at java.lang.Thread.run(Thread.java:745) \n  at org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n179: \"cat-Message-Gzip-17\" Id=98 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@15ff71c0 \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@15ff71c0 \n  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) \n  at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) \n  at com.dianping.cat.consumer.dump.LocalMessageBucketManager$MessageGzip.run(LocalMessageBucketManager.java:325) \n  at java.lang.Thread.run(Thread.java:745) \n  at org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n180: \"cat-Message-Gzip-18\" Id=99 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@632ae865 \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@632ae865 \n  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) \n  at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) \n  at com.dianping.cat.consumer.dump.LocalMessageBucketManager$MessageGzip.run(LocalMessageBucketManager.java:325) \n  at java.lang.Thread.run(Thread.java:745) \n  at org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n181: \"cat-Message-Gzip-19\" Id=100 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@32b27913 \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@32b27913 \n  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) \n  at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) \n  at com.dianping.cat.consumer.dump.LocalMessageBucketManager$MessageGzip.run(LocalMessageBucketManager.java:325) \n  at java.lang.Thread.run(Thread.java:745) \n  at org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n182: \"cat-Message-Gzip-2\" Id=83 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@753c9a33 \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@753c9a33 \n  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) \n  at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) \n  at com.dianping.cat.consumer.dump.LocalMessageBucketManager$MessageGzip.run(LocalMessageBucketManager.java:325) \n  at java.lang.Thread.run(Thread.java:745) \n  at org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n183: \"cat-Message-Gzip-3\" Id=84 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@6f945c5f \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@6f945c5f \n  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) \n  at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) \n  at com.dianping.cat.consumer.dump.LocalMessageBucketManager$MessageGzip.run(LocalMessageBucketManager.java:325) \n  at java.lang.Thread.run(Thread.java:745) \n  at org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n184: \"cat-Message-Gzip-4\" Id=85 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@62b93dfb \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@62b93dfb \n  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) \n  at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) \n  at com.dianping.cat.consumer.dump.LocalMessageBucketManager$MessageGzip.run(LocalMessageBucketManager.java:325) \n  at java.lang.Thread.run(Thread.java:745) \n  at org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n185: \"cat-Message-Gzip-5\" Id=86 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@50e6d53b \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@50e6d53b \n  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) \n  at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) \n  at com.dianping.cat.consumer.dump.LocalMessageBucketManager$MessageGzip.run(LocalMessageBucketManager.java:325) \n  at java.lang.Thread.run(Thread.java:745) \n  at org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n186: \"cat-Message-Gzip-6\" Id=87 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@4a2535ac \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@4a2535ac \n  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) \n  at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) \n  at com.dianping.cat.consumer.dump.LocalMessageBucketManager$MessageGzip.run(LocalMessageBucketManager.java:325) \n  at java.lang.Thread.run(Thread.java:745) \n  at org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n187: \"cat-Message-Gzip-7\" Id=88 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@4f2be287 \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@4f2be287 \n  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) \n  at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) \n  at com.dianping.cat.consumer.dump.LocalMessageBucketManager$MessageGzip.run(LocalMessageBucketManager.java:325) \n  at java.lang.Thread.run(Thread.java:745) \n  at org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n188: \"cat-Message-Gzip-8\" Id=89 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@2fee70be \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@2fee70be \n  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) \n  at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) \n  at com.dianping.cat.consumer.dump.LocalMessageBucketManager$MessageGzip.run(LocalMessageBucketManager.java:325) \n  at java.lang.Thread.run(Thread.java:745) \n  at org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n189: \"cat-Message-Gzip-9\" Id=90 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@1e2199a6 \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@1e2199a6 \n  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) \n  at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) \n  at com.dianping.cat.consumer.dump.LocalMessageBucketManager$MessageGzip.run(LocalMessageBucketManager.java:325) \n  at java.lang.Thread.run(Thread.java:745) \n  at org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n190: \"cat-NetGraphUpdate\" Id=148 TIMED_WAITING \nat java.lang.Thread.sleep(Native Method) \nat com.dianping.cat.report.page.network.nettopology.NetGraphManager$NetGraphReloader.run(NetGraphManager.java:184) \nat java.lang.Thread.run(Thread.java:745) \nat org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n191: \"cat-Network\" Id=130 TIMED_WAITING \nat java.lang.Thread.sleep(Native Method) \nat com.dianping.cat.report.alert.BaseAlert.run(BaseAlert.java:176) \nat java.lang.Thread.run(Thread.java:745) \nat org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n192: \"cat-RealtimeConsumer-PeriodManager\" Id=120 TIMED_WAITING \nat java.lang.Thread.sleep(Native Method) \nat com.dianping.cat.analysis.PeriodManager.run(PeriodManager.java:96) \nat java.lang.Thread.run(Thread.java:745) \nat org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n193: \"cat-SQL\" Id=143 TIMED_WAITING \nat java.lang.Thread.sleep(Native Method) \nat com.dianping.cat.report.alert.storage.AbstractStorageAlert.run(AbstractStorageAlert.java:306) \nat java.lang.Thread.run(Thread.java:745) \nat org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n194: \"cat-Server-Filter-Config-Reload\" Id=78 TIMED_WAITING \nat java.lang.Thread.sleep(Native Method) \nat com.dianping.cat.config.server.ServerFilterConfigManager$ConfigReloadTask.run(ServerFilterConfigManager.java:168) \nat java.lang.Thread.run(Thread.java:745) \nat org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n195: \"cat-StatusUpdateTask\" Id=69 TIMED_WAITING \nat java.lang.Thread.sleep(Native Method) \nat com.dianping.cat.status.StatusUpdateTask.run(StatusUpdateTask.java:177) \nat java.lang.Thread.run(Thread.java:745) \nat org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n196: \"cat-System\" Id=132 TIMED_WAITING \nat java.lang.Thread.sleep(Native Method) \nat com.dianping.cat.report.alert.BaseAlert.run(BaseAlert.java:176) \nat java.lang.Thread.run(Thread.java:745) \nat org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n197: \"cat-Task-Consumer\" Id=124 TIMED_WAITING \nat java.lang.Thread.sleep(Native Method) \nat com.dianping.cat.report.task.DefaultTaskConsumer.taskNotFoundDuration(DefaultTaskConsumer.java:78) \nat com.dianping.cat.report.task.TaskConsumer.run(TaskConsumer.java:90) \nat java.lang.Thread.run(Thread.java:745) \nat org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n198: \"cat-TcpSocketSender\" Id=66 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@29397e18 \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@29397e18 \n  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) \n  at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) \n  at com.dianping.cat.message.io.DefaultMessageQueue.poll(DefaultMessageQueue.java:49) \n  at com.dianping.cat.message.io.TcpSocketSender.run(TcpSocketSender.java:174) \n  at java.lang.Thread.run(Thread.java:745) \n  at org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n199: \"cat-TcpSocketSender-ChannelManager\" Id=67 TIMED_WAITING \nat java.lang.Thread.sleep(Native Method) \nat com.dianping.cat.message.io.ChannelManager.run(ChannelManager.java:368) \nat java.lang.Thread.run(Thread.java:745) \nat org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n200: \"cat-ThirdParty\" Id=137 TIMED_WAITING \nat java.lang.Thread.sleep(Native Method) \nat com.dianping.cat.report.alert.thirdParty.ThirdPartyAlert.run(ThirdPartyAlert.java:110) \nat java.lang.Thread.run(Thread.java:745) \nat org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n201: \"cat-TopologyGraphReload\" Id=125 TIMED_WAITING \nat java.lang.Thread.sleep(Native Method) \nat com.dianping.cat.report.page.dependency.graph.TopologyGraphManager$DependencyReloadTask.run(TopologyGraphManager.java:283) \nat java.lang.Thread.run(Thread.java:745) \nat org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n202: \"cat-Transaction\" Id=141 TIMED_WAITING \nat java.lang.Thread.sleep(Native Method) \nat com.dianping.cat.report.alert.transaction.TransactionAlert.run(TransactionAlert.java:276) \nat java.lang.Thread.run(Thread.java:745) \nat org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n203: \"cat-UrlPattern-Config-Reload\" Id=127 TIMED_WAITING \nat java.lang.Thread.sleep(Native Method) \nat com.dianping.cat.config.web.url.UrlPatternConfigManager$ConfigReloadTask.run(UrlPatternConfigManager.java:272) \nat java.lang.Thread.run(Thread.java:745) \nat org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n204: \"cat-Web\" Id=140 TIMED_WAITING \nat java.lang.Thread.sleep(Native Method) \nat com.dianping.cat.report.alert.web.WebAlert.run(WebAlert.java:257) \nat java.lang.Thread.run(Thread.java:745) \nat org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n205: \"cat-http-reconnector\" Id=42040 TIMED_WAITING \nat java.lang.Thread.sleep(Native Method) \nat com.dianping.cat.report.alert.thirdParty.ThirdPartyAlertBuilder$HttpReconnector.run(ThirdPartyAlertBuilder.java:164) \nat java.lang.Thread.run(Thread.java:745) \nat org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n206: \"cat-merge-atomic-task\" Id=68 TIMED_WAITING \nat java.lang.Thread.sleep(Native Method) \nat com.dianping.cat.message.io.TcpSocketSender$MergeAtomicTask.run(TcpSocketSender.java:270) \nat java.lang.Thread.run(Thread.java:745) \nat org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n207: \"cat-recovery-announcer\" Id=129 TIMED_WAITING \nat java.lang.Thread.sleep(Native Method) \nat java.lang.Thread.sleep(Thread.java:340) \nat java.util.concurrent.TimeUnit.sleep(TimeUnit.java:360) \nat com.dianping.cat.report.alert.sender.AlertManager$RecoveryAnnouncer.run(AlertManager.java:251) \nat java.lang.Thread.run(Thread.java:745) \nat org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n208: \"cat-send-executor\" Id=128 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@c7c79e \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@c7c79e \n  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) \n  at java.util.concurrent.LinkedBlockingDeque.pollFirst(LinkedBlockingDeque.java:519) \n  at java.util.concurrent.LinkedBlockingDeque.poll(LinkedBlockingDeque.java:682) \n  at com.dianping.cat.report.alert.sender.AlertManager$SendExecutor.run(AlertManager.java:274) \n  at java.lang.Thread.run(Thread.java:745) \n  at org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n209: \"cat-thirdParty-alert-task\" Id=138 TIMED_WAITING \nat java.lang.Thread.sleep(Native Method) \nat com.dianping.cat.report.alert.thirdParty.ThirdPartyAlertBuilder.run(ThirdPartyAlertBuilder.java:122) \nat java.lang.Thread.run(Thread.java:745) \nat org.unidal.helper.Threads$RunnableThread.run(Threads.java:294) \n\n210: \"http-bio-8080-Acceptor-0\" Id=288 RUNNABLE (in native) \nat java.net.PlainSocketImpl.socketAccept(Native Method) \nat java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:398) \nat java.net.ServerSocket.implAccept(ServerSocket.java:530) \nat java.net.ServerSocket.accept(ServerSocket.java:498) \nat org.apache.tomcat.util.net.DefaultServerSocketFactory.acceptSocket(DefaultServerSocketFactory.java:60) \nat org.apache.tomcat.util.net.JIoEndpoint$Acceptor.run(JIoEndpoint.java:220) \nat java.lang.Thread.run(Thread.java:745) \n\n211: \"http-bio-8080-AsyncTimeout\" Id=289 TIMED_WAITING \nat java.lang.Thread.sleep(Native Method) \nat org.apache.tomcat.util.net.JIoEndpoint$AsyncTimeout.run(JIoEndpoint.java:152) \nat java.lang.Thread.run(Thread.java:745) \n\n212: \"http-bio-8080-exec-418\" Id=39328 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@463b0652 \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@463b0652 \n  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) \n  at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) \n  at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86) \n  at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32) \n  at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) \n  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) \n  ... \n\n213: \"http-bio-8080-exec-423\" Id=39323 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@463b0652 \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@463b0652 \n  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) \n  at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) \n  at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86) \n  at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32) \n  at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) \n  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) \n  ... \n\n214: \"http-bio-8080-exec-435\" Id=40109 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@463b0652 \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@463b0652 \n  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) \n  at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) \n  at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86) \n  at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32) \n  at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) \n  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) \n  ... \n\n215: \"http-bio-8080-exec-445\" Id=40537 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@463b0652 \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@463b0652 \n  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) \n  at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) \n  at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86) \n  at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32) \n  at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) \n  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) \n  ... \n\n216: \"http-bio-8080-exec-446\" Id=40536 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@463b0652 \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@463b0652 \n  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) \n  at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) \n  at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86) \n  at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32) \n  at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) \n  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) \n  ... \n\n217: \"http-bio-8080-exec-457\" Id=41103 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@463b0652 \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@463b0652 \n  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) \n  at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) \n  at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86) \n  at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32) \n  at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) \n  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) \n  ... \n\n218: \"http-bio-8080-exec-458\" Id=41199 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@463b0652 \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@463b0652 \n  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) \n  at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) \n  at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86) \n  at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32) \n  at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) \n  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) \n  ... \n\n219: \"http-bio-8080-exec-460\" Id=41200 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@463b0652 \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@463b0652 \n  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) \n  at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) \n  at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86) \n  at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32) \n  at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) \n  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) \n  ... \n\n220: \"http-bio-8080-exec-462\" Id=41547 RUNNABLE (in native) \nat java.net.SocketInputStream.socketRead0(Native Method) \nat java.net.SocketInputStream.read(SocketInputStream.java:152) \nat java.net.SocketInputStream.read(SocketInputStream.java:122) \nat org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:516) \nat org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:501) \nat org.apache.coyote.http11.Http11Processor.setRequestLineReadTimeout(Http11Processor.java:167) \nat org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:946) \nat org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:607) \n... \n\n221: \"http-bio-8080-exec-463\" Id=41549 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@463b0652 \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@463b0652 \n  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) \n  at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) \n  at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86) \n  at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32) \n  at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) \n  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) \n  ... \n\n222: \"http-bio-8080-exec-464\" Id=41548 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@463b0652 \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@463b0652 \n  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) \n  at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) \n  at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86) \n  at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32) \n  at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) \n  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) \n  ... \n\n223: \"http-bio-8080-exec-466\" Id=41763 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@463b0652 \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@463b0652 \n  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) \n  at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) \n  at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86) \n  at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32) \n  at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) \n  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) \n  ... \n\n224: \"http-bio-8080-exec-467\" Id=41764 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@463b0652 \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@463b0652 \n  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) \n  at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) \n  at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:86) \n  at org.apache.tomcat.util.threads.TaskQueue.poll(TaskQueue.java:32) \n  at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) \n  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) \n  ... \n\n225: \"main\" Id=1 RUNNABLE (in native) \nat java.net.PlainSocketImpl.socketAccept(Native Method) \nat java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:398) \nat java.net.ServerSocket.implAccept(ServerSocket.java:530) \nat java.net.ServerSocket.accept(ServerSocket.java:498) \nat org.apache.catalina.core.StandardServer.await(StandardServer.java:451) \nat org.apache.catalina.startup.Catalina.await(Catalina.java:777) \nat org.apache.catalina.startup.Catalina.start(Catalina.java:723) \nat sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) \n... \n\n226: \"nioEventLoopGroup-2-1\" Id=151 RUNNABLE (in native) \nat sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) \nat sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) \nat sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) \nat sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) \nat sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) \nat io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:622) \nat io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:310) \nat io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116) \n... \n\n227: \"pool-2-thread-1\" Id=301 WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@4280e43d \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@4280e43d \n  at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) \n  at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) \n  at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) \n  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) \n  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) \n  at java.lang.Thread.run(Thread.java:745) \n\n228: \"pool-2-thread-2\" Id=302 WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@4280e43d \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@4280e43d \n  at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) \n  at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) \n  at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) \n  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) \n  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) \n  at java.lang.Thread.run(Thread.java:745) \n\n229: \"pool-2-thread-3\" Id=561 WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@4280e43d \nat sun.misc.Unsafe.park(Native Method) \n- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@4280e43d \n  at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) \n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) \n  at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) \n  at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) \n  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) \n  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) \n  at java.lang.Thread.run(Thread.java:745) \n\n230: \"threadDeathWatcher-4-1\" Id=101 TIMED_WAITING \nat java.lang.Thread.sleep(Native Method) \nat io.netty.util.ThreadDeathWatcher$Watcher.run(ThreadDeathWatcher.java:137) \nat io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137) \nat java.lang.Thread.run(Thread.java:745) \n\n</dump> \n</thread> \n<message produced=\"0\" overflowed=\"0\" bytes=\"0\"/> \n<extension id=\"System\"> \n<extensionDetail id=\"LoadAverage\" value=\"0.0\"/> \n<extensionDetail id=\"FreePhysicalMemory\" value=\"6.3014912E8\"/> \n<extensionDetail id=\"FreeSwapSpaceSize\" value=\"4.293984256E9\"/> \n</extension> \n<extension id=\"Disk\"> \n<extensionDetail id=\"/ Free\" value=\"2.7752267776E10\"/> \n<extensionDetail id=\"/data Free\" value=\"2.7752267776E10\"/> \n</extension> \n<extension id=\"GC\"> \n<extensionDetail id=\"PS ScavengeCount\" value=\"4789.0\"/> \n<extensionDetail id=\"PS ScavengeTime\" value=\"59269.0\"/> \n<extensionDetail id=\"PS MarkSweepCount\" value=\"15.0\"/> \n<extensionDetail id=\"PS MarkSweepTime\" value=\"5234.0\"/> \n</extension> \n<extension id=\"JVMHeap\"> \n<extensionDetail id=\"Code Cache\" value=\"2.2126784E7\"/> \n<extensionDetail id=\"PS Eden Space\" value=\"2.08104576E8\"/> \n<extensionDetail id=\"PS Survivor Space\" value=\"9088936.0\"/> \n<extensionDetail id=\"PS Old Gen\" value=\"2.16183856E8\"/> \n<extensionDetail id=\"PS Perm Gen\" value=\"7.8008456E7\"/> \n</extension> \n<extension id=\"FrameworkThread\"> \n<extensionDetail id=\"HttpThread\" value=\"15.0\"/> \n<extensionDetail id=\"CatThread\" value=\"236.0\"/> \n<extensionDetail id=\"PigeonThread\" value=\"0.0\"/> \n<extensionDetail id=\"ActiveThread\" value=\"403.0\"/> \n<extensionDetail id=\"StartedThread\" value=\"41981.0\"/> \n</extension> \n<extension id=\"CatUsage\"> \n<extensionDetail id=\"Produced\" value=\"167896.0\"/> \n<extensionDetail id=\"Overflowed\" value=\"0.0\"/> \n<extensionDetail id=\"Bytes\" value=\"2.611048628E9\"/> \n</extension> \n</status> \n"},"comment":{"url":"https://api.github.com/repos/dianping/cat/issues/comments/450838321","html_url":"https://github.com/dianping/cat/issues/987#issuecomment-450838321","issue_url":"https://api.github.com/repos/dianping/cat/issues/987","id":450838321,"node_id":"MDEyOklzc3VlQ29tbWVudDQ1MDgzODMyMQ==","user":{"login":"duguyixiaono1","id":2703461,"node_id":"MDQ6VXNlcjI3MDM0NjE=","avatar_url":"https://avatars2.githubusercontent.com/u/2703461?v=4","gravatar_id":"","url":"https://api.github.com/users/duguyixiaono1","html_url":"https://github.com/duguyixiaono1","followers_url":"https://api.github.com/users/duguyixiaono1/followers","following_url":"https://api.github.com/users/duguyixiaono1/following{/other_user}","gists_url":"https://api.github.com/users/duguyixiaono1/gists{/gist_id}","starred_url":"https://api.github.com/users/duguyixiaono1/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/duguyixiaono1/subscriptions","organizations_url":"https://api.github.com/users/duguyixiaono1/orgs","repos_url":"https://api.github.com/users/duguyixiaono1/repos","events_url":"https://api.github.com/users/duguyixiaono1/events{/privacy}","received_events_url":"https://api.github.com/users/duguyixiaono1/received_events","type":"User","site_admin":false},"created_at":"2019-01-02T11:12:41Z","updated_at":"2019-01-02T11:12:41Z","author_association":"CONTRIBUTOR","body":"这个不是错，是心跳"}}
{"actor":{"display_login":"duguyixiaono1"}}