Hugging Face's logo

Spaces:
evelyn-lo
/
evelyn
Running

App Files Community
evelyn
File size: 25,571 Bytes 
37c870e
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
 
2024-07-02 09:40:35 | INFO | controller | args: Namespace(dispatch_method='shortest_queue', host='localhost', port=21001, ssl=False)
2024-07-02 09:40:35 | ERROR | stderr | INFO:     Started server process [47395]
2024-07-02 09:40:35 | ERROR | stderr | INFO:     Waiting for application startup.
2024-07-02 09:40:35 | ERROR | stderr | INFO:     Application startup complete.
2024-07-02 09:40:35 | ERROR | stderr | ERROR:    [Errno 99] error while attempting to bind on address ('::1', 21001, 0, 0): cannot assign requested address
2024-07-02 09:40:35 | ERROR | stderr | INFO:     Waiting for application shutdown.
2024-07-02 09:40:35 | ERROR | stderr | INFO:     Application shutdown complete.
2024-07-02 09:40:42 | ERROR | stderr | Exception ignored in: <module 'threading' from '/usr/lib/python3.8/threading.py'>
2024-07-02 09:40:42 | ERROR | stderr | Traceback (most recent call last):
2024-07-02 09:40:42 | ERROR | stderr |   File "/usr/lib/python3.8/threading.py", line 1388, in _shutdown
2024-07-02 09:40:42 | ERROR | stderr |     lock.acquire()
2024-07-02 09:40:42 | ERROR | stderr | KeyboardInterrupt:
2024-07-02 09:41:06 | INFO | controller | args: Namespace(dispatch_method='shortest_queue', host='127.0.0.1', port=21002, ssl=False)
2024-07-02 09:41:06 | ERROR | stderr | INFO:     Started server process [47753]
2024-07-02 09:41:06 | ERROR | stderr | INFO:     Waiting for application startup.
2024-07-02 09:41:06 | ERROR | stderr | INFO:     Application startup complete.
2024-07-02 09:41:06 | ERROR | stderr | INFO:     Uvicorn running on http://127.0.0.1:21002 (Press CTRL+C to quit)
2024-07-02 09:47:52 | INFO | controller | Register a new worker: http://127.0.0.1:21003
2024-07-02 09:47:52 | INFO | controller | Register done: http://127.0.0.1:21003, {'model_names': ['vicuna-7b-v1.5'], 'speed': 1, 'queue_length': 0}
2024-07-02 09:47:52 | INFO | stdout | INFO:     127.0.0.1:43654 - "POST /register_worker HTTP/1.1" 200 OK
2024-07-02 09:48:37 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-02 09:48:37 | INFO | stdout | INFO:     127.0.0.1:60980 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-02 09:49:22 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-02 09:49:22 | INFO | stdout | INFO:     127.0.0.1:35868 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-02 09:49:42 | INFO | controller | Register a new worker: http://127.0.0.1:21003
2024-07-02 09:49:42 | INFO | controller | Register done: http://127.0.0.1:21003, {'model_names': ['vicuna-7b-v1.5'], 'speed': 1, 'queue_length': 0}
2024-07-02 09:49:42 | INFO | stdout | INFO:     127.0.0.1:50044 - "POST /refresh_all_workers HTTP/1.1" 200 OK
2024-07-02 09:49:42 | INFO | stdout | INFO:     127.0.0.1:50056 - "POST /list_language_models HTTP/1.1" 200 OK
2024-07-02 09:50:07 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-02 09:50:07 | INFO | stdout | INFO:     127.0.0.1:50038 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-02 09:50:46 | INFO | controller | names: ['http://127.0.0.1:21003'], queue_lens: [0.0], ret: http://127.0.0.1:21003
2024-07-02 09:50:46 | INFO | stdout | INFO:     127.0.0.1:35180 - "POST /get_worker_address HTTP/1.1" 200 OK
2024-07-02 09:50:52 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-02 09:50:52 | INFO | stdout | INFO:     127.0.0.1:35190 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-02 09:50:56 | INFO | controller | names: ['http://127.0.0.1:21003'], queue_lens: [0.0], ret: http://127.0.0.1:21003
2024-07-02 09:50:56 | INFO | stdout | INFO:     127.0.0.1:37720 - "POST /get_worker_address HTTP/1.1" 200 OK
2024-07-02 09:51:37 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-02 09:51:37 | INFO | stdout | INFO:     127.0.0.1:45998 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-02 09:52:22 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-02 09:52:22 | INFO | stdout | INFO:     127.0.0.1:53188 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-02 09:53:07 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-02 09:53:07 | INFO | stdout | INFO:     127.0.0.1:51900 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-02 09:53:52 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-02 09:53:52 | INFO | stdout | INFO:     127.0.0.1:59176 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-02 09:54:37 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-02 09:54:37 | INFO | stdout | INFO:     127.0.0.1:32772 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-02 09:55:04 | ERROR | stderr | INFO:     Shutting down
2024-07-02 09:55:04 | ERROR | stderr | INFO:     Waiting for application shutdown.
2024-07-02 09:55:04 | ERROR | stderr | INFO:     Application shutdown complete.
2024-07-02 09:55:04 | ERROR | stderr | INFO:     Finished server process [47753]
2024-07-02 09:55:04 | ERROR | stderr | Traceback (most recent call last):
2024-07-02 09:55:04 | ERROR | stderr |   File "/usr/lib/python3.8/runpy.py", line 194, in _run_module_as_main
2024-07-02 09:55:04 | ERROR | stderr |     return _run_code(code, main_globals, None,
2024-07-02 09:55:04 | ERROR | stderr |   File "/usr/lib/python3.8/runpy.py", line 87, in _run_code
2024-07-02 09:55:04 | ERROR | stderr |     exec(code, run_globals)
2024-07-02 09:55:04 | ERROR | stderr |   File "/LLM_32T/evelyn/FastChat/fastchat/serve/controller.py", line 389, in <module>
2024-07-02 09:55:04 | ERROR | stderr |     uvicorn.run(app, host=args.host, port=args.port, log_level="info")
2024-07-02 09:55:04 | ERROR | stderr |   File "/usr/local/lib/python3.8/dist-packages/uvicorn/main.py", line 577, in run
2024-07-02 09:55:04 | ERROR | stderr |     server.run()
2024-07-02 09:55:04 | ERROR | stderr |   File "/usr/local/lib/python3.8/dist-packages/uvicorn/server.py", line 65, in run
2024-07-02 09:55:04 | ERROR | stderr |     return asyncio.run(self.serve(sockets=sockets))
2024-07-02 09:55:04 | ERROR | stderr |   File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
2024-07-02 09:55:04 | ERROR | stderr |     return loop.run_until_complete(main)
2024-07-02 09:55:04 | ERROR | stderr |   File "uvloop/loop.pyx", line 1511, in uvloop.loop.Loop.run_until_complete
2024-07-02 09:55:04 | ERROR | stderr |   File "uvloop/loop.pyx", line 1504, in uvloop.loop.Loop.run_until_complete
2024-07-02 09:55:04 | ERROR | stderr |   File "uvloop/loop.pyx", line 1377, in uvloop.loop.Loop.run_forever
2024-07-02 09:55:04 | ERROR | stderr |   File "uvloop/loop.pyx", line 555, in uvloop.loop.Loop._run
2024-07-02 09:55:04 | ERROR | stderr |   File "uvloop/loop.pyx", line 474, in uvloop.loop.Loop._on_idle
2024-07-02 09:55:04 | ERROR | stderr |   File "uvloop/cbhandles.pyx", line 83, in uvloop.loop.Handle._run
2024-07-02 09:55:04 | ERROR | stderr |   File "uvloop/cbhandles.pyx", line 63, in uvloop.loop.Handle._run
2024-07-02 09:55:04 | ERROR | stderr |   File "/usr/local/lib/python3.8/dist-packages/uvicorn/server.py", line 69, in serve
2024-07-02 09:55:04 | ERROR | stderr |     await self._serve(sockets)
2024-07-02 09:55:04 | ERROR | stderr |   File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__
2024-07-02 09:55:04 | ERROR | stderr |     next(self.gen)
2024-07-02 09:55:04 | ERROR | stderr |   File "/usr/local/lib/python3.8/dist-packages/uvicorn/server.py", line 328, in capture_signals
2024-07-02 09:55:04 | ERROR | stderr |     signal.raise_signal(captured_signal)
2024-07-02 09:55:04 | ERROR | stderr | KeyboardInterrupt
2024-07-02 09:55:04 | ERROR | stderr | Exception ignored in: <module 'threading' from '/usr/lib/python3.8/threading.py'>
2024-07-02 09:55:04 | ERROR | stderr | Traceback (most recent call last):
2024-07-02 09:55:04 | ERROR | stderr |   File "/usr/lib/python3.8/threading.py", line 1388, in _shutdown
2024-07-02 09:55:04 | ERROR | stderr |     lock.acquire()
2024-07-02 09:55:04 | ERROR | stderr | KeyboardInterrupt:
2024-07-03 02:34:01 | INFO | controller | args: Namespace(dispatch_method='shortest_queue', host='127.0.0.1', port=21002, ssl=False)
2024-07-03 02:34:02 | ERROR | stderr | INFO:     Started server process [88773]
2024-07-03 02:34:02 | ERROR | stderr | INFO:     Waiting for application startup.
2024-07-03 02:34:02 | ERROR | stderr | INFO:     Application startup complete.
2024-07-03 02:34:02 | ERROR | stderr | INFO:     Uvicorn running on http://127.0.0.1:21002 (Press CTRL+C to quit)
2024-07-03 02:40:52 | INFO | controller | Register a new worker: http://127.0.0.1:21003
2024-07-03 02:40:52 | INFO | controller | Register done: http://127.0.0.1:21003, {'model_names': ['vicuna-7b-v1.5'], 'speed': 1, 'queue_length': 0}
2024-07-03 02:40:52 | INFO | stdout | INFO:     127.0.0.1:34042 - "POST /register_worker HTTP/1.1" 200 OK
2024-07-03 02:41:37 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-03 02:41:37 | INFO | stdout | INFO:     127.0.0.1:45744 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-03 02:42:22 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-03 02:42:22 | INFO | stdout | INFO:     127.0.0.1:56428 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-03 02:43:08 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-03 02:43:08 | INFO | stdout | INFO:     127.0.0.1:53856 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-03 02:43:53 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-03 02:43:53 | INFO | stdout | INFO:     127.0.0.1:43854 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-03 02:44:22 | INFO | controller | Register an existing worker: http://127.0.0.1:21003
2024-07-03 02:44:22 | INFO | controller | Register done: http://127.0.0.1:21003, {'model_names': ['vicuna-7b-v1.5'], 'speed': 1, 'queue_length': 0}
2024-07-03 02:44:22 | INFO | stdout | INFO:     127.0.0.1:45520 - "POST /register_worker HTTP/1.1" 200 OK
2024-07-03 02:44:38 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-03 02:44:38 | INFO | stdout | INFO:     127.0.0.1:55416 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-03 02:45:23 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-03 02:45:23 | INFO | stdout | INFO:     127.0.0.1:38016 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-03 02:45:48 | INFO | controller | Register an existing worker: http://127.0.0.1:21003
2024-07-03 02:45:48 | INFO | controller | Register done: http://127.0.0.1:21003, {'model_names': ['vicuna-7b-v1.5'], 'speed': 1, 'queue_length': 0}
2024-07-03 02:45:48 | INFO | stdout | INFO:     127.0.0.1:54584 - "POST /register_worker HTTP/1.1" 200 OK
2024-07-03 02:46:08 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-03 02:46:08 | INFO | stdout | INFO:     127.0.0.1:53596 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-03 02:46:53 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-03 02:46:53 | INFO | stdout | INFO:     127.0.0.1:43150 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-03 02:47:38 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-03 02:47:38 | INFO | stdout | INFO:     127.0.0.1:40674 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-03 02:48:23 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-03 02:48:23 | INFO | stdout | INFO:     127.0.0.1:53896 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-03 02:49:08 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-03 02:49:08 | INFO | stdout | INFO:     127.0.0.1:34066 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-03 02:49:53 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-03 02:49:53 | INFO | stdout | INFO:     127.0.0.1:40154 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-03 02:50:38 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-03 02:50:38 | INFO | stdout | INFO:     127.0.0.1:43326 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-03 02:51:23 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-03 02:51:23 | INFO | stdout | INFO:     127.0.0.1:46014 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-03 02:52:08 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-03 02:52:08 | INFO | stdout | INFO:     127.0.0.1:39774 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-03 02:52:53 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-03 02:52:53 | INFO | stdout | INFO:     127.0.0.1:41350 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-03 02:53:38 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-03 02:53:38 | INFO | stdout | INFO:     127.0.0.1:33768 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-03 02:54:23 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-03 02:54:23 | INFO | stdout | INFO:     127.0.0.1:39246 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-03 02:55:52 | INFO | controller | Register a new worker: http://127.0.0.1:21003
2024-07-03 02:55:52 | ERROR | controller | Get status fails: http://127.0.0.1:21003, HTTPConnectionPool(host='127.0.0.1', port=21003): Max retries exceeded with url: /worker_get_status (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7eff8b781550>: Failed to establish a new connection: [Errno 111] Connection refused'))
2024-07-03 02:55:52 | INFO | controller | Remove stale worker: http://127.0.0.1:21003
2024-07-03 02:55:52 | INFO | stdout | INFO:     127.0.0.1:45740 - "POST /refresh_all_workers HTTP/1.1" 200 OK
2024-07-03 02:55:52 | INFO | stdout | INFO:     127.0.0.1:45748 - "POST /list_language_models HTTP/1.1" 200 OK
2024-07-03 05:49:21 | INFO | controller | args: Namespace(dispatch_method='shortest_queue', host='127.0.0.1', port=21002, ssl=False)
2024-07-03 05:49:21 | ERROR | stderr | INFO:     Started server process [85493]
2024-07-03 05:49:21 | ERROR | stderr | INFO:     Waiting for application startup.
2024-07-03 05:49:21 | ERROR | stderr | INFO:     Application startup complete.
2024-07-03 05:49:21 | ERROR | stderr | ERROR:    [Errno 98] error while attempting to bind on address ('127.0.0.1', 21002): address already in use
2024-07-03 05:49:21 | ERROR | stderr | INFO:     Waiting for application shutdown.
2024-07-03 05:49:21 | ERROR | stderr | INFO:     Application shutdown complete.
2024-07-03 05:50:39 | INFO | controller | args: Namespace(dispatch_method='shortest_queue', host='127.0.0.1', port=21002, ssl=False)
2024-07-03 05:50:40 | ERROR | stderr | INFO:     Started server process [86753]
2024-07-03 05:50:40 | ERROR | stderr | INFO:     Waiting for application startup.
2024-07-03 05:50:40 | ERROR | stderr | INFO:     Application startup complete.
2024-07-03 05:50:40 | ERROR | stderr | INFO:     Uvicorn running on http://127.0.0.1:21002 (Press CTRL+C to quit)
2024-07-03 05:52:46 | INFO | controller | Register a new worker: http://127.0.0.1:21003
2024-07-03 05:52:46 | INFO | controller | Register done: http://127.0.0.1:21003, {'model_names': ['vicuna-7b-v1.5'], 'speed': 1, 'queue_length': 0}
2024-07-03 05:52:46 | INFO | stdout | INFO:     127.0.0.1:59954 - "POST /register_worker HTTP/1.1" 200 OK
2024-07-03 05:53:31 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-03 05:53:31 | INFO | stdout | INFO:     127.0.0.1:44442 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-03 05:54:16 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-03 05:54:16 | INFO | stdout | INFO:     127.0.0.1:50732 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-03 05:54:32 | INFO | controller | Register a new worker: http://127.0.0.1:21003
2024-07-03 05:54:32 | INFO | controller | Register done: http://127.0.0.1:21003, {'model_names': ['vicuna-7b-v1.5'], 'speed': 1, 'queue_length': 0}
2024-07-03 05:54:32 | INFO | stdout | INFO:     127.0.0.1:49984 - "POST /refresh_all_workers HTTP/1.1" 200 OK
2024-07-03 05:54:32 | INFO | stdout | INFO:     127.0.0.1:49994 - "POST /list_models HTTP/1.1" 200 OK
2024-07-03 05:54:32 | INFO | controller | names: ['http://127.0.0.1:21003'], queue_lens: [0.0], ret: http://127.0.0.1:21003
2024-07-03 05:54:32 | INFO | stdout | INFO:     127.0.0.1:50010 - "POST /get_worker_address HTTP/1.1" 200 OK
2024-07-03 05:55:01 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-03 05:55:01 | INFO | stdout | INFO:     127.0.0.1:52580 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-03 05:55:46 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-03 05:55:46 | INFO | stdout | INFO:     127.0.0.1:36462 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-03 05:56:11 | INFO | controller | Register a new worker: http://127.0.0.1:21003
2024-07-03 05:56:11 | INFO | controller | Register done: http://127.0.0.1:21003, {'model_names': ['vicuna-7b-v1.5'], 'speed': 1, 'queue_length': 0}
2024-07-03 05:56:11 | INFO | stdout | INFO:     127.0.0.1:51020 - "POST /refresh_all_workers HTTP/1.1" 200 OK
2024-07-03 05:56:11 | INFO | stdout | INFO:     127.0.0.1:51032 - "POST /list_models HTTP/1.1" 200 OK
2024-07-03 05:56:11 | INFO | controller | names: ['http://127.0.0.1:21003'], queue_lens: [0.0], ret: http://127.0.0.1:21003
2024-07-03 05:56:11 | INFO | stdout | INFO:     127.0.0.1:51036 - "POST /get_worker_address HTTP/1.1" 200 OK
2024-07-03 05:56:31 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-03 05:56:31 | INFO | stdout | INFO:     127.0.0.1:35372 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-03 05:57:16 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-03 05:57:16 | INFO | stdout | INFO:     127.0.0.1:48530 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-03 05:58:01 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-03 05:58:01 | INFO | stdout | INFO:     127.0.0.1:54872 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-03 05:58:18 | INFO | controller | Register a new worker: http://127.0.0.1:21003
2024-07-03 05:58:18 | INFO | controller | Register done: http://127.0.0.1:21003, {'model_names': ['vicuna-7b-v1.5'], 'speed': 1, 'queue_length': 0}
2024-07-03 05:58:18 | INFO | stdout | INFO:     127.0.0.1:45950 - "POST /refresh_all_workers HTTP/1.1" 200 OK
2024-07-03 05:58:18 | INFO | stdout | INFO:     127.0.0.1:45954 - "POST /list_language_models HTTP/1.1" 200 OK
2024-07-03 05:58:37 | INFO | controller | names: ['http://127.0.0.1:21003'], queue_lens: [0.0], ret: http://127.0.0.1:21003
2024-07-03 05:58:37 | INFO | stdout | INFO:     127.0.0.1:58440 - "POST /get_worker_address HTTP/1.1" 200 OK
2024-07-03 05:58:46 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-03 05:58:46 | INFO | stdout | INFO:     127.0.0.1:36438 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-03 05:59:08 | INFO | controller | names: ['http://127.0.0.1:21003'], queue_lens: [0.0], ret: http://127.0.0.1:21003
2024-07-03 05:59:08 | INFO | stdout | INFO:     127.0.0.1:53772 - "POST /get_worker_address HTTP/1.1" 200 OK
2024-07-03 05:59:31 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-03 05:59:31 | INFO | stdout | INFO:     127.0.0.1:36736 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-03 06:00:16 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-03 06:00:16 | INFO | stdout | INFO:     127.0.0.1:54552 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-03 06:01:01 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-03 06:01:01 | INFO | stdout | INFO:     127.0.0.1:48538 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-03 06:01:46 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-03 06:01:46 | INFO | stdout | INFO:     127.0.0.1:44790 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-03 06:02:31 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-03 06:02:31 | INFO | stdout | INFO:     127.0.0.1:43236 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-03 06:03:16 | INFO | controller | Receive heart beat. http://127.0.0.1:21003
2024-07-03 06:03:16 | INFO | stdout | INFO:     127.0.0.1:49682 - "POST /receive_heart_beat HTTP/1.1" 200 OK
2024-07-03 06:03:50 | ERROR | stderr | INFO:     Shutting down
2024-07-03 06:03:50 | ERROR | stderr | INFO:     Waiting for application shutdown.
2024-07-03 06:03:50 | ERROR | stderr | INFO:     Application shutdown complete.
2024-07-03 06:03:50 | ERROR | stderr | INFO:     Finished server process [86753]
2024-07-03 06:03:50 | ERROR | stderr | Traceback (most recent call last):
2024-07-03 06:03:50 | ERROR | stderr |   File "/usr/lib/python3.8/runpy.py", line 194, in _run_module_as_main
2024-07-03 06:03:50 | ERROR | stderr |     return _run_code(code, main_globals, None,
2024-07-03 06:03:50 | ERROR | stderr |   File "/usr/lib/python3.8/runpy.py", line 87, in _run_code
2024-07-03 06:03:50 | ERROR | stderr |     exec(code, run_globals)
2024-07-03 06:03:50 | ERROR | stderr |   File "/LLM_32T/evelyn/FastChat/fastchat/serve/controller.py", line 389, in <module>
2024-07-03 06:03:50 | ERROR | stderr |     uvicorn.run(app, host=args.host, port=args.port, log_level="info")
2024-07-03 06:03:50 | ERROR | stderr |   File "/usr/local/lib/python3.8/dist-packages/uvicorn/main.py", line 577, in run
2024-07-03 06:03:50 | ERROR | stderr |     server.run()
2024-07-03 06:03:50 | ERROR | stderr |   File "/usr/local/lib/python3.8/dist-packages/uvicorn/server.py", line 65, in run
2024-07-03 06:03:50 | ERROR | stderr |     return asyncio.run(self.serve(sockets=sockets))
2024-07-03 06:03:50 | ERROR | stderr |   File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
2024-07-03 06:03:50 | ERROR | stderr |     return loop.run_until_complete(main)
2024-07-03 06:03:50 | ERROR | stderr |   File "uvloop/loop.pyx", line 1511, in uvloop.loop.Loop.run_until_complete
2024-07-03 06:03:50 | ERROR | stderr |   File "uvloop/loop.pyx", line 1504, in uvloop.loop.Loop.run_until_complete
2024-07-03 06:03:50 | ERROR | stderr |   File "uvloop/loop.pyx", line 1377, in uvloop.loop.Loop.run_forever
2024-07-03 06:03:50 | ERROR | stderr |   File "uvloop/loop.pyx", line 555, in uvloop.loop.Loop._run
2024-07-03 06:03:50 | ERROR | stderr |   File "uvloop/loop.pyx", line 474, in uvloop.loop.Loop._on_idle
2024-07-03 06:03:50 | ERROR | stderr |   File "uvloop/cbhandles.pyx", line 83, in uvloop.loop.Handle._run
2024-07-03 06:03:50 | ERROR | stderr |   File "uvloop/cbhandles.pyx", line 63, in uvloop.loop.Handle._run
2024-07-03 06:03:50 | ERROR | stderr |   File "/usr/local/lib/python3.8/dist-packages/uvicorn/server.py", line 69, in serve
2024-07-03 06:03:50 | ERROR | stderr |     await self._serve(sockets)
2024-07-03 06:03:50 | ERROR | stderr |   File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__
2024-07-03 06:03:50 | ERROR | stderr |     next(self.gen)
2024-07-03 06:03:50 | ERROR | stderr |   File "/usr/local/lib/python3.8/dist-packages/uvicorn/server.py", line 328, in capture_signals
2024-07-03 06:03:50 | ERROR | stderr |     signal.raise_signal(captured_signal)
2024-07-03 06:03:50 | ERROR | stderr | KeyboardInterrupt
2024-07-03 06:03:50 | ERROR | stderr | Exception ignored in: <module 'threading' from '/usr/lib/python3.8/threading.py'>
2024-07-03 06:03:50 | ERROR | stderr | Traceback (most recent call last):
2024-07-03 06:03:50 | ERROR | stderr |   File "/usr/lib/python3.8/threading.py", line 1388, in _shutdown
2024-07-03 06:03:50 | ERROR | stderr |     lock.acquire()
2024-07-03 06:03:50 | ERROR | stderr | KeyboardInterrupt: