Commit Graph

304 Commits

Author SHA1 Message Date
Timothy Pogue
d2870d48ea change typing to async iterator 2022-11-20 16:24:44 -07:00
Timothy Pogue
48a1f2418f update typing, remove unneeded try block, readd sleep 2022-11-20 16:18:24 -07:00
Timothy Pogue
60a167bdef add dynamic send timeout 2022-11-20 14:09:45 -07:00
Timothy Pogue
3714d7074b smaller throttle in channel send 2022-11-19 13:29:23 -07:00
Timothy Pogue
c1a73a5512 move sleep call in send, minor cleanup 2022-11-19 13:21:26 -07:00
Timothy Pogue
98d87b3ba6 Merge branch 'develop' into feat/refactor-ws 2022-11-18 13:41:22 -07:00
Timothy Pogue
0cb6f71c02 better error handling, true async sending, more readable api 2022-11-18 13:32:27 -07:00
Matthias
4de9a46618
Merge pull request #7759 from wizrds/fix/pd-mem-leak
Fix Pandas to_json memory leak
2022-11-18 20:24:16 +01:00
Timothy Pogue
b6a8e421f1 remove redundant timestamp conversion in ws serializer 2022-11-18 09:43:39 -07:00
Matthias
12cd83453c Add warning when queue websocket queue becomes too full 2022-11-18 14:03:56 +01:00
Timothy Pogue
ba493eb7a7 Merge fix/pd-mem-leak 2022-11-17 16:21:12 -07:00
Timothy Pogue
ce43fa5f43 small fix to websocketchannel and relay 2022-11-17 12:03:11 -07:00
Timothy Pogue
875e9ab447 change df serialization to avoid mem leak 2022-11-17 11:59:03 -07:00
Matthias
93addbe5c3 Improve typechecking 2022-11-17 10:16:38 +00:00
Timothy Pogue
442467e8ae remove old comments and code 2022-11-14 22:26:34 -07:00
Timothy Pogue
d713af045f remove main queue completely 2022-11-14 22:21:40 -07:00
Timothy Pogue
659c8c237f initial revision 2022-11-14 20:27:45 -07:00
Matthias
a951b49541 Use Generator when sending initial dataframes 2022-11-14 19:43:59 +01:00
Matthias
fed3bc6730 Simplify Websocket Init 2022-11-13 10:33:54 +01:00
Matthias
ff619edebf Improve explanation comment as to why we're waiting ourselfs 2022-11-03 06:50:18 +01:00
Timothy Pogue
000b0c2198 prevent memory leaks from error in _broadcast_queue_data 2022-11-02 18:00:10 -06:00
Timothy Pogue
cbede2e27d refactor channel.send to avoid queue.put 2022-11-02 17:57:11 -06:00
Timothy Pogue
2dc55e89e6 better error handling channel send 2022-11-02 15:25:39 -06:00
Timothy Pogue
55bf195bfb remove debugging log calls 2022-11-02 14:21:34 -06:00
Timothy Pogue
c2bdaea84a change exception handling in channel send 2022-11-02 14:19:08 -06:00
Timothy Pogue
d848c27283 add task done to broadcast queue method 2022-11-02 13:30:42 -06:00
Timothy Pogue
e25dea7e0e update channel disconnecting 2022-11-02 13:26:27 -06:00
Timothy Pogue
fd5f31368c fix indent in initial df send 2022-10-25 14:08:28 -06:00
Matthias
3fa50077c9 Don't use pydantic to type-verify outgoing messages 2022-10-25 20:00:53 +02:00
Timothy Pogue
32600a113f fix broadcast 2022-10-24 12:21:17 -06:00
Timothy Pogue
94b65a007a fix message typing in channel manager, minor improvements 2022-10-23 11:42:59 -06:00
Timothy Pogue
9cffa3ca2b add comment in channel 2022-10-22 21:03:57 -06:00
Timothy Pogue
3d7a311caa removed sleep calls, better channel sending 2022-10-22 19:02:05 -06:00
Timothy Pogue
2b6d00dde4 initial channel api change 2022-10-22 09:30:18 -06:00
Matthias
c3d4fb9f1b Simplify backtest calling interface 2022-10-18 06:39:55 +02:00
Matthias
c7fff1213c Rate-limit EMC startup to avoid overwelming the queue 2022-10-17 20:46:15 +02:00
Matthias
b166c04cba Bring back asyncio.sleep to avoid overwelming the a consumer queue 2022-10-17 19:29:30 +02:00
Matthias
4a8cb3359b Fix broken tests 2022-10-14 16:07:49 +00:00
Matthias
9d4ba767c4 Update usages of search_all_objects 2022-10-14 14:50:52 +00:00
Timothy Pogue
eb8c89fe31 move send delay to relay 2022-10-10 23:32:10 -06:00
Timothy Pogue
5ada5eb540 fix error message, update exception import 2022-10-10 23:30:43 -06:00
Timothy Pogue
71bbffd10a update ws channel send to add data to queue 2022-10-09 18:49:04 -06:00
Timothy Pogue
2f64a08623 set channel queue maxsize to 32 2022-10-09 15:11:58 -06:00
Timothy Pogue
3e8d8fd1b0 refactor broadcasting to a queue per client 2022-10-09 15:04:52 -06:00
Matthias
2c94ed2e59 Decrease message throughput
fixes memory leak by queue raising indefinitely
2022-10-01 21:23:33 +02:00
Matthias
42cecb83f2 Disable base64 loading via API
closes severe RCE vulnerability reported privately.
2022-09-27 20:37:16 +02:00
Timothy Pogue
e54ed5b10e fix runtime error: dict changed size during iteration 2022-09-25 15:05:56 -06:00
Timothy Pogue
6a6ae809f4 fix jwt auth 2022-09-21 18:23:00 -06:00
Timothy Pogue
128b117af6 support list of tokens in ws_token 2022-09-21 16:02:21 -06:00
Matthias
914eccecec Merge branch 'develop' into pr/wizrds/7303 2022-09-20 06:56:15 +02:00