ansuz
e05891184e
fix regression in maxWorkers
9 months ago
ansuz
b56c73be6e
delegate more work from getOlderHistory to the worker
9 months ago
ansuz
fd169ff39c
close streams after 2 minutes instead of 5
Hopefully this helps to even out our memory and CPU usage.
There's also some improved labels so that IF streams time out
we will know the exact origin of the offending call.
9 months ago
ansuz
bac8ef3c6e
lint compliance
9 months ago
ansuz
4e57e390da
write tasks inside of workers
9 months ago
ansuz
ba6faca02e
make the number of workers configurable
9 months ago
ansuz
0465f31a45
add a FIXME note
9 months ago
ansuz
04ab7f538a
recover from worker faults and unify worker types
9 months ago
ansuz
e0a6852b79
correctly serialize an error log
9 months ago
ansuz
e8b1fcf710
solve some cases where crashing workers could result in an invalid state for the queue
9 months ago
ansuz
9ed26cfeb0
lint compliance
9 months ago
ansuz
74567e0cf4
return process memory usage in GET CACHE STATS RPC
9 months ago
Martin Alexander Neumann
e3f42cbc20
Allow config.defaultStorageLimit to be zero bytes
9 months ago
ansuz
e527867e2e
queue blob and channel deletions per-user
9 months ago
ansuz
bd3e18d1a8
only cache a user's pinned channels if there are no errors when loading them
9 months ago
ansuz
bef18a9320
hotfix
9 months ago
ansuz
7fac997e93
increase some file storage timeouts related to streams
9 months ago
ansuz
95965c1dee
keep a parallel implementation of the pin loader to validate the new one
9 months ago
ansuz
a57bf94058
remove XXX note
9 months ago
ansuz
c53675c9d5
WIP worker rpc call queue
9 months ago
ansuz
d802173325
remove an invalid line
9 months ago
ansuz
adfd1eaaa2
avoid a silly typeError in the event of an error
9 months ago
ansuz
834c96a4fc
update comments and remove some notes
9 months ago
ansuz
ed5d97f899
WIP history-keeper fixes
9 months ago
ansuz
3d8e78a268
fix overly broad config interpretation for daily check
9 months ago
ansuz
e6ec891d9a
improve admin rpc for diagnosing memory used by the cache
9 months ago
ansuz
77961e3954
trim lookup tables for channels without checkpoints
9 months ago
ansuz
6d0dee979a
allow admins to inspect index/metadata caches
9 months ago
ansuz
cbd3547814
remove log statements
9 months ago
ansuz
9058a59555
reassign db tasks if the responsible worker fails
9 months ago
ansuz
172823c954
lint compliance
9 months ago
ansuz
b5649707d1
export 'tryParse' command
9 months ago
ansuz
64b0879984
improve logging for parse errors
9 months ago
ansuz
3f86b6141e
rename worker processes
9 months ago
ansuz
d8a88cb4ca
run expiration tasks in a worker instead of the main process
9 months ago
ansuz
b0179eaad9
drop XXX note
9 months ago
ansuz
9dbd32758a
improve worker logging and move blob deletion to worker processes as well
9 months ago
ansuz
5f69fc18d0
suppress some noisy errors
9 months ago
ansuz
5f2d7c8dcf
increase worker rpc wait time before timeout
9 months ago
ansuz
33e8e65507
handle errors in the server's workers
9 months ago
ansuz
a4c8039cc7
improve error handling with rpc response API
9 months ago
ansuz
cb53bd1c15
lint compliance
9 months ago
ansuz
14feef1757
calculate pin list checksums in a worker
9 months ago
ansuz
70a0d4efb4
move more database reads into the database worker
9 months ago
ansuz
bc13a21796
give fileStreams a little bit more time before closing them
9 months ago
ansuz
4ba36a9173
load user pins in the database worker
9 months ago
ansuz
50e8893b24
move the 'getOlderHistory' call into the database worker
9 months ago
ansuz
471e374533
compute metadata in the same child process that builds indexes
10 months ago
ansuz
479b76f848
lint compliance
10 months ago
ansuz
c2fcba31e3
remove an XXX
10 months ago