Alexander Bondarenko
63f092ce70
Merge remote-tracking branch 'origin/master' into ab/measure
2024-05-14 14:20:35 +03:00
Alexander Bondarenko
3d9e5a501e
draft SEND stats update
2024-05-13 22:34:33 +03:00
Evgeny Poberezkin
512afa1e2b
agent: count received duplicate messages ( #1148 )
...
* agent: count received duplicate messages
* count total too
* names
* fix
* tuple
2024-05-13 15:16:20 +01:00
Alexander Bondarenko
2fcc8d0107
expand ClientStats
2024-05-13 16:35:19 +03:00
Alexander Bondarenko
dbc6ae2a47
WIP: command rate monitoring
2024-05-13 13:15:59 +03:00
Evgeny Poberezkin
4455b8bd0e
agent: do not throw exception when command is created for deleted connection ( #1150 )
...
* agent: do not throw exception when command is created for deleted connection
* convert database busy/locked to critical alert
2024-05-13 08:10:40 +01:00
Evgeny Poberezkin
91cc48aabe
agent: do not mark subscriptions on expired sessions as active, mark delayed subscriptions as active on the same session, do not cancel sending expired commands ( #1127 )
...
* agent: do not mark subscriptions on expired sessions as active, do mark delayed subscriptions as active on the same session, SUBOK response in the next SMP protocol version
* client: prevent sub actions from zombie sessions (#1122 )
* client: prevent sub actions from zombie sessions
* error handling
* add AERR to pass background errors to client
* switch to activeClientSession
* put closeClient under activeClientSession
* rename
* remove AERR, do not skip processing
* move check and state update to one transaction
* catch extra UPs
* fix
* check queue is still pending before making it active
---------
Co-authored-by: Evgeny Poberezkin <evgeny@poberezkin.com >
* do not forward agent error
* revert not expiring sending subs
* fixes
* track subscription responses better
* add pending connection
* Revert "revert not expiring sending subs"
This reverts commit 4310a69391 .
* do not expire sending commands
* rename
* fix race
* function
---------
Co-authored-by: Alexander Bondarenko <486682+dpwiz@users.noreply.github.com >
2024-05-12 17:47:08 +01:00
Evgeny Poberezkin
103ae06d55
agent: remove critical error on subscription timeout ( #1146 )
2024-05-11 23:38:27 +01:00
Evgeny Poberezkin
727fd8b8f5
server: more efficient response to batched subscriptions ( #1141 )
...
* server: more efficient response to batched subscriptions
* add sndMsgQ for interleaving messages with replies
* remove redundant liftIO
* refactor
* refactor2
* rename
* fix
* diff
* remove comment
* remove comment
---------
Co-authored-by: Alexander Bondarenko <486682+dpwiz@users.noreply.github.com >
2024-05-10 22:19:11 +01:00
Evgeny Poberezkin
5cafd9d5c4
server: more efficient responses to batch subscriptions ( #1137 )
...
* server: more efficient responses to batch subscriptions
* comments
* comment
* enable tests
* LogError
2024-05-09 09:20:57 +01:00
Evgeny Poberezkin
ea21b296fd
agent: reset error count and do not report errors when consequitive timeouts happen while offline ( #1136 )
...
* agent: reset error count and do not report errors when consequitive timeouts happen while offline
* refactor
* comment
2024-05-08 15:33:51 +01:00
spaced4ndy
3f57d54832
xftp: catch exceptions in chunk download ( #1133 )
2024-05-08 16:57:04 +04:00
Evgeny Poberezkin
b40654c95d
update agent to v7/v2 SMP/NTF protocol versions ( #997 )
...
* update agent to v7/v2 SMP/NTF protocol versions
2024-05-08 13:05:06 +01:00
Alexander Bondarenko
7a07076277
transport: require ALPN for extended handshakes ( #1134 )
...
* transport: require ALPN for extended handshakes
* fix 8.10 build
* rename
---------
Co-authored-by: Evgeny Poberezkin <evgeny@poberezkin.com >
2024-05-08 00:06:09 +01:00
Evgeny Poberezkin
e13b0df539
client: remove TLS handshake timeout ( #1129 )
...
* client: remove TLS handshake timeout
* remove comment
2024-05-05 17:05:51 +01:00
Evgeny Poberezkin
ee8e4067b0
agent: prepare connection record before joining to prevent race conditions ( #1128 )
...
* agent: prepare connection record before joining to prevent race conditions
* prepare connection for contact address as well
* clean up
2024-05-05 12:12:19 +01:00
Evgeny Poberezkin
b586a6e90a
client: removed concurrency limit when waiting for subscription results ( #1126 )
2024-05-03 22:16:52 +01:00
Evgeny Poberezkin
6f83273318
client: increase timeout for SOCKS connection, increase timeout for direct connection ( #1123 )
2024-05-02 15:14:01 +01:00
Alexander Bondarenko
0d2c1d3c01
transport: reduce ping traffic ( #1118 )
...
* transport: reduce ping traffic
* make pings opt-in, enable automatically with SUB commands
* fix reduced delays
* enable pings on MSG too
* rename pingErrorCount
* check timeout counter even when not sending pings
* clean up
* reset timeout error count on any event
---------
Co-authored-by: Evgeny Poberezkin <evgeny@poberezkin.com >
2024-05-01 10:38:33 +01:00
Evgeny Poberezkin
66eccbecb3
upgrade SMP/NTF servers to v7/v2 protocol versions ( #996 )
...
* upgrade SMP/NTF servers to v7/v2 protocol versions
* 5.6.0.0
---------
Co-authored-by: spaced4ndy <8711996+spaced4ndy@users.noreply.github.com >
2024-05-01 00:51:08 +01:00
Alexander Bondarenko
b931c1be37
utils: remove zstd contexts ( #1116 )
2024-04-25 09:33:22 +01:00
Evgeny Poberezkin
fe28e02be7
agent: make version independent of PQ enqryption support ( #1114 )
...
* agent: make version independent of PQ enqryption support
* remove comment
2024-04-22 13:40:24 +01:00
Evgeny Poberezkin
1612a7e2c7
agent: reduce sizes for per-queue e2e encryption ( #1113 )
2024-04-22 09:25:03 +01:00
Evgeny Poberezkin
2347b82b47
adjust timeouts and delayed response errors ( #1112 )
2024-04-21 22:57:07 +01:00
Alexander Bondarenko
b98fdb672d
transport: increase client timeouts, don't send command after timeout ( #1110 )
...
* transport: fix client handshake timeouts
* fix handshake timeout
* skip sending requests for timed out responses
* expose batch concurrency as PClient field
* move to NetworkConfig
* remove Request on timeout
* use record
---------
Co-authored-by: Evgeny Poberezkin <evgeny@poberezkin.com >
2024-04-20 18:17:48 +01:00
Evgeny Poberezkin
3ba3172aaf
xftp: enable ALPN in XFTP server ( #1109 )
2024-04-20 09:15:33 +01:00
Evgeny Poberezkin
c00c223f3b
remove (or make optional) client key from handshakes ( #1104 )
...
* remove (or make optional) client key from handshakes
* remove comment
2024-04-18 22:43:49 +01:00
Evgeny Poberezkin
2f43b43225
parameterize transport handle with transport peer to include server certificate ( #1100 )
...
* parameterize transport handle with transport peer to include server certificate
* include server certificate into THandle
* load server chain and sign key
* fix key type
* fix for 8.10
---------
Co-authored-by: Alexander Bondarenko <486682+dpwiz@users.noreply.github.com >
Co-authored-by: IC Rainbow <aenor.realm@gmail.com >
2024-04-17 17:46:22 +01:00
Evgeny Poberezkin
ebb75ced12
extract SessionVar from AgentClient to reuse ( #1099 )
2024-04-13 18:33:12 +01:00
Evgeny Poberezkin
b741b65700
use online status in network information ( #1094 )
...
* use online status in network information
* test
* refactor
* flip condition
* fix
2024-04-12 22:22:24 +01:00
Alexander Bondarenko
036b7523a5
xftp: matrix test for new versions ( #1093 )
...
* xftp: matrix test for new versions
* manual matrix
* more, faster
---------
Co-authored-by: Evgeny Poberezkin <evgeny@poberezkin.com >
2024-04-12 13:28:16 +01:00
spaced4ndy
3b1dd6dff9
agent: notify about available quota ( #1087 )
...
* agent: notify about available quota
* rename
---------
Co-authored-by: Evgeny Poberezkin <evgeny@poberezkin.com >
2024-04-11 09:38:12 +01:00
Evgeny Poberezkin
fbc25b171e
xftp: reply ERR AUTH when file is removed from server storage ( #1091 )
2024-04-10 23:02:48 +01:00
Evgeny Poberezkin
8fa9ed6317
wait for user network availability ( #1085 )
...
* ghc-options
* wait for user network availability
* test
* update
* comment
* refactor
* slow config
* line
* waitForUserNetwork in xftp and ntf workers
* refactor
* refactor with registerDelay
---------
Co-authored-by: spaced4ndy <8711996+spaced4ndy@users.noreply.github.com >
2024-04-10 21:50:05 +01:00
Alexander Bondarenko
91cf6841e0
http2: fix client setup ( #1090 )
...
* http2: cancel client action on setup timeout
* ignore incompatible server keys
2024-04-10 21:00:39 +01:00
Evgeny Poberezkin
1219446996
dispose agent instances, fix tests, ( #1089 )
...
* dispose agent instances in tests
* fix quota test
* tests: fix tests with -threaded (#1088 )
* fix some tests
* match RTS opts with apps
* less verbose rts stats
* enable sqlite extended error codes
* clean up
* unfocus
* remove extendedErrorCode
It's actually setExtendedResultCodes, which isn't yet available.
* diff
---------
Co-authored-by: Evgeny Poberezkin <evgeny@poberezkin.com >
* fix switch test
* fix
---------
Co-authored-by: Alexander Bondarenko <486682+dpwiz@users.noreply.github.com >
2024-04-10 19:34:02 +01:00
Evgeny Poberezkin
b994fd9f0f
use sendRequest for HTTP2
2024-04-09 21:14:10 +01:00
Alexander Bondarenko
4c20ff6d00
xftp: negotiate protocol with ALPN ( #1047 )
...
* xftp: negotiate protocol with ALPN
* add RFC
* add handshake implementation
* implement extended handshake
* enable authentication
* update rfc
* Apply suggestions from code review
Co-authored-by: Evgeny Poberezkin <evgeny@poberezkin.com >
* cleanup
* discard trailing data
* cleanup diff
* use find
* rename
* refactor
* add x509 tests
---------
Co-authored-by: Evgeny Poberezkin <evgeny@poberezkin.com >
2024-04-09 15:03:40 +01:00
spaced4ndy
791368c7be
export lock function ( #1073 )
...
* export lock functions
* rename with tick
* simplify
---------
Co-authored-by: Evgeny Poberezkin <evgeny@poberezkin.com >
2024-04-04 15:37:31 +01:00
Alexander Bondarenko
a4cfcfcc85
ntf-server: fix test token handling ( #1083 )
...
* use formatted logger
* fix DeviceToken parser for apns_null
* exclude PPNull from token stats
2024-04-04 14:46:40 +01:00
Evgeny Poberezkin
84b8c8417b
revert base64 change ( #1081 )
2024-04-03 09:27:36 +01:00
Alexander Bondarenko
be9a84905f
servers: read stores by chunks ( #1080 )
2024-04-01 19:42:30 +01:00
Alexander Bondarenko
a698f9a0c4
xftp-server: run expiration checks on start ( #1042 )
...
* xftp-server: run expiration checks on start
* rename
* refactor
---------
Co-authored-by: Evgeny Poberezkin <evgeny@poberezkin.com >
2024-04-01 11:29:19 +01:00
Evgeny Poberezkin
39bb804fab
xftp: fix repeated replica creation if it was in uploaded status ( #1079 )
...
* test with failing files (in progress)
* print
* add replica uploading state
* Revert "add replica uploading state"
This reverts commit 7068213aa6 .
* <=
* fix
* prints
* test no redundancy
* all tests no redundancy
* revert delay
* refactor
---------
Co-authored-by: Alexander Bondarenko <486682+dpwiz@users.noreply.github.com >
Co-authored-by: spaced4ndy <8711996+spaced4ndy@users.noreply.github.com >
2024-04-01 13:37:35 +04:00
Evgeny Poberezkin
6ded721daa
remove monad typeclasses to reduce overhead ( #1077 )
...
* remove monad typeclasses to reduce overhead
* remove unliftIO
* StrictData
* inline
* optional agent port
* avoid MonadUnliftIO instance (#1078 )
* avoid MonadUnliftIO instance
* simpler liftError'
* rename
* narrow down instance
* revert
---------
Co-authored-by: Evgeny Poberezkin <evgeny@poberezkin.com >
* logServer
---------
Co-authored-by: Alexander Bondarenko <486682+dpwiz@users.noreply.github.com >
2024-03-31 20:50:35 +01:00
Evgeny Poberezkin
44410535fd
do not pass key to control port of xftp server ( #1074 )
2024-03-28 18:16:36 +00:00
Alexander Bondarenko
bbc9eccf4d
xftp: prevent overwriting completed upload ( #1063 )
...
* xftp: prevent overwriting completed upload
* add size check for skipCommitted
* fix import
* fail on incorrect size
---------
Co-authored-by: Evgeny Poberezkin <evgeny@poberezkin.com >
2024-03-28 18:12:48 +00:00
Alexander Bondarenko
ee90ea6a69
replace base64-bytestring with base64 ( #1065 )
...
* replace base64-bytestring with base64
* minify
* use bytestring-0.10 compatible fork
PR pending...
* bump base64 fork with text compat
* move compat details to modules
* switch repo
* add back module
* cleanup
* minify
* clean imports
* rename
---------
Co-authored-by: Evgeny Poberezkin <evgeny@poberezkin.com >
2024-03-27 23:35:09 +00:00
Alexander Bondarenko
5e0123313c
log control port commands, authentication for control port ( #1071 )
...
* log control port commands
* auth
* add auth to xftp, config and commands
* log missing auth
* put smp save under auth
* corrections
---------
Co-authored-by: Evgeny Poberezkin <evgeny@poberezkin.com >
2024-03-26 18:04:28 +00:00
Evgeny Poberezkin
2712fbc711
add key to XFTP server control port command ( #1070 )
...
* add key to XFTP server control port command
* name
2024-03-26 09:38:28 +00:00