Evgeny
47dd0c4c64
agent: do not send worker crash errors when agent is not active (stopped) ( #1256 )
2024-08-09 21:10:27 +01:00
Evgeny
7762b4d364
reduce the number of STM transactions ( #1255 )
...
* reduce the number of STM transactions
* reduce STM more
* refactor
* remove more
2024-08-09 16:38:46 +01:00
Evgeny
fc6b9c0e1b
agent: stop statistics and cleanup when chat is stopped ( #1251 )
2024-08-07 13:14:09 +01:00
Evgeny
a017047c52
smp server: fix race when client is marked as subscribed after it is disconnected, preventing its GC ( #1250 )
...
* smp server: fix race when client is marked as subscribed after it is disconnected, preventing its GC
* refactor
2024-08-06 08:17:38 +01:00
Evgeny
f4d1a33ed8
agent: retry loop that resumes subscriptions as soon as agent is moved to foreground, suspend retry loops while agent is suspended ( #1249 )
...
* agent: retry loop that resumes subscriptions as soon as agent is moved to foreground, suspend retry loops while agent is suspended
* reset retry enterval when moving to foreground
* account for network state too
* simplify
* typo
* simplify
2024-08-05 15:09:46 +01:00
Evgeny Poberezkin
03ea151be5
agent: support additional messages for connection in message batches ( #1247 )
...
* agent: support additional messages for connection in message batches
* fix, test
* test 2 connections
* use TVar instead of TMVar for GHC 8.10.7
2024-07-30 17:12:29 +01:00
Evgeny Poberezkin
3753379ae4
agent: support dababase access with high priority for more responsive user actions ( #1248 )
...
* agent: support dababase access with high priority for more responsive user actions
* rename, export
* fix
2024-07-29 18:57:16 +01:00
Evgeny Poberezkin
5fa3c149e9
smp server: fix server-info, additional stats, allow expiring inactive clients which have prohibit subscriptions only (iOS NSE clients) ( #1237 )
...
* smp server: fix server-info
* fix
* faster saving messages
* remove comment
* move ProhibitSub out of TVar
* subscription stats
* stabilize test
* order
Co-authored-by: spaced4ndy <8711996+spaced4ndy@users.noreply.github.com >
* more notification stats
* count ntf stats
* update server-info
---------
Co-authored-by: spaced4ndy <8711996+spaced4ndy@users.noreply.github.com >
2024-07-25 16:06:40 +01:00
Evgeny Poberezkin
9093c7b120
agent, ntf server: only mark subscriptions as pending that were created by the disconnected client ( #1242 )
...
* ntf server: only mark subscriptions as pending if the disconnected client is current
* add sessionId to subscribed queue
* add sessionId to subscriptions in ntf server agent
* fix
2024-07-25 13:07:28 +01:00
Evgeny Poberezkin
47ae921b86
use strict Map ( #1241 )
2024-07-23 08:27:54 +01:00
spaced4ndy
c605156302
agent: getAgentSubsTotal api ( #1238 )
...
* agent: getAgentSubsTotal api
* move
* export
* count sessions
* simplify
* simplify 2
---------
Co-authored-by: Evgeny Poberezkin <evgeny@poberezkin.com >
2024-07-22 15:43:38 +01:00
Evgeny Poberezkin
051bf38bc7
agent: remove delays in notification processing, add notification stats ( #1235 )
...
* agent: remove delays in notification processing, add notification stats
* do not replace token after failed check
* more stats
* refactor
* fix
* backwards compatible JSON parsing
* retry deleting subscription on temporary error
* remove attempts to get multiple notification messages
* fix JSON decoding to be backwards compatible
2024-07-22 15:42:34 +01:00
Evgeny Poberezkin
8423c636a8
rename queueId to entId (can be message queue, proxied session and data blob ID to be added) ( #1240 )
2024-07-22 12:01:38 +01:00
Evgeny Poberezkin
cc5732f41f
smp server: stats for commands retrieving messages when notifications are received ( #1236 )
...
* more stats
* fix stats
2024-07-20 14:10:10 +01:00
spaced4ndy
7565ddd91c
agent: initialize ratchet on processing confirmation to support decryption of messages received before allowConnection; return SndQueueSecured from joinConnection, acceptContact ( #1233 )
2024-07-18 19:54:14 +04:00
Evgeny Poberezkin
e59a098e66
smp server: remove subscriptions from the clients when queues are deleted ( #1234 )
...
* smp server: remove subscriptions from the clients when queues are deleted
* remove ntf subscriptions, update stats
* add GET stats
2024-07-18 10:59:48 +01:00
Evgeny Poberezkin
8d56b0ba85
agent: allow starting only XFTP sending workers ( #1232 )
...
* agent: allow starting only XFTP sending workers
* use Bool param
* flip bool
* update
2024-07-17 13:01:17 +01:00
Evgeny Poberezkin
784d36d691
socks mode encoding ( #1231 )
...
* socks mode encoding
* test delays
* test delay
* unused import
2024-07-15 20:28:24 +01:00
Evgeny Poberezkin
291039159f
ntf server: use SOCKS proxy to connect to onion-only SMP servers ( #1229 )
...
* ntf server: use SOCKS proxy to connect to onion-only SMP servers
* fix test
2024-07-14 23:19:02 +01:00
Evgeny Poberezkin
492d2f86bc
smp server: additional control port commands to monitor server state ( #1228 )
...
* smp server: additional control port commands to monitor server state
* fix
* space
2024-07-13 22:34:10 +01:00
Evgeny Poberezkin
8dd54ced0e
agent: retry proxied command on NO_SESSION error, to prevent failure of proxied interactive commands (like joining connection) ( #1227 )
2024-07-13 10:06:48 +01:00
Evgeny Poberezkin
e56bd0b47b
agent: add known servers ( #1225 )
...
* agent: add known servers
* test delays
* ServerCfg
* json encoding
* enabledServerCfg
* checkUserServers
2024-07-12 12:41:55 +01:00
spaced4ndy
ff2b00a029
agent: change ProxyClientError json encoding ( #1226 )
2024-07-11 19:27:04 +04:00
Evgeny Poberezkin
26979ff6b5
smp server: simplify client subscriptions ( #1223 )
2024-07-09 08:36:03 +01:00
Evgeny Poberezkin
21abc5cabe
smp server: reduce the number of threads by delivering message to subscription when it is sent ( #1222 )
...
* smp server: reduce the number of threads by delivering message to subscription when it is sent
* test delay
* test delay
2024-07-08 23:12:01 +01:00
Evgeny Poberezkin
6e76221e07
agent: fix possible dead lock between sending and receiving messages, stress test for message delivery ( #1224 )
...
* agent: fix possible dead lock between sending and receiving messages, stress test for message delivery
* deliver events after the lock is released
* delayed delivery in command processing too
* tests: increase message expiration time
2024-07-08 21:47:42 +01:00
Evgeny Poberezkin
743676421d
ntf server: simplify and optimize subscriptions in server agent ( #1219 )
...
* increase queue size
* simplify
* refactor to optimize memory usage and performance
* comment
* refactor
* test delays
2024-07-07 21:17:12 +01:00
Evgeny Poberezkin
9d0774a58e
agent: add queue information ( #1217 )
...
* agent: add queue information to "debug delivery" response
* fix test
* rename
* encodings
2024-07-03 19:32:27 +01:00
Evgeny Poberezkin
ce732c0efb
agent: enable fast handshake (revert #1215 ) ( #1216 )
...
* Revert "agent: disable fast handshake (#1215 )"
This reverts commit aa1d8d6c8b .
* remove import
* test delays
2024-07-03 18:05:27 +01:00
spaced4ndy
ae8e1c5e9a
agent: servers stats improvements, fixes ( #1208 )
...
* agent: reset stats startedAt time in memory
* getAgentSubsSummary
* change sub counting
* ack statistics
* add import
* instance
* Revert "instance"
This reverts commit 1f63740d56 .
* Revert "add import"
This reverts commit ef72df8014 .
* modify sub counting
* modify conn creation counting
* use int64
* file size stats
* remove import
* ack err counting
* conn del stats
* format
* new data
* add data
* toKB
* restore connCompleted
* use Int for counts
* use rq from scope
* remove getAgentSubsSummary
* fix connCompleted
* fix
* revert disabling stats
* use srv from scope
* combine ack stats
* modify
* comment
* count subs
* refactor
---------
Co-authored-by: Evgeny Poberezkin <evgeny@poberezkin.com >
2024-07-03 12:36:15 +01:00
Evgeny Poberezkin
aa1d8d6c8b
agent: disable fast handshake ( #1215 )
2024-07-02 13:40:37 +01:00
Evgeny Poberezkin
5c839b40c9
Merge branch 'master' into fast-connection
2024-07-01 21:14:32 +01:00
spaced4ndy
a50e2e74a5
agent: disable saving stats ( #1214 )
...
* agent: disable stat saving
* disable migration
* schema
* disable restore
2024-07-01 21:06:38 +01:00
Evgeny Poberezkin
26cfad5e88
do not use sndSecure when rotating queue ( #1213 )
2024-07-01 13:42:46 +01:00
Evgeny Poberezkin
a99ce6122c
secure queue by sender via proxy (proxy SKEY command) ( #1210 )
...
* client: secure queue by sender via proxy (proxy SKEY command)
* agent and server: proxy SKEY command
2024-06-30 16:20:54 +01:00
Evgeny Poberezkin
a6b542b301
Merge branch 'master' into fast-connection
2024-06-30 15:00:28 +01:00
Evgeny Poberezkin
6a54a58a0d
agent: remove legacy statistics ( #1211 )
...
* agent: remove legacy statistics
* delays after disposeAgent
* delays
* enable all tests
* more delays
2024-06-30 12:50:42 +01:00
Evgeny Poberezkin
9ee684b0f4
rfc: faster handshake protocol ( #1203 )
...
* rfc: faster handshake protocol
* update
* 1 message
* SKEY
* use SKEY for both parties
* test
* update doc
* NEW command parameter
* add k=s param to queue URI
* fix
* add sndSecure field to queues
* make sender key non-optional in SndQueue (WIP, tests fail)
* fast handshake sometimes works (many tests fail)
* correctly handle SKEY retries, avoiding to re-generate the keys
* handle SKEY retries during async connection
* fix most tests (1 test fails)
* remove do
* fix contact requests encoding/tests
* export
* fix: ignore duplicate confirmations, fixes testBatchedPendingMessages
* do not store sndSecure in store log if it is false to allow server downgrade
* add connection invitation encoding tests
2024-06-30 08:36:24 +01:00
spaced4ndy
c788692687
agent: servers summary types, api ( #1202 )
...
* agent: servers summary types, api [wip]
* encoding
* export
* Revert "export"
This reverts commit cd9f315fe8 .
* comment
* rename
* simplify types
* uncomment
* comment
* rework
* comment, exports
* save, restore stats wip
* remove
* rename
* save stats periodically
* sigint, sigterm experiments
* corrections
* remove some proxy stats
* increase stat
* proposed stats
* fields
* Revert "sigint, sigterm experiments"
This reverts commit f876fbd418 .
* wip
* retries -> attempts
* errs
* fix
* other errs
* more stat tracking
* sub stats
* remove xftp successes stats
* xftp stats tracking
* revert
* revert
* refactor
* remove imports
* comment
* Revert "refactor"
This reverts commit 26c368d82a .
* Revert "revert"
This reverts commit 4c9e3753b5 .
* Revert "revert"
This reverts commit 6f65644053 .
* todos
* persistence
* rename, fix
* config
* comment
* add started at to summary
* delete stats on user deletion
* reset api
* move
* getAgentServersSummary collect state logic
* corrections
* corrections
* remove
* rework
* decrease contention
* update
* more stats
* count sentProxied
* count subs
* remove unused
* comment
* remove comment
* comment
* export
* refactor
* cleanup
* intervals
* refactor
* refactor2
* refactor3
* refactor4
---------
Co-authored-by: Evgeny Poberezkin <2769109+epoberezkin@users.noreply.github.com >
2024-06-25 09:42:59 +04:00
Alexander Bondarenko
9e7e0d102d
smp-server: conserve resources ( #1194 )
...
* transport: force auth params, remove async wrapper
* stricter new messages
* bang more thunks
* style
* don't produce msgQuota unless requested
* strict
* refactor
* remove bangs
---------
Co-authored-by: Evgeny Poberezkin <2769109+epoberezkin@users.noreply.github.com >
2024-06-24 13:15:08 +01:00
Evgeny Poberezkin
d47c099ac9
docs: update protocol specifications ( #1204 )
...
* docs: update protocol specifications
* update SMP protocol (WIP)
* add proxy protocol commands and responses, amend envelope sizes in SMP protocol
* docs: update XFTP protocol (#1205 )
* docs: update XFTP protocol
* commands
* fix table of contents, move sections
* add about ids
* download encryption
* qualities
* diagram
* crypto
* sending file diagram
* fix svg
* receiving file diagram
* update commands
* update handshake
* Add updated XRCP (#1207 )
* add XRCP protocol
* add ToC
* update
* update
---------
Co-authored-by: Evgeny Poberezkin <2769109+epoberezkin@users.noreply.github.com >
* add XFTP handshake description
* update agent protocol
* fast duplex connection in agent protocol
* update agent protocol
* update overview
* typos
* queue rotation, agent API, updates
* push notifications specification
* add XRCP threat model
* XFTP threat model
* update PQDR
* agent protocol end-to-end encryption
* versions
* remove TOC details
* update
---------
Co-authored-by: spaced4ndy <8711996+spaced4ndy@users.noreply.github.com >
Co-authored-by: Alexander Bondarenko <486682+dpwiz@users.noreply.github.com >
2024-06-23 22:53:45 +01:00
spaced4ndy
4bbadffa37
agent: api to reconnect single server ( #1198 )
...
* agent: api to reconnect single server
* refactor
---------
Co-authored-by: Evgeny Poberezkin <2769109+epoberezkin@users.noreply.github.com >
2024-06-16 06:27:25 -07:00
Evgeny Poberezkin
388d77b61a
ntf stats on SMP server ( #1197 )
...
* log undelivered notifications
* type
* add counters and encoding
* rename
* diff
* style
* style2
---------
Co-authored-by: Alexander Bondarenko <486682+dpwiz@users.noreply.github.com >
2024-06-15 20:05:45 -07:00
Alexander Bondarenko
6597f6f0ed
tests: add proxy connection refused test ( #1200 )
2024-06-15 19:27:58 -07:00
spaced4ndy
3c0cd7efcc
agent: separate type for agent file errors ( #1185 )
2024-06-05 18:44:32 +04:00
Evgeny Poberezkin
3d605310ed
agent: remove protocol encodings and agent TCP server ( #1189 )
...
* rfc: remove agent protocol encodings
* agent: remove protocol encodings and agent TCP server
* update
* remove unused code
* remove
* move tests
* add delay to tests
* stabilize test
* test
* more delays
* reduce delays
* enable all tests
* delays
* style
2024-06-05 14:34:40 +01:00
Evgeny Poberezkin
3dab330480
use throwE instead of throwError ( #1187 )
...
* use throwE instead of throwError
* test delay
2024-06-05 11:20:50 +01:00
Evgeny Poberezkin
d28b17e787
xftp server: send HTTP2 error as timeout error to the client so it is treated as temporary ( #1186 )
...
* xftp server: log file reception error
* report HTTP2 error as timeout error
* reduce timeout to 5 min
* process timeout error in protocol response
* log warning on timeout/HTTP2 error
2024-05-31 22:18:28 +01:00
Evgeny Poberezkin
3a3a84c58c
server: log proxy connection errors
2024-05-31 12:20:29 +01:00
Evgeny Poberezkin
d12ea92055
agent: report correct errors from xftp handshake so they are treated as temporary ( #1184 )
...
* agent: report correct errors from xftp handshake so they are treated as temporary
* disable slow servers test
* remove comments
* all tests
* remove duplicate functions
2024-05-31 09:47:47 +01:00