dandri/simplexmq
1
0
Fork 0
mirror of https://github.com/simplex-chat/simplexmq.git synced 2026-04-22 14:45:46 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,247 Commits 93 Branches 173 Tags
fa848decd2922cd00a3fccf491cd7a3d72c2ee24
Commit Graph

1247 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Evgeny Poberezkin
fa848decd2 Merge branch 'master' into ep/cmd-auth 2024-02-05 21:02:38 +00:00
Evgeny Poberezkin
189885c50d protocol: ignore tail bytes in handshake blocks to allow future extension (#983) 
* protocol: ignore tail bytes in handshake blocks to allow future extension

* cleanup
 2024-02-05 21:01:20 +00:00
Evgeny Poberezkin
5b2af24df9 fix encoding, most tests 2024-02-05 13:34:11 +00:00
Evgeny Poberezkin
a7a467196f smp: command authorization 2024-02-05 09:07:27 +00:00
Evgeny Poberezkin
a516c2f72c 5.5.1.2 v5.5.1 2024-02-02 08:19:02 +00:00
Evgeny Poberezkin
2ae1c9f79d agent: only retry connecting SMP clients when there are pending subscriptions (#981) 
* agent: only retry connecting SMP clients when there are pending subscriptions

* fix

* remove retry on creating clients

* simplify
 2024-02-01 16:17:37 +00:00
Alexander Bondarenko
24b84106a6 core: add activity tests to workers details (#980) 
* core: add activity tests to workers details

* remove names

---------

Co-authored-by: Evgeny Poberezkin <evgeny@poberezkin.com>
 2024-02-01 11:02:31 +00:00
Alexander Bondarenko
15bc027f23 core: fix reconnection bugs (#979) 
* core: fix reconnection bugs

* untangle newProtocolClient

* refactor

* report busy clientVar error

* log error

* comments

---------

Co-authored-by: Evgeny Poberezkin <evgeny@poberezkin.com>
 2024-02-01 10:55:50 +00:00
Alexander Bondarenko
cb64dabf75 tests: fix sporadic failures from reading stats (#975) 2024-01-30 11:36:07 +00:00
Evgeny Poberezkin
7a0cd8041b 5.5.1.1 2024-01-22 14:06:52 +00:00
Evgeny Poberezkin
fd4eeb36db agent: optimize expired messages query (#976) 
* agent: optimize expired messages query

* schema

* fix query

* fix

* typo

Co-authored-by: spaced4ndy <8711996+spaced4ndy@users.noreply.github.com>

* fix

* refactor

* comment

* refactor2

---------

Co-authored-by: spaced4ndy <8711996+spaced4ndy@users.noreply.github.com>
 2024-01-22 14:04:57 +00:00
Evgeny Poberezkin
1e49f1c92d 5.5.1.0 v5.5.1-beta.0 2024-01-19 19:47:39 +00:00
Alexander Bondarenko
f7cdec2f08 fix: support multiple notification servers in configuration (#971) 
* tests: add trpl-keeps-server check

* add smp server switch check

* add connection test and fix withNtfServer

* Update src/Simplex/Messaging/Agent/NtfSubSupervisor.hs

Co-authored-by: Evgeny Poberezkin <e.poberezkin@me.com>

* use ntfServer from token

* rename

---------

Co-authored-by: Evgeny Poberezkin <e.poberezkin@me.com>
Co-authored-by: Evgeny Poberezkin <evgeny@poberezkin.com>
 2024-01-19 19:42:28 +00:00
Evgeny Poberezkin
8ff89c19dc servers: do not keep stats file open during delays (#974) 2024-01-19 17:47:47 +00:00
Evgeny Poberezkin
baf2c47065 agent: expire messages failed after quota exceeded after 7 days, and expire multiple messages at once (#973) 
* agent: expire messages failed after quota exceeded after 7 days, and expire multiple messages at once

* fix, test

* refactor

* catch in loop
 2024-01-19 17:21:25 +00:00
Alexander Bondarenko
40fa34c2d5 tests: test multiple Ntf servers (#966) 
* tests: add ntf case with multiple Ntf servers

* simplify test

* fix for master

* add server switch test

* add server switch test

* add message test for ntf server switch
 2024-01-17 19:47:47 +00:00
Alexander Bondarenko
eb41abfb8f tests: fix random order in async commands case (#969) 2024-01-17 11:48:41 +00:00
Evgeny Poberezkin
b547f34cc0 Revert "Revert "agent: do not create user record in new databases (#957)" (#963)" (#964) 
* Revert "Revert "agent: do not create user record in new databases (#957)" (#963)"

This reverts commit aee9088417.

* tests

* remove logging
 2024-01-17 11:01:04 +00:00
Evgeny Poberezkin
f6ed4640d4 5.5.0.6 v5.5.0 2024-01-16 17:07:15 +00:00
Evgeny Poberezkin
a0b35cec4f agent: fix potential race when good client can be removed instead of bad for the same transport session (#967) 
* agent: fix potential race when good client can be removed instead of bad for the same transport session

* tryAgentError

* case
 2024-01-16 13:45:51 +00:00
Evgeny Poberezkin
00c4ff4a21 agent: fix race condition in subscription worker (results in stuck delivery), better error handling in batch operations (#962) 
* debugging test: join connection when reply queue creation fails

* more logs

* more logs

* more logs, fixed bug

* cleanup

* catch all errors

* simplify

* comment

* remove client ID counter
 2024-01-16 10:29:35 +00:00
Evgeny Poberezkin
aee9088417 Revert "agent: do not create user record in new databases (#957)" (#963) 
This reverts commit 9b9a0bd0df.
 2024-01-14 22:28:28 +00:00
Evgeny Poberezkin
7f7a77c4eb SMP protocol: optimize batching transactions, remove Builder (#961) 
* remove Builder

* fewer chunks

* remove lazy bytestrings

* optimize

* pad
 2024-01-14 20:42:47 +00:00
Alexander Bondarenko
cd4329f2de agent: collect worker stats (#959) 
* agent: collect worker stats

* add more workers

* process asyncCmdWorkers as a Map
 2024-01-12 23:38:35 +00:00
Alexander Bondarenko
68f5e189a6 smp: check for progress when resubscribing (#956) 
* smp: check for progress when resubscribing

* add allowClose to reconnectServer to distinguish entry points

* resolve error todo

* make reconnect async per-session

* remove allowClose

* deregister reconnecter when it finishes

* signal/react more work explicitly

* fix restart condition

* wait for reconnecter to finish

* remove redundant reconnect locks

* rename getClientVar for expanded scope

* formatting

* remove withPending

* move pending check to tryReconnectSMPClient loop

* combine pending check and slot release transactions

* actually reserve the slot for async

* simplify

* refactor

* refactor

* use removeClientVar

* rename

* refactor

* test

* reduce MonadError scope

---------

Co-authored-by: Evgeny Poberezkin <2769109+epoberezkin@users.noreply.github.com>
 2024-01-12 19:29:18 +00:00
Evgeny Poberezkin
17f64e1565 docs: URI schemes (#958) 2024-01-12 17:21:57 +00:00
Evgeny Poberezkin
9b9a0bd0df agent: do not create user record in new databases (#957) 
* agent: do not create user record in new databases

* update
 2024-01-12 16:57:57 +00:00
Evgeny Poberezkin
ad8cd1d515 5.5.0.5 v5.5.0-beta.5 2024-01-09 19:44:15 +00:00
Evgeny Poberezkin
ca527b4d6c use Builder for batching commands (#953) 
* use Builder for batching commands

* refactor

* refactor

* increase timeout in test

* do not materialize builder

* use concat

* debug test

* debug2

* delays

* more delay, less worker delay

* remove logs

* reduce delay

* tests

* sized builder

* builder

* comment

* remove unsafe

* style

* remove fromIntegral
 2024-01-08 22:54:27 +00:00
Evgeny Poberezkin
55808b0c82 5.5.0.4 v5.5.0-beta.4 2024-01-06 11:40:15 +00:00
Evgeny Poberezkin
fa794d7878 agent: send errors on subscription timeouts (#937) 
* agent: debug server reconnections

* update lock only if it has the same name already

* report subscription timeouts

* clean up
 2024-01-05 17:36:57 +00:00
Alexander Bondarenko
34056b9d7b xftp-server: add control port (#951) 
Co-authored-by: Evgeny Poberezkin <2769109+epoberezkin@users.noreply.github.com>
 2024-01-05 17:36:19 +00:00
Alexander Bondarenko
87cec9ad16 control: try deleting from senders first (#950) 2024-01-05 17:07:29 +00:00
Evgeny Poberezkin
2488cf1e3a agent: restart worker when it terminated (#948) 
* agent: restart worker when it terminated

* comment

* remove writeTMVar

* remove writeTMVar 2

* remove writeTMVar 3
 2024-01-05 14:22:26 +00:00
Alexander Bondarenko
b4495bb4f0 xftp-server: fix stats (#944) 
* xftp-server: fix stats

* count file expirations

* rename

* simplify

* check files size

* store and fix fileSize check

* do

---------

Co-authored-by: Evgeny Poberezkin <2769109+epoberezkin@users.noreply.github.com>
 2024-01-05 11:30:27 +00:00
Alexander Bondarenko
6d4834f306 core: publish sendMessagesB (#949) 2024-01-04 15:37:13 +00:00
Evgeny Poberezkin
37d30240fd 5.5.0.3 v5.5.0-beta.3 2024-01-03 20:36:54 +00:00
Alexander Bondarenko
8fd5e9f25a servers: make writeStoreLogRecord atomic (#946) 
* servers: make writeStoreLogRecord atomic

* comment

---------

Co-authored-by: Evgeny Poberezkin <2769109+epoberezkin@users.noreply.github.com>
 2024-01-03 20:29:09 +00:00
Alexander Bondarenko
36298f2cea smp-server: update stats (#943) 
* smp-server: check queue balance in stats vs store

* smp-server: add msgExpired stats

* add msgExpired stats

* split expire/stats transactions

* count and pass msgExpired explicitly

* save/load qCount and use it for checking store
 2024-01-02 21:24:17 +00:00
Evgeny Poberezkin
f954c2cd17 rfc: SMP proxies key scope and other considerations (#927) 
* rfc: SMP proxies key scope and other considerations

* split line
 2023-12-28 23:29:51 +00:00
Evgeny Poberezkin
d0588bd0ac 5.5.0.2 v5.5.0-beta.2 2023-12-27 20:35:56 +00:00
Alexander Bondarenko
7eb7bd5e81 xftp-server: add inactiveClientExpiration (#936) 
* xftp-server: add inactiveClientExpiration

* fix test config

* add test

* add xftpPing

* switch to PCEUnexpectedResponse

* remove watchdog when server quits

* rename, loop

---------

Co-authored-by: Evgeny Poberezkin <2769109+epoberezkin@users.noreply.github.com>
 2023-12-27 20:31:19 +00:00
Alexander Bondarenko
bb4de2e63c ci: limit releases to GHC-9.6.3 (#938) 2023-12-27 15:55:42 +00:00
spaced4ndy
22e1932372 xftp, ntf: refactor, reuse workers abstractions (#935) 
* xftp: refactor, reuse workers abstractions (wip, test fails)

* rename

* refactor (tests pass)

* refactor2

* linebreaks

* do

* reuse worker abstractions for notifications

---------

Co-authored-by: Evgeny Poberezkin <2769109+epoberezkin@users.noreply.github.com>
 2023-12-27 13:02:08 +04:00
spaced4ndy
e43e4860b9 xftp: file workers cycle through pending files based on retries count (limit number of iterations per work item to prevent stuck delivery) (#930) 
* xftp: test file reception - shouldn't get stuck if file is deleted on server

* comment

* expiration test

* approach

* wip

* sort by retries in other works, revert some diff

* revert diff

* modify tests

* refactor

* refactor

* remove prints

* apply to other workers

* remove import

* comment

* refactor

* revert queue size

* fix test

* rename

* comment, correct number of retries

---------

Co-authored-by: Evgeny Poberezkin <2769109+epoberezkin@users.noreply.github.com>
 2023-12-26 22:20:25 +00:00
Alexander Bondarenko
efe7ce27e7 control: add delete command (#933) 
* control: add delete command

* logDeleteQueue only when found

* use default StrEncoding for CPDelete arg

* move stats update from main transaction

* use size

* stabilize AUTH timing tests

* more iterations

---------

Co-authored-by: Evgeny Poberezkin <2769109+epoberezkin@users.noreply.github.com>
 2023-12-26 20:20:12 +00:00
Evgeny Poberezkin
577e3cf14d agent: add server msg IDs to agent logs, disable 2 tests (#934) 
* agent: race when using agent via TCP

* remove logs

* enable tests

* comments

* use different databases for different clients

* enable all tests
 2023-12-26 17:50:39 +00:00
Evgeny Poberezkin
7ddeca50e4 agent: mark work items failed (#931) 
* agent: mark work items failed (WIP)

* add tests, created_at

* getWorkItem for snd and rcv files

* fix

* tests

* fix

* tests

* test

* tests

* rename

* fix,refactor

* add indexes

* update schema

* do not try to get more work when resuming an existing worker

---------

Co-authored-by: spaced4ndy <8711996+spaced4ndy@users.noreply.github.com>
 2023-12-26 17:00:42 +04:00
Evgeny Poberezkin
1e15d56e92 5.5.0.1: fix migration 2023-12-23 16:06:11 +00:00
Evgeny Poberezkin
46056557f8 5.5.0.1: update .cabal 2023-12-23 14:12:20 +00:00