25 Commits

Author	SHA1	Message	Date
Evgeny Poberezkin	c8cc2f262b	journal store works, some tests pass	2024-12-15 21:59:34 +00:00
Evgeny Poberezkin	14aed2dda7	refactor	2024-12-15 16:38:09 +00:00
Evgeny Poberezkin	a319a377a1	types for store	2024-12-15 11:19:36 +00:00
Evgeny Poberezkin	3af3f475cf	todo	2024-12-14 11:27:26 +00:00
Evgeny Poberezkin	45a78639d8	closeMsgStore	2024-12-13 20:43:03 +00:00
Evgeny Poberezkin	6b37c53d15	implement deleteQueue_	2024-12-13 20:40:12 +00:00
Evgeny Poberezkin	dfa77a1efa	remove recipientId from QueueRec, statePath from queue object	2024-12-13 18:29:23 +00:00
Evgeny Poberezkin	f3fc087800	remove statePath from queue record	2024-12-13 17:34:11 +00:00
Evgeny Poberezkin	38a4a4faf5	move queue recipient ID and paths to queue object, TODO remove recipientId from QueueRec, implement suspendQueue and updateQueueTime	2024-12-13 14:25:52 +00:00
Evgeny Poberezkin	8b656d7dc5	partial implementation	2024-12-12 13:45:18 +00:00
Evgeny Poberezkin	1bdf8bc3e3	parameterize journal store for queue storage	2024-12-12 09:06:10 +00:00
Evgeny	45333bd340	smp server: do not open/read journal message queues that are known to be empty (#1406) ... * smp server: do not open/read journal message queues that are known to be empty * cleanup * version * close empty queues on first subscription * revert version	2024-11-22 12:29:31 +00:00
Evgeny	21fbbf9106	smp server: update message counts during message expiration, increase idle interval (#1404) ... * smp server: update message counts during message expiration, increase idle interval * version * fix * flip results * version	2024-11-17 09:44:40 +00:00
Evgeny	17a0be10fa	smp server: expire messages in idle message queues (including not opened) (#1403) ... * smp server: expire messages in idle message queues (including not opened) * use message expiration interval * simpler * version * remove version	2024-11-15 10:26:24 +00:00
Evgeny	d3275cef48	smp server: combine messages and queue storage to optimise performance, prevent race condition when deleting queue and to avoid "orphan" messages. (#1395) ... * smp server: combine queue and message store into one class (WIP) * keep deleted queue tombstones to prevent race conditions and errors when restoring * move store log from server to store implementations * STMQueueStore type class * fix store closed when messages expired, handle store writing errors * types * version * fix recovery from missing write journal, tests * version	2024-11-07 08:09:11 +00:00
Evgeny	7c21945569	smp server: option to skip expiring messages on start, read queue state file end only (#1400)	2024-11-03 21:08:07 +00:00
Evgeny Poberezkin	d49dc201c3	smp server: log file name on hClose error	2024-10-28 10:26:24 +00:00
Evgeny	5940514f40	smp server: remove queue from map when closing, test (#1392) ... * smp server: remove queue from map when closing, test * remove print * refactor	2024-10-26 16:14:55 +01:00
Evgeny	56ca7bf30e	smp server: do not log progress when server starts (#1390) ... * smp server: do not log progress when server starts * test	2024-10-26 10:33:18 +01:00
Evgeny	a3351ad060	smp server: fix export of journal storage (#1384) ... * smp: fix export of journal storage * catch errors when exporting messages	2024-10-25 09:11:47 +01:00
Evgeny	2322f5bf59	smp server: logging format, mask/handle exceptions during journal store operations (#1381) ... * smp server: fixed logging format for journal store errors * version * colon * logs * refactor * space * remove comment * log file name in fixFileSize * logError * stricter * process all queues more efficiently * use monoid for queue processing * expire messages concurrently * concurrently 2 * Revert "concurrently 2" This reverts commit c1aee1f22c. * Revert "expire messages concurrently" This reverts commit fc53137cdb. * show queue directory or ID in errors * foldM * mask_ * try * mask more * refactor * command to delete journal * uninterruptibleMask_ when writing to state file * fix ghc8.10.7 * version * revert version	2024-10-24 19:44:47 +01:00
Evgeny	c9c075fd49	smp server: merge quota messages and set queue to "over quota" state after restoring, server tests with journal and memory store (#1380) ... * smp: run server tests with journal and memory store * merge quota messages, set queue to "over quota" state after restoring * fix test	2024-10-23 09:17:23 +01:00
Evgeny	1484523164	smp server, journal store: check file size on append, validate queue state (#1377) ... * smp server: journal store queue state validation * validate state on update, refactor * handle message parsing errors * typo * fix test, throw exception when file is smaller than expected * fix * fix test in ghc 8.10.7	2024-10-22 12:09:51 +01:00
Evgeny	dc17402896	smp server: updated journal store API (#1374) ... * core: updated journal store API * parameterize JournalState by read/write type * collect stats when importing/expiring * compare stored stats and store for messages and notifications * simplify	2024-10-21 16:50:07 +01:00
Evgeny	0414ea59f0	smp server: journal message store (#1370) ... * smp server: remove STM function from MsgStore * polymorphic MsgStore * jourmal storage for messages (WIP) * more journal, test setup * writeMsg * test * tryDelMsg * delMsgQueue * remove MsgStoreClass instance of existential wrapper for Msg stores * store config * extract common logic out of store instances * add store type to config * open journals, cache last message, tests pass * CLI commands * refactor import/export messages * cli commands to import/export journal message store * export journal without draining, import/export tests * journal command * import/export progress * better progress info * only log queue state once when importing * logs * handle IO errors in journal store, return as STORE error * recover from state file errors * fix message files after crash * fix messages folder	2024-10-21 11:50:30 +01:00