8fde8e1344
xftp: agent command entities ( #676 )
...
* xftp: agent command entities
* progress event
* parameterize agent command by entity
* refactor
* Eq instance for APartyCmdTag
2023-03-10 09:10:52 +00:00
e9f949f117
xftp: resume file reception and decryption on agent restart ( #673 )
2023-03-07 13:29:28 +04:00
cc38deb65d
Merge branch 'master' into xftp
2023-03-03 19:16:12 +04:00
cf147397a4
xftp: agent receive file ( #637 )
...
* xftp: agent receive file draft
* receiveFile more stubs, changes to types, schema
* cabal file
* comments
* xftp_server_id
* schema changes, get client, local worker/action
* agent env, save file description, adjust schema
* client stubs
* download chunk wip, store, schema, types
* remove commented code
* read file description, schema, types
* check received, decrypt
* remove pure
* todo
* add XFTP to agent client
* add user id
* agent test
* tests
* rename supervisor into agent
---------
Co-authored-by: Evgeny Poberezkin <2769109+epoberezkin@users.noreply.github.com >
2023-03-03 18:50:16 +04:00
2f7c115207
retryInterval functions pass current interval to the action, to resume with the same interval on restart (improve battery consumption) ( #670 )
2023-03-03 14:12:36 +00:00
94de01a06f
xftp: use SHA256 digest for file chunks to reduce file description size ( #666 )
...
* xftp: use SHA256 digest for file chunks to reduce file description size
* enable all tests
2023-03-01 14:36:55 +00:00
faec32dc5e
xftp: constrain supported file size to 1gb
2023-03-01 13:50:08 +00:00
6227215c3f
xftp: remove file description that cannot be used ( #665 )
...
* xftp: remove file description that cannot be used
* show sender file description first
* change order
Co-authored-by: spaced4ndy <8711996+spaced4ndy@users.noreply.github.com >
---------
Co-authored-by: spaced4ndy <8711996+spaced4ndy@users.noreply.github.com >
2023-03-01 13:08:59 +00:00
249bcc7bb3
update cGet to not throw exception if returned string is shorter (trying to fix HTTP2), fix test ( #663 )
2023-02-28 19:16:35 +00:00
524c1de4de
xftp: server stats ( #661 )
2023-02-28 08:59:28 +00:00
875a4bac5e
xftp cli: use 3 chunk sizes (256kb, 1mb, 4mb) ( #660 )
...
* xftp cli: use 3 chunk sizes (256kb, 1mb, 4mb)
* hardcode default servers
* disable rand command
* hide rand command instead of removing
2023-02-27 21:15:22 +00:00
2f15ce2662
xftp: add quota param to server CLI, restrict chunk sizes ( #659 )
...
* xftp: add quota param to server CLI
* only allow certain file sizes, fix tests
2023-02-27 18:01:18 +00:00
781f8e0000
xftp: increase timeouts for file uploads, show progress ( #658 )
...
* xftp: increase timeouts for file uploads, show progress
* refactor
* use default port 443
* typo
Co-authored-by: spaced4ndy <8711996+spaced4ndy@users.noreply.github.com >
* upload/download to/from chosen servers concurrently
---------
Co-authored-by: spaced4ndy <8711996+spaced4ndy@users.noreply.github.com >
2023-02-27 13:42:15 +00:00
50c9c95287
Merge branch 'master' into xftp
2023-02-25 18:36:48 +00:00
e4aad7583f
unpadded AES-GCM encryption now requires 12 bytes IV ( #656 )
...
* unpadded AES-GCM encryption now requires 12 bytes IV
* update
* simplify AuthTag encoding
2023-02-25 16:22:10 +00:00
f20a996797
xftp: more store log tests ( #654 )
2023-02-24 18:34:01 +04:00
8c8a984c1c
xftp: add basic auth ( #653 )
2023-02-24 17:40:26 +04:00
202922bceb
xftp: server store log ( #652 )
2023-02-24 15:21:07 +04:00
3ab5e9d110
xftp: expire files on the server, track/limit used storage ( #651 )
...
* xftp: expire files on the server
* track/limit used storage
* support storage quota and disabling queue creation in CLI parameters
* fix ini file
* correction
---------
Co-authored-by: spaced4ndy <8711996+spaced4ndy@users.noreply.github.com >
2023-02-24 11:09:51 +04:00
4ce4fa3423
xftp: write secret_box auth tag to the end of the file, for efficiency of ecryption/decryption ( #650 )
...
* xftp: write secret_box auth tag to the end of the file, for efficiency of ecryption/decryption
* comments
2023-02-23 18:28:20 +00:00
fbf0b8b175
xftp: cli - delete file command, acknowledge received chunks ( #649 )
2023-02-23 16:54:50 +04:00
1f394b76a6
xftp: sender file description ( #647 )
...
* xftp: sender file description
* tests
* check, info, tests
* test
* refactor
* refactor, rename sender file
---------
Co-authored-by: Evgeny Poberezkin <2769109+epoberezkin@users.noreply.github.com >
2023-02-22 17:16:49 +04:00
97b8b37325
xftp: FDEL and FACK commands ( #648 )
...
* xftp: FDEL and FACK commands
* correction
* more tests
---------
Co-authored-by: spaced4ndy <8711996+spaced4ndy@users.noreply.github.com >
2023-02-22 12:32:30 +00:00
bbf9e28696
xftp: add server to client encryption layer with cryptobox ( #646 )
...
* xftp: add server to client encryption layer with cryptobox
* workarounds for http2
* update http2 commit
* remove TODOs
2023-02-22 09:03:18 +00:00
50664930cc
xftp: tests with 2 servers and 2 clients
2023-02-20 12:41:15 +00:00
4a9b5412db
xftp: refactor
2023-02-18 23:21:59 +00:00
1ecef81b4d
xftp: validate digests of file chunks in client and server
2023-02-18 22:44:44 +00:00
2bf8cba4fd
xftp: download chunks to separate files
2023-02-18 20:56:46 +00:00
15637e545b
Merge branch 'master' into xftp
2023-02-17 21:40:35 +00:00
c0dcf283eb
server_key_hash fields ( #643 )
...
* server_key_hash fields
* test
* refactor
* fix
* order
* use sync command in test
* refactor
---------
Co-authored-by: Evgeny Poberezkin <2769109+epoberezkin@users.noreply.github.com >
2023-02-17 21:24:32 +00:00
2ddfb044fc
parameterize protocol by error type ( #644 )
2023-02-17 20:46:01 +00:00
acdf4f41c5
XFTP: CLI tests, output command results, info command ( #642 )
...
* XFTP: CLI tests, output command results
* info command, test
* fix test
2023-02-17 11:38:43 +00:00
4e8657097c
xftp: cli client draft ( #635 )
...
* xftp: cli client draft
* more stubs
* compiles
* hash, app
* options parsers, random
* tmp
* xftp CLI client agent, simplify CLI command syntax
* only allow argument as a second parameter
* pivot signature draft
* receive file
* pivot sent chunks to recipients
* encryptFile - temp, chunks, specs
* send (upload) file and save file descriptions
* refactor, remove encrypted file
* save file size in description as string
* include filename inside padded encrypted file
* call chunk uploads concurrently, using queueing in HTTP2 as library client does not support concurrent streaming uploads
* download file (does not work yet)
* add digests to sent chunks
* fix recv - save file using AppendMode
* encrypt/decrypt sent file with secretbox
* remove print
* fix file description parsing in tests
* fix test
---------
Co-authored-by: Evgeny Poberezkin <2769109+epoberezkin@users.noreply.github.com >
2023-02-16 14:06:03 +04:00
d8f81b5cdb
Merge branch 'master' into xftp
2023-02-15 22:02:19 +00:00
2ae3100bed
lazy pad/unpad, secretbox encrypt/decrypt ( #639 )
2023-02-15 22:01:33 +00:00
88c6b0d663
Merge branch 'master' into xftp
2023-02-15 12:51:34 +00:00
8659d4de05
NaCL secretbox based on cryptonite ( #636 )
2023-02-15 12:51:08 +00:00
bccef0ba47
files: server and client spike - basic upload/download ( #591 )
...
* Files: main, env, stats, storeLog
* Better + transport
* Executable
* Env
* Update Client.hs, Server.hs, and 4 more files...
* Answer on request
* Delay
* Temp file
* Bypass cert check
* update package.yml, rename
* update store log
* extend HTTP2 transport
* refactor caStore
* HTTP2 body
* update server stats
* file server/client framework
* verify server commands
* process FNEW command, CLI test works
* simple XFTP server test (fails)
* fix test, refactor
* upload chunk works
* receive file chunk in the client
* remove transport handshake
* typo
Co-authored-by: spaced4ndy <8711996+spaced4ndy@users.noreply.github.com >
* fix names
---------
Co-authored-by: Evgeny Poberezkin <2769109+epoberezkin@users.noreply.github.com >
Co-authored-by: spaced4ndy <8711996+spaced4ndy@users.noreply.github.com >
2023-02-13 13:36:02 +00:00
d7a008985b
Merge branch 'xftp' of github.com:simplex-chat/simplexmq into xftp
2023-02-12 15:53:48 +00:00
9775861b6f
files: file description parsing & serialization, tests ( #633 )
...
* files: file description parsing & serialization, tests
* chunk list
* processFileDescription
* name
* different values
* undo chunk objects to strings
* parser, serializer
* use Either as monad
* refactor
* remove comments
* fix 2 tests
* fix test
* enable all tests
* remove comment
* move
---------
Co-authored-by: JRoberts <8711996+jr-simplex@users.noreply.github.com >
Co-authored-by: Evgeny Poberezkin <2769109+epoberezkin@users.noreply.github.com >
2023-02-12 15:53:37 +00:00
4d333a90fa
Merge branch 'master' into xftp
2023-02-10 19:07:12 +00:00
eb1723acce
refactor transport encoding, make client IO error "temporary" ( #634 )
...
* file server/client framework
* refactor
* make IOError temporary
* fix test
2023-02-10 19:06:28 +00:00
eff501ddcc
Merge branch 'master' into xftp
2023-02-09 23:10:46 +00:00
b342b1dc59
extend HTTP2 transport ( #632 )
...
* extend HTTP2 transport
* refactor caStore
* HTTP2 body
* enable test
* remove maxBodySize
2023-02-09 23:09:24 +00:00
1523c00bcc
files: file description types ( #631 )
2023-02-09 21:22:58 +04:00
ee2a764f93
agent: more strict parsing of TransportHost, tests ( #629 )
2023-02-04 22:59:28 +00:00
5d8febc353
avoid possible race conditions when cancelled clients/asyncs can be removed after the new ones are added (so that the new are removed as well) ( #627 )
2023-01-30 17:46:06 +00:00
c77e7f7e43
remove tests/tmp folder after every test ( #625 )
2023-01-29 22:10:07 +00:00
7fb48930f6
increase database transaction timeout, add test for user deletion ( #622 )
...
* increase database transaction timeout, add test for user deletion
* more test logs
2023-01-25 20:58:03 +00:00
b59669a65e
refactor functions operating on single connections using batch functions ( #620 )
...
* refactor functions operating on single connections using batch functions
* update tests
2023-01-24 13:14:13 +00:00
Evgeny Poberezkin