7e265e5c59
Merge pull request #584 from simplex-chat/xftp
...
XFTP
2023-03-20 20:33:01 +04:00
2bec353eae
xftp: add command to delete rcv file; agent manages save path ( #692 )
2023-03-20 20:08:38 +04:00
40da7e76dd
import stateTVar
2023-03-18 13:57:17 +00:00
2e02ba86fd
add stateTVar import
2023-03-18 13:38:20 +00:00
02eb1e9822
add stateTVar imports for compatibility with older hackage index in nix builds
2023-03-18 07:57:25 +00:00
cd48c33c0d
Merge branch 'master' into xftp
2023-03-17 13:30:52 +00:00
5258fe9b7e
add sha512 ( #691 )
...
* add sha512
* update export title
2023-03-17 13:01:49 +00:00
e33d5b5184
use different constraint for non-error functions ( #690 )
2023-03-17 16:01:24 +04:00
2b1a02d7d4
xftp: reconnect XFTP client on replica retry ( #689 )
...
* xftp: re-create XFTP client on replica retry
* closeXFTPSessionClient
* refactor
---------
Co-authored-by: Evgeny Poberezkin <2769109+epoberezkin@users.noreply.github.com >
2023-03-17 09:50:49 +00:00
9255d48b69
xftp: move delay to replica ( #688 )
2023-03-16 18:12:38 +04:00
bab689099f
xftp: streaming file encryption/decryption to avoid memory spikes ( #687 )
...
* xftp: streaming file decryption to avoid memory spikes
* refactor, enable tests
* streaming encryption
* refactor
2023-03-16 13:57:21 +00:00
a0eb53b891
xftp: use agent servers in experimental send, refactor decryption ( #686 )
...
* xftp: use agent servers in experimental send, refactor decryption
* fix/enable xftp send test test
* allow any order
2023-03-14 22:56:19 +00:00
db120b6d2e
xftp: pass save path to agent ( #685 )
2023-03-14 19:16:25 +04:00
64f5d63d2e
Support for building ARM docker images ( #679 )
...
* add llvm to build stage
running docker build on Apple Sillicon would result in this error:
#14 49.39 <no location info>: error:
#14 49.39 Warning: Couldn't figure out LLVM version!
#14 49.39 Make sure you have installed LLVM between [9 and 13)
I assume it can’t find llvm/clang?
* install using unattended helper script
the current haskell is hardcoded to x86, so switch to using haskell’s official helper script which supports arm
also need to bump up setting the path, since ghcup is no longer in /usr/bin
reference: https://www.haskell.org/ghcup/guide/#continuous-integration
* add numa headers/libs
docker build (specifically haskell install step) would fail with :
#7 107.2 utils/ghc-cabal/dist-install/build/tmp/ghc-cabal: error while loading shared libraries: libnuma.so.1: cannot open shared object file: No such file or directory
I think this is because numa isn’t installed on arm instances of focal by default, but it is in later versions
anyway this fixes that
* also add numa to final
The image builds at this point! But it fails to boot on arm - again with a numa error.
This fixes that.
* don’t specify llvm version
---------
Co-authored-by: +shyfire131 <shyfire131@shyfire131.net >
2023-03-13 20:00:34 +00:00
ddc2da8fe4
xftp: agent API for xftp commands and events ( #684 )
...
* xftp: agent API for xftp commands and events
* fix tests
* fix tests 2
* xftp: update agent send api
* update API to make temp path optional
* revert tmp path changes (fixes send)
---------
Co-authored-by: spacedandy <8711996+spaced4ndy@users.noreply.github.com >
2023-03-13 09:04:23 +00:00
3fe1f3c822
rename FileParty constructors
2023-03-11 10:05:07 +00:00
448b674fb1
5.0.0-beta.5
2023-03-10 17:37:38 +00:00
cf1cd75a15
xftp: fix experimental send api description paths ( #683 )
2023-03-10 21:06:09 +04:00
40164ff21f
update http2 to 4.1 ( #680 )
2023-03-10 16:59:26 +00:00
c1266d55a4
xftp: experimental send api wip ( #682 )
2023-03-10 20:43:10 +04:00
cf8f78f518
xftp: add random bytestring entity id for rcv files ( #681 )
2023-03-10 20:32:37 +04:00
accfee5a52
5.0.0-beta.4
2023-03-10 10:32:05 +00:00
cc2066473c
xftp: cleanup complete & error files tmp paths; remove save path before decrypting if exists ( #677 )
2023-03-10 14:26:34 +04:00
8fde8e1344
xftp: agent command entities ( #676 )
...
* xftp: agent command entities
* progress event
* parameterize agent command by entity
* refactor
* Eq instance for APartyCmdTag
2023-03-10 09:10:52 +00:00
deec963de8
xftp: agent error handling ( #675 )
...
- chunk download doesn't loop on permanent errors
- decryption errors are considered permanent - local worker doesn't retry
- update replica retries; to do - consider use for this field, or remove it
- rcv file Error status - to prevent repeat reads of chunks for download, files for decryption; also plan to use it for filtering on cleanup
- error string saved in separate field for debugging (not part of status type)
- agent event for rcv file errors
2023-03-09 15:32:17 +04:00
552759018e
xftp: server types for any protocol ( #672 )
2023-03-09 09:54:31 +00:00
6d52150672
xftp: agent send file design wip ( #674 )
2023-03-08 14:30:37 +04:00
e9f949f117
xftp: resume file reception and decryption on agent restart ( #673 )
2023-03-07 13:29:28 +04:00
a0c86158d9
xftp agent: update chunk delay ( #671 )
2023-03-03 20:39:15 +04:00
cc38deb65d
Merge branch 'master' into xftp
2023-03-03 19:16:12 +04:00
cf147397a4
xftp: agent receive file ( #637 )
...
* xftp: agent receive file draft
* receiveFile more stubs, changes to types, schema
* cabal file
* comments
* xftp_server_id
* schema changes, get client, local worker/action
* agent env, save file description, adjust schema
* client stubs
* download chunk wip, store, schema, types
* remove commented code
* read file description, schema, types
* check received, decrypt
* remove pure
* todo
* add XFTP to agent client
* add user id
* agent test
* tests
* rename supervisor into agent
---------
Co-authored-by: Evgeny Poberezkin <2769109+epoberezkin@users.noreply.github.com >
2023-03-03 18:50:16 +04:00
2f7c115207
retryInterval functions pass current interval to the action, to resume with the same interval on restart (improve battery consumption) ( #670 )
2023-03-03 14:12:36 +00:00
6ed4dd1515
update http2 library
2023-03-03 11:00:10 +00:00
914240108d
xftp: update http2 to remove workarounds with padding and delay ( #667 )
2023-03-02 16:00:46 +00:00
e764a51fc0
v5.0.0-beta.3
2023-03-01 14:37:59 +00:00
94de01a06f
xftp: use SHA256 digest for file chunks to reduce file description size ( #666 )
...
* xftp: use SHA256 digest for file chunks to reduce file description size
* enable all tests
2023-03-01 14:36:55 +00:00
faec32dc5e
xftp: constrain supported file size to 1gb
2023-03-01 13:50:08 +00:00
6227215c3f
xftp: remove file description that cannot be used ( #665 )
...
* xftp: remove file description that cannot be used
* show sender file description first
* change order
Co-authored-by: spaced4ndy <8711996+spaced4ndy@users.noreply.github.com >
---------
Co-authored-by: spaced4ndy <8711996+spaced4ndy@users.noreply.github.com >
2023-03-01 13:08:59 +00:00
3d3eb335e8
xftp: download timeout, reconnect CLI on timeouts, verbose logging ( #664 )
...
* xftp: download timeout, reconnect CLI on timeouts, verbose logging
* typo
Co-authored-by: spaced4ndy <8711996+spaced4ndy@users.noreply.github.com >
---------
Co-authored-by: spaced4ndy <8711996+spaced4ndy@users.noreply.github.com >
2023-03-01 07:47:27 +00:00
453e18c4ad
Correct minor Docker syntax error ( #662 )
...
Noticed that the environment variables for SMP server when using Docker were improperly quoted, so I corrected them.
This will fix an issue with server address being displayed incorrectly in the CLI when viewing init logs.
I also explicitly added the `:latest` tag for the Docker image in the Running example to make it more clear which tag is being run (no tag defaults to `latest`.)
2023-03-01 07:45:18 +00:00
249bcc7bb3
update cGet to not throw exception if returned string is shorter (trying to fix HTTP2), fix test ( #663 )
2023-02-28 19:16:35 +00:00
4afb72070a
v5.0.0-beta.2
2023-02-28 09:02:05 +00:00
524c1de4de
xftp: server stats ( #661 )
2023-02-28 08:59:28 +00:00
875a4bac5e
xftp cli: use 3 chunk sizes (256kb, 1mb, 4mb) ( #660 )
...
* xftp cli: use 3 chunk sizes (256kb, 1mb, 4mb)
* hardcode default servers
* disable rand command
* hide rand command instead of removing
2023-02-27 21:15:22 +00:00
f02cb2da4c
5.0.0-beta.1
2023-02-27 18:04:00 +00:00
2f15ce2662
xftp: add quota param to server CLI, restrict chunk sizes ( #659 )
...
* xftp: add quota param to server CLI
* only allow certain file sizes, fix tests
2023-02-27 18:01:18 +00:00
781f8e0000
xftp: increase timeouts for file uploads, show progress ( #658 )
...
* xftp: increase timeouts for file uploads, show progress
* refactor
* use default port 443
* typo
Co-authored-by: spaced4ndy <8711996+spaced4ndy@users.noreply.github.com >
* upload/download to/from chosen servers concurrently
---------
Co-authored-by: spaced4ndy <8711996+spaced4ndy@users.noreply.github.com >
2023-02-27 13:42:15 +00:00
c3872f0a55
5.0.0-beta.0
2023-02-25 19:52:33 +00:00
3e9e144145
ci: add xftp server ( #657 )
...
* ci: add xftp server
* add xftp
2023-02-25 19:51:33 +00:00
50c9c95287
Merge branch 'master' into xftp
2023-02-25 18:36:48 +00:00
spaced4ndy