spaced4ndy
2bec353eae
xftp: add command to delete rcv file; agent manages save path ( #692 )
2023-03-20 20:08:38 +04:00
Evgeny Poberezkin
40da7e76dd
import stateTVar
2023-03-18 13:57:17 +00:00
Evgeny Poberezkin
2e02ba86fd
add stateTVar import
2023-03-18 13:38:20 +00:00
Evgeny Poberezkin
02eb1e9822
add stateTVar imports for compatibility with older hackage index in nix builds
2023-03-18 07:57:25 +00:00
Evgeny Poberezkin
cd48c33c0d
Merge branch 'master' into xftp
2023-03-17 13:30:52 +00:00
Evgeny Poberezkin
5258fe9b7e
add sha512 ( #691 )
...
* add sha512
* update export title
2023-03-17 13:01:49 +00:00
Evgeny Poberezkin
e33d5b5184
use different constraint for non-error functions ( #690 )
2023-03-17 16:01:24 +04:00
spaced4ndy
2b1a02d7d4
xftp: reconnect XFTP client on replica retry ( #689 )
...
* xftp: re-create XFTP client on replica retry
* closeXFTPSessionClient
* refactor
---------
Co-authored-by: Evgeny Poberezkin <2769109+epoberezkin@users.noreply.github.com >
2023-03-17 09:50:49 +00:00
spaced4ndy
9255d48b69
xftp: move delay to replica ( #688 )
2023-03-16 18:12:38 +04:00
Evgeny Poberezkin
bab689099f
xftp: streaming file encryption/decryption to avoid memory spikes ( #687 )
...
* xftp: streaming file decryption to avoid memory spikes
* refactor, enable tests
* streaming encryption
* refactor
2023-03-16 13:57:21 +00:00
Evgeny Poberezkin
a0eb53b891
xftp: use agent servers in experimental send, refactor decryption ( #686 )
...
* xftp: use agent servers in experimental send, refactor decryption
* fix/enable xftp send test test
* allow any order
2023-03-14 22:56:19 +00:00
spaced4ndy
db120b6d2e
xftp: pass save path to agent ( #685 )
2023-03-14 19:16:25 +04:00
+shyfire131
64f5d63d2e
Support for building ARM docker images ( #679 )
...
* add llvm to build stage
running docker build on Apple Sillicon would result in this error:
#14 49.39 <no location info>: error:
#14 49.39 Warning: Couldn't figure out LLVM version!
#14 49.39 Make sure you have installed LLVM between [9 and 13)
I assume it can’t find llvm/clang?
* install using unattended helper script
the current haskell is hardcoded to x86, so switch to using haskell’s official helper script which supports arm
also need to bump up setting the path, since ghcup is no longer in /usr/bin
reference: https://www.haskell.org/ghcup/guide/#continuous-integration
* add numa headers/libs
docker build (specifically haskell install step) would fail with :
#7 107.2 utils/ghc-cabal/dist-install/build/tmp/ghc-cabal: error while loading shared libraries: libnuma.so.1: cannot open shared object file: No such file or directory
I think this is because numa isn’t installed on arm instances of focal by default, but it is in later versions
anyway this fixes that
* also add numa to final
The image builds at this point! But it fails to boot on arm - again with a numa error.
This fixes that.
* don’t specify llvm version
---------
Co-authored-by: +shyfire131 <shyfire131@shyfire131.net >
2023-03-13 20:00:34 +00:00
Evgeny Poberezkin
ddc2da8fe4
xftp: agent API for xftp commands and events ( #684 )
...
* xftp: agent API for xftp commands and events
* fix tests
* fix tests 2
* xftp: update agent send api
* update API to make temp path optional
* revert tmp path changes (fixes send)
---------
Co-authored-by: spacedandy <8711996+spaced4ndy@users.noreply.github.com >
2023-03-13 09:04:23 +00:00
Evgeny Poberezkin
3fe1f3c822
rename FileParty constructors
2023-03-11 10:05:07 +00:00
Evgeny Poberezkin
448b674fb1
5.0.0-beta.5
2023-03-10 17:37:38 +00:00
spaced4ndy
cf1cd75a15
xftp: fix experimental send api description paths ( #683 )
2023-03-10 21:06:09 +04:00
Evgeny Poberezkin
40164ff21f
update http2 to 4.1 ( #680 )
2023-03-10 16:59:26 +00:00
spaced4ndy
c1266d55a4
xftp: experimental send api wip ( #682 )
2023-03-10 20:43:10 +04:00
spaced4ndy
cf8f78f518
xftp: add random bytestring entity id for rcv files ( #681 )
2023-03-10 20:32:37 +04:00
Evgeny Poberezkin
accfee5a52
5.0.0-beta.4
2023-03-10 10:32:05 +00:00
spaced4ndy
cc2066473c
xftp: cleanup complete & error files tmp paths; remove save path before decrypting if exists ( #677 )
2023-03-10 14:26:34 +04:00
Evgeny Poberezkin
8fde8e1344
xftp: agent command entities ( #676 )
...
* xftp: agent command entities
* progress event
* parameterize agent command by entity
* refactor
* Eq instance for APartyCmdTag
2023-03-10 09:10:52 +00:00
spaced4ndy
deec963de8
xftp: agent error handling ( #675 )
...
- chunk download doesn't loop on permanent errors
- decryption errors are considered permanent - local worker doesn't retry
- update replica retries; to do - consider use for this field, or remove it
- rcv file Error status - to prevent repeat reads of chunks for download, files for decryption; also plan to use it for filtering on cleanup
- error string saved in separate field for debugging (not part of status type)
- agent event for rcv file errors
2023-03-09 15:32:17 +04:00
Evgeny Poberezkin
552759018e
xftp: server types for any protocol ( #672 )
2023-03-09 09:54:31 +00:00
spaced4ndy
6d52150672
xftp: agent send file design wip ( #674 )
2023-03-08 14:30:37 +04:00
spaced4ndy
e9f949f117
xftp: resume file reception and decryption on agent restart ( #673 )
2023-03-07 13:29:28 +04:00
spaced4ndy
a0c86158d9
xftp agent: update chunk delay ( #671 )
2023-03-03 20:39:15 +04:00
spacedandy
cc38deb65d
Merge branch 'master' into xftp
2023-03-03 19:16:12 +04:00
spaced4ndy
cf147397a4
xftp: agent receive file ( #637 )
...
* xftp: agent receive file draft
* receiveFile more stubs, changes to types, schema
* cabal file
* comments
* xftp_server_id
* schema changes, get client, local worker/action
* agent env, save file description, adjust schema
* client stubs
* download chunk wip, store, schema, types
* remove commented code
* read file description, schema, types
* check received, decrypt
* remove pure
* todo
* add XFTP to agent client
* add user id
* agent test
* tests
* rename supervisor into agent
---------
Co-authored-by: Evgeny Poberezkin <2769109+epoberezkin@users.noreply.github.com >
2023-03-03 18:50:16 +04:00
Evgeny Poberezkin
2f7c115207
retryInterval functions pass current interval to the action, to resume with the same interval on restart (improve battery consumption) ( #670 )
2023-03-03 14:12:36 +00:00
Evgeny Poberezkin
6ed4dd1515
update http2 library
2023-03-03 11:00:10 +00:00
Evgeny Poberezkin
914240108d
xftp: update http2 to remove workarounds with padding and delay ( #667 )
2023-03-02 16:00:46 +00:00
Evgeny Poberezkin
e764a51fc0
v5.0.0-beta.3
2023-03-01 14:37:59 +00:00
Evgeny Poberezkin
94de01a06f
xftp: use SHA256 digest for file chunks to reduce file description size ( #666 )
...
* xftp: use SHA256 digest for file chunks to reduce file description size
* enable all tests
2023-03-01 14:36:55 +00:00
Evgeny Poberezkin
faec32dc5e
xftp: constrain supported file size to 1gb
2023-03-01 13:50:08 +00:00
Evgeny Poberezkin
6227215c3f
xftp: remove file description that cannot be used ( #665 )
...
* xftp: remove file description that cannot be used
* show sender file description first
* change order
Co-authored-by: spaced4ndy <8711996+spaced4ndy@users.noreply.github.com >
---------
Co-authored-by: spaced4ndy <8711996+spaced4ndy@users.noreply.github.com >
2023-03-01 13:08:59 +00:00
Evgeny Poberezkin
3d3eb335e8
xftp: download timeout, reconnect CLI on timeouts, verbose logging ( #664 )
...
* xftp: download timeout, reconnect CLI on timeouts, verbose logging
* typo
Co-authored-by: spaced4ndy <8711996+spaced4ndy@users.noreply.github.com >
---------
Co-authored-by: spaced4ndy <8711996+spaced4ndy@users.noreply.github.com >
2023-03-01 07:47:27 +00:00
Seth For Privacy
453e18c4ad
Correct minor Docker syntax error ( #662 )
...
Noticed that the environment variables for SMP server when using Docker were improperly quoted, so I corrected them.
This will fix an issue with server address being displayed incorrectly in the CLI when viewing init logs.
I also explicitly added the `:latest` tag for the Docker image in the Running example to make it more clear which tag is being run (no tag defaults to `latest`.)
2023-03-01 07:45:18 +00:00
Evgeny Poberezkin
249bcc7bb3
update cGet to not throw exception if returned string is shorter (trying to fix HTTP2), fix test ( #663 )
2023-02-28 19:16:35 +00:00
Evgeny Poberezkin
4afb72070a
v5.0.0-beta.2
2023-02-28 09:02:05 +00:00
Evgeny Poberezkin
524c1de4de
xftp: server stats ( #661 )
2023-02-28 08:59:28 +00:00
Evgeny Poberezkin
875a4bac5e
xftp cli: use 3 chunk sizes (256kb, 1mb, 4mb) ( #660 )
...
* xftp cli: use 3 chunk sizes (256kb, 1mb, 4mb)
* hardcode default servers
* disable rand command
* hide rand command instead of removing
2023-02-27 21:15:22 +00:00
Evgeny Poberezkin
f02cb2da4c
5.0.0-beta.1
2023-02-27 18:04:00 +00:00
Evgeny Poberezkin
2f15ce2662
xftp: add quota param to server CLI, restrict chunk sizes ( #659 )
...
* xftp: add quota param to server CLI
* only allow certain file sizes, fix tests
2023-02-27 18:01:18 +00:00
Evgeny Poberezkin
781f8e0000
xftp: increase timeouts for file uploads, show progress ( #658 )
...
* xftp: increase timeouts for file uploads, show progress
* refactor
* use default port 443
* typo
Co-authored-by: spaced4ndy <8711996+spaced4ndy@users.noreply.github.com >
* upload/download to/from chosen servers concurrently
---------
Co-authored-by: spaced4ndy <8711996+spaced4ndy@users.noreply.github.com >
2023-02-27 13:42:15 +00:00
Evgeny Poberezkin
c3872f0a55
5.0.0-beta.0
2023-02-25 19:52:33 +00:00
Evgeny Poberezkin
3e9e144145
ci: add xftp server ( #657 )
...
* ci: add xftp server
* add xftp
2023-02-25 19:51:33 +00:00
Evgeny Poberezkin
50c9c95287
Merge branch 'master' into xftp
2023-02-25 18:36:48 +00:00
spaced4ndy
1b4b184517
xftp: server - retry on duplicate ids ( #655 )
...
* xftp: server - retry on duplicate ids (with commented monad code)
* remove commented code, refactor
* replace traverse with mapM
* refactor
* refactor
* refactor
* refactor
* refactor
---------
Co-authored-by: Evgeny Poberezkin <2769109+epoberezkin@users.noreply.github.com >
2023-02-25 17:55:58 +00:00
