dandri/simplexmq
1
0
Fork 0
mirror of https://github.com/simplex-chat/simplexmq.git synced 2026-05-10 19:16:57 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
fd298ae3280fdc18924aa0b23ec8e2eadeef0e95
simplexmq/tests/manual/xftp-server-testing.md
T
sh 1e1f897c79 core: use = as INI key-value separator (#1767) 
* core: use = as INI key-value separator

* core: update docker entrypoints for = INI separator

* core: update INI separator in README and test scripts
2026-04-20 09:22:14 +01:00

44 KiB
Raw Blame History

XFTP Server Manual Testing Guide

Manual testing of the XFTP server with memory (STM) and PostgreSQL backends, including migration between them, blocking, auth, quota, control port, and edge cases.

All paths are self-contained under ./xftp-test/. The automated version of this guide is xftp-test.py (143 checks). This guide mirrors the script 1:1.

Prerequisites

See tests/manual/README.md for PostgreSQL setup. After setup, in the shell running this guide:

cabal build -fserver_postgres exe:xftp-server exe:xftp

export XFTP_SERVER=$(cabal list-bin exe:xftp-server)
export XFTP=$(cabal list-bin exe:xftp)
export TEST_DIR=$(pwd)/xftp-test
export XFTP_SERVER_CFG_PATH=$TEST_DIR/etc
export XFTP_SERVER_LOG_PATH=$TEST_DIR/var
export PGHOST=/tmp/pgsocket

PostgreSQL roles postgres and xftp (both SUPERUSER) must exist — see the README.

Helper functions for editing the INI config:

ini_set() { sed -i "s|^${1}:.*|${1}: ${2}|" $XFTP_SERVER_CFG_PATH/file-server.ini; }
ini_uncomment() { sed -i "s|^# ${1} =|${1} =|" $XFTP_SERVER_CFG_PATH/file-server.ini; }
ini_comment() { sed -i "s|^${1} =|# ${1} =|" $XFTP_SERVER_CFG_PATH/file-server.ini; }

enable_control_port() {
  sed -i 's/^# control_port = 5226/control_port = 15230/' $XFTP_SERVER_CFG_PATH/file-server.ini
  sed -i 's/^# control_port_admin_password =.*/control_port_admin_password = testadmin/' $XFTP_SERVER_CFG_PATH/file-server.ini
}

# Extract recipient IDs from a file description (chunk format: "- N:rcvId:privKey:digest")
get_recipient_ids() {
  grep '^ *- [0-9]' "$1" | cut -d: -f2
}

# Send a command to the control port as admin and print the response
control_cmd() {
  python3 -c "
import socket, time
s = socket.create_connection(('127.0.0.1', 15230), timeout=5)
s.settimeout(2)
# Drain welcome
time.sleep(0.3)
s.recv(4096)
s.sendall(b'auth testadmin\n')
time.sleep(0.3); s.recv(4096)
s.sendall(b'$1\n')
time.sleep(0.3)
print(s.recv(4096).decode().strip())
s.sendall(b'quit\n'); s.close()
"
}

Important notes

  • -y on recv auto-confirms, ACKs chunks on the server, and deletes the descriptor file.
  • -y on del auto-confirms and deletes the sender descriptor.
  • database import and database export prompt for confirmation. Answer uppercase Y.
  • Server defaults to port 443 (requires root). All tests use port 7921.
  • init does not create the store log file. It is created on first server start with enable: on.
  • --confirm-migrations up auto-confirms PG schema migrations.
  • With store_files: database, the PG schema must already exist — create manually or use database import which creates it automatically.

1. Basic send/receive (memory backend)

1.1 Initialize and start server

rm -rf $TEST_DIR
mkdir -p $TEST_DIR/{files,descriptions,received}

$XFTP_SERVER init -p $TEST_DIR/files -q 10gb --ip 127.0.0.1
ini_set port 7921

FP=$(cat $XFTP_SERVER_CFG_PATH/fingerprint)
SRV="xftp://$FP@127.0.0.1:7921"

$XFTP_SERVER start &
SERVER_PID=$!
sleep 2

1.2 Send a file with 2 recipients

dd if=/dev/urandom of=$TEST_DIR/testfile.bin bs=1M count=5 2>/dev/null

$XFTP send $TEST_DIR/testfile.bin $TEST_DIR/descriptions -s "$SRV" -n 2 -v

ls $TEST_DIR/descriptions/testfile.bin.xftp/
# Expected: rcv1.xftp  rcv2.xftp  snd.xftp.private

1.3 Receive the file (recipient 1)

$XFTP recv $TEST_DIR/descriptions/testfile.bin.xftp/rcv1.xftp $TEST_DIR/received -y -v
diff $TEST_DIR/testfile.bin $TEST_DIR/received/testfile.bin
# Expected: no output

ls $TEST_DIR/descriptions/testfile.bin.xftp/rcv1.xftp 2>&1
# Expected: No such file or directory (deleted by -y)

1.4 Receive the file (recipient 2)

rm -f $TEST_DIR/received/testfile.bin

$XFTP recv $TEST_DIR/descriptions/testfile.bin.xftp/rcv2.xftp $TEST_DIR/received -y -v
diff $TEST_DIR/testfile.bin $TEST_DIR/received/testfile.bin

1.5 Delete the file from server

$XFTP del $TEST_DIR/descriptions/testfile.bin.xftp/snd.xftp.private -y -v

ls $TEST_DIR/descriptions/testfile.bin.xftp/snd.xftp.private 2>&1
# Expected: No such file or directory

ls $TEST_DIR/files/ | wc -l
# Expected: 0

1.6 Stop server

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null

2. Basic send/receive (PostgreSQL backend)

2.1 Initialize fresh server for PostgreSQL

rm -rf $TEST_DIR
mkdir -p $TEST_DIR/{files,descriptions,received}
psql -U postgres -c "DROP DATABASE IF EXISTS xftp_server_store;"
psql -U postgres -c "CREATE DATABASE xftp_server_store OWNER xftp;"

$XFTP_SERVER init -p $TEST_DIR/files -q 10gb --ip 127.0.0.1
ini_set port 7921
ini_set store_files database
ini_uncomment db_connection
ini_uncomment db_schema
ini_uncomment db_pool_size

FP=$(cat $XFTP_SERVER_CFG_PATH/fingerprint)
SRV="xftp://$FP@127.0.0.1:7921"

psql -U xftp -d xftp_server_store -c "CREATE SCHEMA IF NOT EXISTS xftp_server;"

2.2 Start server with PostgreSQL

$XFTP_SERVER start --confirm-migrations up &
SERVER_PID=$!
sleep 2

2.3 Send, receive, verify

dd if=/dev/urandom of=$TEST_DIR/testfile.bin bs=1M count=5 2>/dev/null

$XFTP send $TEST_DIR/testfile.bin $TEST_DIR/descriptions -s "$SRV" -n 2 -v
$XFTP recv $TEST_DIR/descriptions/testfile.bin.xftp/rcv1.xftp $TEST_DIR/received -y -v
diff $TEST_DIR/testfile.bin $TEST_DIR/received/testfile.bin

2.4 Verify data is in PostgreSQL

psql -U xftp -d xftp_server_store \
  -c "SET search_path TO xftp_server; SELECT count(*) AS files FROM files;"
# Expected: > 0

psql -U xftp -d xftp_server_store \
  -c "SET search_path TO xftp_server; SELECT count(*) AS recipients FROM recipients;"
# Expected: > 0

2.5 Delete and verify all cleaned up

$XFTP del $TEST_DIR/descriptions/testfile.bin.xftp/snd.xftp.private -y -v

psql -U xftp -d xftp_server_store -c "SET search_path TO xftp_server; SELECT count(*) FROM files;"
# Expected: 0
psql -U xftp -d xftp_server_store -c "SET search_path TO xftp_server; SELECT count(*) FROM recipients;"
# Expected: 0

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null

3. Migration: memory to PostgreSQL

3.1 Start with memory backend, send files

rm -rf $TEST_DIR
mkdir -p $TEST_DIR/{files,descriptions,received}
psql -U postgres -c "DROP DATABASE IF EXISTS xftp_server_store;"
psql -U postgres -c "CREATE DATABASE xftp_server_store OWNER xftp;"

$XFTP_SERVER init -p $TEST_DIR/files -q 10gb --ip 127.0.0.1
ini_set port 7921
FP=$(cat $XFTP_SERVER_CFG_PATH/fingerprint)
SRV="xftp://$FP@127.0.0.1:7921"

$XFTP_SERVER start &
SERVER_PID=$!; sleep 2

dd if=/dev/urandom of=$TEST_DIR/fileA.bin bs=1M count=1 2>/dev/null
$XFTP send $TEST_DIR/fileA.bin $TEST_DIR/descriptions -s "$SRV" -n 2

dd if=/dev/urandom of=$TEST_DIR/fileB.bin bs=1M count=1 2>/dev/null
$XFTP send $TEST_DIR/fileB.bin $TEST_DIR/descriptions -s "$SRV" -n 2

# Partially receive fileB (only rcv1)
$XFTP recv $TEST_DIR/descriptions/fileB.bin.xftp/rcv1.xftp $TEST_DIR/received -y
diff $TEST_DIR/fileB.bin $TEST_DIR/received/fileB.bin

3.2 Stop server and migrate to PostgreSQL

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null; sleep 1

ini_set store_files database
ini_uncomment db_connection
ini_uncomment db_schema
ini_uncomment db_pool_size

echo Y | $XFTP_SERVER database import
# Expected: "Loaded N files, M recipients" / "Imported N files" / "Imported M recipients"
#           "Store log renamed to ...file-server-store.log.bak"

ls $XFTP_SERVER_LOG_PATH/file-server-store.log.bak  # should exist
ls $XFTP_SERVER_LOG_PATH/file-server-store.log 2>&1  # should NOT exist

psql -U xftp -d xftp_server_store <<'SQL'
SET search_path TO xftp_server;
SELECT count(*) AS file_count FROM files;
SELECT count(*) AS recipient_count FROM recipients;
SQL

3.3 Start server with PostgreSQL and receive remaining files

$XFTP_SERVER start --confirm-migrations up &
SERVER_PID=$!; sleep 2

$XFTP recv $TEST_DIR/descriptions/fileA.bin.xftp/rcv1.xftp $TEST_DIR/received -y
diff $TEST_DIR/fileA.bin $TEST_DIR/received/fileA.bin

$XFTP recv $TEST_DIR/descriptions/fileA.bin.xftp/rcv2.xftp $TEST_DIR/received -y

rm -f $TEST_DIR/received/fileB.bin
$XFTP recv $TEST_DIR/descriptions/fileB.bin.xftp/rcv2.xftp $TEST_DIR/received -y
diff $TEST_DIR/fileB.bin $TEST_DIR/received/fileB.bin

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null

4. Migration: PostgreSQL back to memory

Continues from section 3 state.

4.1 Export from PostgreSQL

echo Y | $XFTP_SERVER database export
ls $XFTP_SERVER_LOG_PATH/file-server-store.log  # should exist
head -5 $XFTP_SERVER_LOG_PATH/file-server-store.log
# Should contain FNEW, FADD, FPUT entries

4.2 Switch back to memory and start

ini_set store_files memory
ini_comment db_connection
ini_comment db_schema
ini_comment db_pool_size

$XFTP_SERVER start &
SERVER_PID=$!; sleep 2

4.3 Verify deletes work on round-trip data

$XFTP del $TEST_DIR/descriptions/fileA.bin.xftp/snd.xftp.private -y
$XFTP del $TEST_DIR/descriptions/fileB.bin.xftp/snd.xftp.private -y

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null

4b. Send on PostgreSQL, export, receive on memory

4b.1 Start PG server and send a file

rm -rf $TEST_DIR
mkdir -p $TEST_DIR/{files,descriptions,received}
psql -U postgres -c "DROP DATABASE IF EXISTS xftp_server_store;"
psql -U postgres -c "CREATE DATABASE xftp_server_store OWNER xftp;"

$XFTP_SERVER init -p $TEST_DIR/files -q 10gb --ip 127.0.0.1
ini_set port 7921
ini_set store_files database
ini_uncomment db_connection
ini_uncomment db_schema
ini_uncomment db_pool_size
FP=$(cat $XFTP_SERVER_CFG_PATH/fingerprint)
SRV="xftp://$FP@127.0.0.1:7921"

psql -U xftp -d xftp_server_store -c "CREATE SCHEMA IF NOT EXISTS xftp_server;"

$XFTP_SERVER start --confirm-migrations up &
SERVER_PID=$!; sleep 2

dd if=/dev/urandom of=$TEST_DIR/pgfileA.bin bs=1M count=1 2>/dev/null
$XFTP send $TEST_DIR/pgfileA.bin $TEST_DIR/descriptions -s "$SRV" -n 2

# Receive rcv1 on PG
$XFTP recv $TEST_DIR/descriptions/pgfileA.bin.xftp/rcv1.xftp $TEST_DIR/received -y
diff $TEST_DIR/pgfileA.bin $TEST_DIR/received/pgfileA.bin

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null; sleep 1

4b.2 Export and switch to memory

echo Y | $XFTP_SERVER database export

ini_set store_files memory
ini_comment db_connection
ini_comment db_schema
ini_comment db_pool_size

$XFTP_SERVER start &
SERVER_PID=$!; sleep 2

4b.3 Receive remaining file on memory backend

rm -f $TEST_DIR/received/pgfileA.bin
$XFTP recv $TEST_DIR/descriptions/pgfileA.bin.xftp/rcv2.xftp $TEST_DIR/received -y
diff $TEST_DIR/pgfileA.bin $TEST_DIR/received/pgfileA.bin

$XFTP del $TEST_DIR/descriptions/pgfileA.bin.xftp/snd.xftp.private -y

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null

5. Server restart persistence

5.1 Memory backend with store log

rm -rf $TEST_DIR
mkdir -p $TEST_DIR/{files,descriptions,received}
$XFTP_SERVER init -p $TEST_DIR/files -q 10gb --ip 127.0.0.1
ini_set port 7921
FP=$(cat $XFTP_SERVER_CFG_PATH/fingerprint)
SRV="xftp://$FP@127.0.0.1:7921"

$XFTP_SERVER start &
SERVER_PID=$!; sleep 2

dd if=/dev/urandom of=$TEST_DIR/persist.bin bs=1M count=1 2>/dev/null
$XFTP send $TEST_DIR/persist.bin $TEST_DIR/descriptions -s "$SRV" -n 1

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null; sleep 1

$XFTP_SERVER start &
SERVER_PID=$!; sleep 2

$XFTP recv $TEST_DIR/descriptions/persist.bin.xftp/rcv1.xftp $TEST_DIR/received -y
diff $TEST_DIR/persist.bin $TEST_DIR/received/persist.bin

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null

5.2 Memory backend WITHOUT store log

rm -rf $TEST_DIR/descriptions/* $TEST_DIR/received/*
ini_set enable off

$XFTP_SERVER start &
SERVER_PID=$!; sleep 2

dd if=/dev/urandom of=$TEST_DIR/persist2.bin bs=1M count=1 2>/dev/null
$XFTP send $TEST_DIR/persist2.bin $TEST_DIR/descriptions -s "$SRV" -n 1

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null; sleep 1

$XFTP_SERVER start &
SERVER_PID=$!; sleep 2

$XFTP recv $TEST_DIR/descriptions/persist2.bin.xftp/rcv1.xftp $TEST_DIR/received -y 2>&1
# Expected: CLIError "PCEProtocolError AUTH"

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null

5.3 PostgreSQL backend

rm -rf $TEST_DIR
mkdir -p $TEST_DIR/{files,descriptions,received}
psql -U postgres -c "DROP DATABASE IF EXISTS xftp_server_store;"
psql -U postgres -c "CREATE DATABASE xftp_server_store OWNER xftp;"

$XFTP_SERVER init -p $TEST_DIR/files -q 10gb --ip 127.0.0.1
ini_set port 7921
ini_set store_files database
ini_uncomment db_connection
ini_uncomment db_schema
ini_uncomment db_pool_size
FP=$(cat $XFTP_SERVER_CFG_PATH/fingerprint)
SRV="xftp://$FP@127.0.0.1:7921"

psql -U xftp -d xftp_server_store -c "CREATE SCHEMA IF NOT EXISTS xftp_server;"

$XFTP_SERVER start --confirm-migrations up &
SERVER_PID=$!; sleep 2

dd if=/dev/urandom of=$TEST_DIR/persist.bin bs=1M count=1 2>/dev/null
$XFTP send $TEST_DIR/persist.bin $TEST_DIR/descriptions -s "$SRV" -n 1

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null; sleep 1

$XFTP_SERVER start --confirm-migrations up &
SERVER_PID=$!; sleep 2

$XFTP recv $TEST_DIR/descriptions/persist.bin.xftp/rcv1.xftp $TEST_DIR/received -y
diff $TEST_DIR/persist.bin $TEST_DIR/received/persist.bin

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null

6. Edge cases

6.1 Receive after server-side delete

rm -rf $TEST_DIR
mkdir -p $TEST_DIR/{files,descriptions,received}
$XFTP_SERVER init -p $TEST_DIR/files -q 10gb --ip 127.0.0.1
ini_set port 7921
FP=$(cat $XFTP_SERVER_CFG_PATH/fingerprint)
SRV="xftp://$FP@127.0.0.1:7921"

$XFTP_SERVER start &
SERVER_PID=$!; sleep 2

dd if=/dev/urandom of=$TEST_DIR/deltest.bin bs=1M count=1 2>/dev/null
$XFTP send $TEST_DIR/deltest.bin $TEST_DIR/descriptions -s "$SRV" -n 2

$XFTP del $TEST_DIR/descriptions/deltest.bin.xftp/snd.xftp.private -y

$XFTP recv $TEST_DIR/descriptions/deltest.bin.xftp/rcv2.xftp $TEST_DIR/received -y 2>&1
# Expected: AUTH error

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null

6.2 Multiple recipients and partial acknowledgment

rm -rf $TEST_DIR
mkdir -p $TEST_DIR/{files,descriptions,received}
$XFTP_SERVER init -p $TEST_DIR/files -q 10gb --ip 127.0.0.1
ini_set port 7921
FP=$(cat $XFTP_SERVER_CFG_PATH/fingerprint)
SRV="xftp://$FP@127.0.0.1:7921"

$XFTP_SERVER start &
SERVER_PID=$!; sleep 2

dd if=/dev/urandom of=$TEST_DIR/multi.bin bs=1M count=1 2>/dev/null
$XFTP send $TEST_DIR/multi.bin $TEST_DIR/descriptions -s "$SRV" -n 3

$XFTP recv $TEST_DIR/descriptions/multi.bin.xftp/rcv1.xftp $TEST_DIR/received -y
diff $TEST_DIR/multi.bin $TEST_DIR/received/multi.bin

rm -f $TEST_DIR/received/multi.bin
$XFTP recv $TEST_DIR/descriptions/multi.bin.xftp/rcv2.xftp $TEST_DIR/received -y
diff $TEST_DIR/multi.bin $TEST_DIR/received/multi.bin

rm -f $TEST_DIR/received/multi.bin
$XFTP recv $TEST_DIR/descriptions/multi.bin.xftp/rcv3.xftp $TEST_DIR/received -y
diff $TEST_DIR/multi.bin $TEST_DIR/received/multi.bin

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null

6.3 Switching to database mode with existing store log (should fail)

rm -rf $TEST_DIR
mkdir -p $TEST_DIR/{files,descriptions,received}
psql -U postgres -c "DROP DATABASE IF EXISTS xftp_server_store;"
psql -U postgres -c "CREATE DATABASE xftp_server_store OWNER xftp;"

$XFTP_SERVER init -p $TEST_DIR/files -q 10gb --ip 127.0.0.1
ini_set port 7921
FP=$(cat $XFTP_SERVER_CFG_PATH/fingerprint)
SRV="xftp://$FP@127.0.0.1:7921"

# Run memory mode to create a store log
$XFTP_SERVER start &
SERVER_PID=$!; sleep 2
dd if=/dev/urandom of=$TEST_DIR/dummy.bin bs=1M count=1 2>/dev/null
$XFTP send $TEST_DIR/dummy.bin $TEST_DIR/descriptions -s "$SRV" -n 1
kill $SERVER_PID; wait $SERVER_PID 2>/dev/null; sleep 1

ls $XFTP_SERVER_LOG_PATH/file-server-store.log  # should exist

# Switch to DB mode without importing
ini_set store_files database
ini_uncomment db_connection
ini_uncomment db_schema
ini_uncomment db_pool_size
psql -U xftp -d xftp_server_store -c "CREATE SCHEMA IF NOT EXISTS xftp_server;"

$XFTP_SERVER start --confirm-migrations up 2>&1
# Expected error:
# Error: store log file .../file-server-store.log exists but store_files is `database`.
# Use `file-server database import` to migrate, or set `db_store_log: on`.

6.4 Database mode without schema (should fail)

rm -rf $TEST_DIR
mkdir -p $TEST_DIR/{files,descriptions,received}
psql -U postgres -c "DROP DATABASE IF EXISTS xftp_server_store;"
psql -U postgres -c "CREATE DATABASE xftp_server_store OWNER xftp;"

$XFTP_SERVER init -p $TEST_DIR/files -q 10gb --ip 127.0.0.1
ini_set port 7921
ini_set store_files database
ini_uncomment db_connection
ini_uncomment db_schema
ini_uncomment db_pool_size

# Do NOT create the schema
$XFTP_SERVER start --confirm-migrations up 2>&1
# Expected error:
# connectPostgresStore, schema xftp_server does not exist, exiting.

6.5 Dual-write mode: database + db_store_log: on

Verifies that writes in dual-write mode land in BOTH the DB and the store log.

rm -rf $TEST_DIR
mkdir -p $TEST_DIR/{files,descriptions,received}
psql -U postgres -c "DROP DATABASE IF EXISTS xftp_server_store;"
psql -U postgres -c "CREATE DATABASE xftp_server_store OWNER xftp;"

$XFTP_SERVER init -p $TEST_DIR/files -q 10gb --ip 127.0.0.1
ini_set port 7921
ini_set store_files database
ini_uncomment db_connection
ini_uncomment db_schema
ini_uncomment db_pool_size
ini_uncomment db_store_log
ini_set db_store_log on
psql -U xftp -d xftp_server_store -c "CREATE SCHEMA IF NOT EXISTS xftp_server;"
rm -f $XFTP_SERVER_LOG_PATH/file-server-store.log

FP=$(cat $XFTP_SERVER_CFG_PATH/fingerprint)
SRV="xftp://$FP@127.0.0.1:7921"

$XFTP_SERVER start --confirm-migrations up &
SERVER_PID=$!; sleep 2

# Send a new file in dual-write mode
dd if=/dev/urandom of=$TEST_DIR/dual.bin bs=1M count=1 2>/dev/null
$XFTP send $TEST_DIR/dual.bin $TEST_DIR/descriptions -s "$SRV" -n 1

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null; sleep 1

# Both the store log AND the DB must have entries
ls -la $XFTP_SERVER_LOG_PATH/file-server-store.log  # size > 0
psql -U xftp -d xftp_server_store -c "SET search_path TO xftp_server; SELECT count(*) FROM files;"
# Expected: > 0

# Now switch to memory-only and verify the file is accessible (proves store log has valid data)
ini_set store_files memory
ini_comment db_connection
ini_comment db_schema
ini_comment db_pool_size
ini_comment db_store_log

$XFTP_SERVER start &
SERVER_PID=$!; sleep 2

$XFTP recv $TEST_DIR/descriptions/dual.bin.xftp/rcv1.xftp $TEST_DIR/received -y
diff $TEST_DIR/dual.bin $TEST_DIR/received/dual.bin
echo "Dual-write mode verified: same file accessible from DB and from store log"

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null

6.6 Import to non-empty database (should fail)

rm -rf $TEST_DIR
mkdir -p $TEST_DIR/{files,descriptions,received}
psql -U postgres -c "DROP DATABASE IF EXISTS xftp_server_store;"
psql -U postgres -c "CREATE DATABASE xftp_server_store OWNER xftp;"

$XFTP_SERVER init -p $TEST_DIR/files -q 10gb --ip 127.0.0.1
ini_set port 7921
ini_set store_files database
ini_uncomment db_connection
ini_uncomment db_schema
ini_uncomment db_pool_size
FP=$(cat $XFTP_SERVER_CFG_PATH/fingerprint)
SRV="xftp://$FP@127.0.0.1:7921"

psql -U xftp -d xftp_server_store -c "CREATE SCHEMA IF NOT EXISTS xftp_server;"
rm -f $XFTP_SERVER_LOG_PATH/file-server-store.log

$XFTP_SERVER start --confirm-migrations up &
SERVER_PID=$!; sleep 2

dd if=/dev/urandom of=$TEST_DIR/dummy.bin bs=1M count=1 2>/dev/null
$XFTP send $TEST_DIR/dummy.bin $TEST_DIR/descriptions -s "$SRV" -n 1
kill $SERVER_PID; wait $SERVER_PID 2>/dev/null

# Export produces a real valid store log, then re-import into non-empty DB
echo Y | $XFTP_SERVER database export
echo Y | $XFTP_SERVER database import 2>&1
# Expected: import fails because DB is not empty

6.7 Import without store log file (should fail)

rm -rf $TEST_DIR
mkdir -p $TEST_DIR/{files,descriptions,received}
$XFTP_SERVER init -p $TEST_DIR/files -q 10gb --ip 127.0.0.1
ini_set store_files database
ini_uncomment db_connection
ini_uncomment db_schema
ini_uncomment db_pool_size

rm -f $XFTP_SERVER_LOG_PATH/file-server-store.log

echo Y | $XFTP_SERVER database import 2>&1
# Expected: Error: store log file ... does not exist.

6.8 Export when store log already exists (should fail)

rm -rf $TEST_DIR
mkdir -p $TEST_DIR/{files,descriptions,received}
psql -U postgres -c "DROP DATABASE IF EXISTS xftp_server_store;"
psql -U postgres -c "CREATE DATABASE xftp_server_store OWNER xftp;"

$XFTP_SERVER init -p $TEST_DIR/files -q 10gb --ip 127.0.0.1
ini_set port 7921
ini_set store_files database
ini_uncomment db_connection
ini_uncomment db_schema
ini_uncomment db_pool_size
FP=$(cat $XFTP_SERVER_CFG_PATH/fingerprint)
SRV="xftp://$FP@127.0.0.1:7921"

psql -U xftp -d xftp_server_store -c "CREATE SCHEMA IF NOT EXISTS xftp_server;"
rm -f $XFTP_SERVER_LOG_PATH/file-server-store.log

$XFTP_SERVER start --confirm-migrations up &
SERVER_PID=$!; sleep 2

dd if=/dev/urandom of=$TEST_DIR/exp.bin bs=1M count=1 2>/dev/null
$XFTP send $TEST_DIR/exp.bin $TEST_DIR/descriptions -s "$SRV" -n 1
kill $SERVER_PID; wait $SERVER_PID 2>/dev/null

echo "existing" > $XFTP_SERVER_LOG_PATH/file-server-store.log
echo Y | $XFTP_SERVER database export 2>&1
# Expected: Error: store log file ... already exists.

7. File blocking via control port

7.1 Block a file, verify receive fails

rm -rf $TEST_DIR
mkdir -p $TEST_DIR/{files,descriptions,received}
$XFTP_SERVER init -p $TEST_DIR/files -q 10gb --ip 127.0.0.1
ini_set port 7921
enable_control_port
FP=$(cat $XFTP_SERVER_CFG_PATH/fingerprint)
SRV="xftp://$FP@127.0.0.1:7921"

$XFTP_SERVER start &
SERVER_PID=$!; sleep 2

dd if=/dev/urandom of=$TEST_DIR/blockme.bin bs=1M count=1 2>/dev/null
$XFTP send $TEST_DIR/blockme.bin $TEST_DIR/descriptions -s "$SRV" -n 2

# Extract the first recipient ID from the descriptor
RCV_ID=$(get_recipient_ids $TEST_DIR/descriptions/blockme.bin.xftp/rcv1.xftp | head -1)
echo "Blocking recipient ID: $RCV_ID"

control_cmd "block $RCV_ID reason=spam"
# Expected: ok

$XFTP recv $TEST_DIR/descriptions/blockme.bin.xftp/rcv1.xftp $TEST_DIR/received -y 2>&1
# Expected: CLIError "PCEProtocolError (BLOCKED {blockInfo = BlockingInfo {reason = BRSpam, ...}})"

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null

7.2 Blocked file survives memory -> PG migration

rm -rf $TEST_DIR
mkdir -p $TEST_DIR/{files,descriptions,received}
psql -U postgres -c "DROP DATABASE IF EXISTS xftp_server_store;"
psql -U postgres -c "CREATE DATABASE xftp_server_store OWNER xftp;"

$XFTP_SERVER init -p $TEST_DIR/files -q 10gb --ip 127.0.0.1
ini_set port 7921
enable_control_port
FP=$(cat $XFTP_SERVER_CFG_PATH/fingerprint)
SRV="xftp://$FP@127.0.0.1:7921"

$XFTP_SERVER start &
SERVER_PID=$!; sleep 2

dd if=/dev/urandom of=$TEST_DIR/blockmigrate.bin bs=1M count=1 2>/dev/null
$XFTP send $TEST_DIR/blockmigrate.bin $TEST_DIR/descriptions -s "$SRV" -n 2

RCV_ID=$(get_recipient_ids $TEST_DIR/descriptions/blockmigrate.bin.xftp/rcv1.xftp | head -1)
control_cmd "block $RCV_ID reason=content"

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null; sleep 1

# Migrate to PG
ini_set store_files database
ini_uncomment db_connection
ini_uncomment db_schema
ini_uncomment db_pool_size
echo Y | $XFTP_SERVER database import

$XFTP_SERVER start --confirm-migrations up &
SERVER_PID=$!; sleep 2

$XFTP recv $TEST_DIR/descriptions/blockmigrate.bin.xftp/rcv1.xftp $TEST_DIR/received -y 2>&1
# Expected: BLOCKED error

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null

7.3 Blocked file survives PG -> memory export

rm -rf $TEST_DIR
mkdir -p $TEST_DIR/{files,descriptions,received}
psql -U postgres -c "DROP DATABASE IF EXISTS xftp_server_store;"
psql -U postgres -c "CREATE DATABASE xftp_server_store OWNER xftp;"

$XFTP_SERVER init -p $TEST_DIR/files -q 10gb --ip 127.0.0.1
ini_set port 7921
ini_set store_files database
ini_uncomment db_connection
ini_uncomment db_schema
ini_uncomment db_pool_size
enable_control_port
FP=$(cat $XFTP_SERVER_CFG_PATH/fingerprint)
SRV="xftp://$FP@127.0.0.1:7921"

psql -U xftp -d xftp_server_store -c "CREATE SCHEMA IF NOT EXISTS xftp_server;"
rm -f $XFTP_SERVER_LOG_PATH/file-server-store.log

$XFTP_SERVER start --confirm-migrations up &
SERVER_PID=$!; sleep 2

dd if=/dev/urandom of=$TEST_DIR/blockpg.bin bs=1M count=1 2>/dev/null
$XFTP send $TEST_DIR/blockpg.bin $TEST_DIR/descriptions -s "$SRV" -n 2

RCV_ID=$(get_recipient_ids $TEST_DIR/descriptions/blockpg.bin.xftp/rcv1.xftp | head -1)
control_cmd "block $RCV_ID reason=spam"

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null; sleep 1

echo Y | $XFTP_SERVER database export
ini_set store_files memory
ini_comment db_connection
ini_comment db_schema
ini_comment db_pool_size

$XFTP_SERVER start &
SERVER_PID=$!; sleep 2

$XFTP recv $TEST_DIR/descriptions/blockpg.bin.xftp/rcv1.xftp $TEST_DIR/received -y 2>&1
# Expected: BLOCKED error

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null

8. Migration edge cases

8.1 Acked recipient preserved after memory -> PG migration

rm -rf $TEST_DIR
mkdir -p $TEST_DIR/{files,descriptions,received}
psql -U postgres -c "DROP DATABASE IF EXISTS xftp_server_store;"
psql -U postgres -c "CREATE DATABASE xftp_server_store OWNER xftp;"

$XFTP_SERVER init -p $TEST_DIR/files -q 10gb --ip 127.0.0.1
ini_set port 7921
FP=$(cat $XFTP_SERVER_CFG_PATH/fingerprint)
SRV="xftp://$FP@127.0.0.1:7921"

$XFTP_SERVER start &
SERVER_PID=$!; sleep 2

dd if=/dev/urandom of=$TEST_DIR/acktest.bin bs=1M count=1 2>/dev/null
$XFTP send $TEST_DIR/acktest.bin $TEST_DIR/descriptions -s "$SRV" -n 2

# BACKUP rcv1 descriptor before recv (recv -y deletes it)
cp $TEST_DIR/descriptions/acktest.bin.xftp/rcv1.xftp $TEST_DIR/rcv1_backup.xftp

# Recv rcv1 (acks it server-side, deletes descriptor)
$XFTP recv $TEST_DIR/descriptions/acktest.bin.xftp/rcv1.xftp $TEST_DIR/received -y

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null; sleep 1

# Migrate to PG
ini_set store_files database
ini_uncomment db_connection
ini_uncomment db_schema
ini_uncomment db_pool_size
echo Y | $XFTP_SERVER database import

$XFTP_SERVER start --confirm-migrations up &
SERVER_PID=$!; sleep 2

# Acked rcv1 MUST fail (recipient removed by ack, preserved through migration)
$XFTP recv $TEST_DIR/rcv1_backup.xftp $TEST_DIR/received -y 2>&1
# Expected: AUTH error

# Unacked rcv2 MUST work
rm -f $TEST_DIR/received/acktest.bin
$XFTP recv $TEST_DIR/descriptions/acktest.bin.xftp/rcv2.xftp $TEST_DIR/received -y
diff $TEST_DIR/acktest.bin $TEST_DIR/received/acktest.bin

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null

8.2 Acked recipient preserved after PG -> memory export

rm -rf $TEST_DIR
mkdir -p $TEST_DIR/{files,descriptions,received}
psql -U postgres -c "DROP DATABASE IF EXISTS xftp_server_store;"
psql -U postgres -c "CREATE DATABASE xftp_server_store OWNER xftp;"

$XFTP_SERVER init -p $TEST_DIR/files -q 10gb --ip 127.0.0.1
ini_set port 7921
ini_set store_files database
ini_uncomment db_connection
ini_uncomment db_schema
ini_uncomment db_pool_size
FP=$(cat $XFTP_SERVER_CFG_PATH/fingerprint)
SRV="xftp://$FP@127.0.0.1:7921"

psql -U xftp -d xftp_server_store -c "CREATE SCHEMA IF NOT EXISTS xftp_server;"
rm -f $XFTP_SERVER_LOG_PATH/file-server-store.log

$XFTP_SERVER start --confirm-migrations up &
SERVER_PID=$!; sleep 2

dd if=/dev/urandom of=$TEST_DIR/ackpg.bin bs=1M count=1 2>/dev/null
$XFTP send $TEST_DIR/ackpg.bin $TEST_DIR/descriptions -s "$SRV" -n 2

cp $TEST_DIR/descriptions/ackpg.bin.xftp/rcv1.xftp $TEST_DIR/rcv1_backup.xftp
$XFTP recv $TEST_DIR/descriptions/ackpg.bin.xftp/rcv1.xftp $TEST_DIR/received -y

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null; sleep 1

echo Y | $XFTP_SERVER database export

ini_set store_files memory
ini_comment db_connection
ini_comment db_schema
ini_comment db_pool_size

$XFTP_SERVER start &
SERVER_PID=$!; sleep 2

$XFTP recv $TEST_DIR/rcv1_backup.xftp $TEST_DIR/received -y 2>&1
# Expected: AUTH error

rm -f $TEST_DIR/received/ackpg.bin
$XFTP recv $TEST_DIR/descriptions/ackpg.bin.xftp/rcv2.xftp $TEST_DIR/received -y
diff $TEST_DIR/ackpg.bin $TEST_DIR/received/ackpg.bin

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null

8.3 Deleted file absent after migration (positive + negative control)

rm -rf $TEST_DIR
mkdir -p $TEST_DIR/{files,descriptions,received}
psql -U postgres -c "DROP DATABASE IF EXISTS xftp_server_store;"
psql -U postgres -c "CREATE DATABASE xftp_server_store OWNER xftp;"

$XFTP_SERVER init -p $TEST_DIR/files -q 10gb --ip 127.0.0.1
ini_set port 7921
FP=$(cat $XFTP_SERVER_CFG_PATH/fingerprint)
SRV="xftp://$FP@127.0.0.1:7921"

$XFTP_SERVER start &
SERVER_PID=$!; sleep 2

# File to be deleted (use n=2, backup rcv2 before delete)
dd if=/dev/urandom of=$TEST_DIR/delmigrate.bin bs=1M count=1 2>/dev/null
$XFTP send $TEST_DIR/delmigrate.bin $TEST_DIR/descriptions -s "$SRV" -n 2
cp $TEST_DIR/descriptions/delmigrate.bin.xftp/rcv2.xftp $TEST_DIR/rcv2_del_backup.xftp

$XFTP recv $TEST_DIR/descriptions/delmigrate.bin.xftp/rcv1.xftp $TEST_DIR/received -y
$XFTP del $TEST_DIR/descriptions/delmigrate.bin.xftp/snd.xftp.private -y

# Positive control: a file that is NOT deleted
dd if=/dev/urandom of=$TEST_DIR/keepmigrate.bin bs=1M count=1 2>/dev/null
$XFTP send $TEST_DIR/keepmigrate.bin $TEST_DIR/descriptions -s "$SRV" -n 1

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null; sleep 1

ini_set store_files database
ini_uncomment db_connection
ini_uncomment db_schema
ini_uncomment db_pool_size
echo Y | $XFTP_SERVER database import

psql -U xftp -d xftp_server_store -c "SET search_path TO xftp_server; SELECT count(*) FROM files;"
# Expected: > 0 (kept file imported)

$XFTP_SERVER start --confirm-migrations up &
SERVER_PID=$!; sleep 2

# Positive: kept file MUST be receivable
$XFTP recv $TEST_DIR/descriptions/keepmigrate.bin.xftp/rcv1.xftp $TEST_DIR/received -y
diff $TEST_DIR/keepmigrate.bin $TEST_DIR/received/keepmigrate.bin

# Negative: deleted file's rcv2 MUST return AUTH
$XFTP recv $TEST_DIR/rcv2_del_backup.xftp $TEST_DIR/received -y 2>&1
# Expected: AUTH error

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null

8.4 Large multi-chunk file integrity after migration

rm -rf $TEST_DIR
mkdir -p $TEST_DIR/{files,descriptions,received}
psql -U postgres -c "DROP DATABASE IF EXISTS xftp_server_store;"
psql -U postgres -c "CREATE DATABASE xftp_server_store OWNER xftp;"

$XFTP_SERVER init -p $TEST_DIR/files -q 10gb --ip 127.0.0.1
ini_set port 7921
FP=$(cat $XFTP_SERVER_CFG_PATH/fingerprint)
SRV="xftp://$FP@127.0.0.1:7921"

$XFTP_SERVER start &
SERVER_PID=$!; sleep 2

dd if=/dev/urandom of=$TEST_DIR/largefile.bin bs=1M count=20 2>/dev/null
$XFTP send $TEST_DIR/largefile.bin $TEST_DIR/descriptions -s "$SRV" -n 1

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null; sleep 1

ini_set store_files database
ini_uncomment db_connection
ini_uncomment db_schema
ini_uncomment db_pool_size
echo Y | $XFTP_SERVER database import

$XFTP_SERVER start --confirm-migrations up &
SERVER_PID=$!; sleep 2

$XFTP recv $TEST_DIR/descriptions/largefile.bin.xftp/rcv1.xftp $TEST_DIR/received -y
diff $TEST_DIR/largefile.bin $TEST_DIR/received/largefile.bin
echo "20MB multi-chunk integrity preserved"

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null

8.5 Double round-trip: memory -> PG -> memory -> PG

rm -rf $TEST_DIR
mkdir -p $TEST_DIR/{files,descriptions,received}
psql -U postgres -c "DROP DATABASE IF EXISTS xftp_server_store;"
psql -U postgres -c "CREATE DATABASE xftp_server_store OWNER xftp;"

$XFTP_SERVER init -p $TEST_DIR/files -q 10gb --ip 127.0.0.1
ini_set port 7921
FP=$(cat $XFTP_SERVER_CFG_PATH/fingerprint)
SRV="xftp://$FP@127.0.0.1:7921"

$XFTP_SERVER start &
SERVER_PID=$!; sleep 2
dd if=/dev/urandom of=$TEST_DIR/roundtrip.bin bs=1M count=1 2>/dev/null
$XFTP send $TEST_DIR/roundtrip.bin $TEST_DIR/descriptions -s "$SRV" -n 1
kill $SERVER_PID; wait $SERVER_PID 2>/dev/null; sleep 1

# Round 1: memory -> PG
ini_set store_files database
ini_uncomment db_connection
ini_uncomment db_schema
ini_uncomment db_pool_size
echo Y | $XFTP_SERVER database import
$XFTP_SERVER start --confirm-migrations up &
SERVER_PID=$!; sleep 2
kill $SERVER_PID; wait $SERVER_PID 2>/dev/null; sleep 1

# Round 1: PG -> memory
echo Y | $XFTP_SERVER database export
ini_set store_files memory
ini_comment db_connection
ini_comment db_schema
ini_comment db_pool_size
$XFTP_SERVER start &
SERVER_PID=$!; sleep 2
kill $SERVER_PID; wait $SERVER_PID 2>/dev/null; sleep 1

# Round 2: memory -> PG
psql -U postgres -c "DROP DATABASE IF EXISTS xftp_server_store;"
psql -U postgres -c "CREATE DATABASE xftp_server_store OWNER xftp;"
ini_set store_files database
ini_uncomment db_connection
ini_uncomment db_schema
ini_uncomment db_pool_size
echo Y | $XFTP_SERVER database import

$XFTP_SERVER start --confirm-migrations up &
SERVER_PID=$!; sleep 2

$XFTP recv $TEST_DIR/descriptions/roundtrip.bin.xftp/rcv1.xftp $TEST_DIR/received -y
diff $TEST_DIR/roundtrip.bin $TEST_DIR/received/roundtrip.bin
echo "File intact after memory->PG->memory->PG double round-trip"

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null

9. Auth and access control

9.1 allowNewFiles=false rejects upload

rm -rf $TEST_DIR
mkdir -p $TEST_DIR/{files,descriptions,received}
$XFTP_SERVER init -p $TEST_DIR/files -q 10gb --ip 127.0.0.1
ini_set port 7921
ini_set new_files off
FP=$(cat $XFTP_SERVER_CFG_PATH/fingerprint)
SRV="xftp://$FP@127.0.0.1:7921"

$XFTP_SERVER start &
SERVER_PID=$!; sleep 2

dd if=/dev/urandom of=$TEST_DIR/reject.bin bs=1M count=1 2>/dev/null
$XFTP send $TEST_DIR/reject.bin $TEST_DIR/descriptions -s "$SRV" -n 1 2>&1
# Expected: upload fails

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null

9.2 Basic auth: no password → fails with AUTH

rm -rf $TEST_DIR
mkdir -p $TEST_DIR/{files,descriptions,received}
$XFTP_SERVER init -p $TEST_DIR/files -q 10gb --ip 127.0.0.1
ini_set port 7921
sed -i 's/^# create_password:.*$/create_password: secret123/' $XFTP_SERVER_CFG_PATH/file-server.ini
FP=$(cat $XFTP_SERVER_CFG_PATH/fingerprint)
SRV="xftp://$FP@127.0.0.1:7921"

$XFTP_SERVER start &
SERVER_PID=$!; sleep 2

dd if=/dev/urandom of=$TEST_DIR/authtest.bin bs=1M count=1 2>/dev/null
$XFTP send $TEST_DIR/authtest.bin $TEST_DIR/descriptions -s "$SRV" -n 1 2>&1
# Expected: AUTH error

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null

9.3 Basic auth: wrong password → PCEProtocolError AUTH

rm -rf $TEST_DIR
mkdir -p $TEST_DIR/{files,descriptions,received}
$XFTP_SERVER init -p $TEST_DIR/files -q 10gb --ip 127.0.0.1
ini_set port 7921
sed -i 's/^# create_password:.*$/create_password: secret123/' $XFTP_SERVER_CFG_PATH/file-server.ini
FP=$(cat $XFTP_SERVER_CFG_PATH/fingerprint)
WRONG_SRV="xftp://$FP:wrongpass@127.0.0.1:7921"

$XFTP_SERVER start &
SERVER_PID=$!; sleep 2

dd if=/dev/urandom of=$TEST_DIR/authtest.bin bs=1M count=1 2>/dev/null
$XFTP send $TEST_DIR/authtest.bin $TEST_DIR/descriptions -s "$WRONG_SRV" -n 1 2>&1
# Expected: "PCEProtocolError AUTH" in output
ls $TEST_DIR/descriptions/authtest.bin.xftp/rcv1.xftp 2>&1
# Expected: No such file or directory (no descriptor created)

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null

9.4 Basic auth: correct password → succeeds

rm -rf $TEST_DIR
mkdir -p $TEST_DIR/{files,descriptions,received}
$XFTP_SERVER init -p $TEST_DIR/files -q 10gb --ip 127.0.0.1
ini_set port 7921
sed -i 's/^# create_password:.*$/create_password: secret123/' $XFTP_SERVER_CFG_PATH/file-server.ini
FP=$(cat $XFTP_SERVER_CFG_PATH/fingerprint)
CORRECT_SRV="xftp://$FP:secret123@127.0.0.1:7921"

$XFTP_SERVER start &
SERVER_PID=$!; sleep 2

dd if=/dev/urandom of=$TEST_DIR/authok.bin bs=1M count=1 2>/dev/null
$XFTP send $TEST_DIR/authok.bin $TEST_DIR/descriptions -s "$CORRECT_SRV" -n 1

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null

9.5 Server without auth, client sends auth → succeeds

rm -rf $TEST_DIR
mkdir -p $TEST_DIR/{files,descriptions,received}
$XFTP_SERVER init -p $TEST_DIR/files -q 10gb --ip 127.0.0.1
ini_set port 7921
FP=$(cat $XFTP_SERVER_CFG_PATH/fingerprint)
AUTH_SRV="xftp://$FP:anypass@127.0.0.1:7921"

$XFTP_SERVER start &
SERVER_PID=$!; sleep 2

dd if=/dev/urandom of=$TEST_DIR/noauth.bin bs=1M count=1 2>/dev/null
$XFTP send $TEST_DIR/noauth.bin $TEST_DIR/descriptions -s "$AUTH_SRV" -n 1

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null

9.6 Storage quota boundary

rm -rf $TEST_DIR
mkdir -p $TEST_DIR/{files,descriptions,received}
$XFTP_SERVER init -p $TEST_DIR/files -q 3mb --ip 127.0.0.1
ini_set port 7921
FP=$(cat $XFTP_SERVER_CFG_PATH/fingerprint)
SRV="xftp://$FP@127.0.0.1:7921"

$XFTP_SERVER start &
SERVER_PID=$!; sleep 2

dd if=/dev/urandom of=$TEST_DIR/quota1.bin bs=1M count=1 2>/dev/null
$XFTP send $TEST_DIR/quota1.bin $TEST_DIR/descriptions -s "$SRV" -n 1

dd if=/dev/urandom of=$TEST_DIR/quota2.bin bs=1M count=1 2>/dev/null
$XFTP send $TEST_DIR/quota2.bin $TEST_DIR/descriptions -s "$SRV" -n 1

dd if=/dev/urandom of=$TEST_DIR/quota3.bin bs=1M count=1 2>/dev/null
$XFTP send $TEST_DIR/quota3.bin $TEST_DIR/descriptions -s "$SRV" -n 1 2>&1
# Expected: QUOTA error

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null

9.7 File expiration

File expiration is not testable in a fast manual test because createdAt uses hour-level precision (fileTimePrecision = 3600s) and the check interval is hardcoded at 2 hours. It is tested in the Haskell test suite (testFileChunkExpiration with a 1-second TTL).

10. Control port operations

10.1 Command without auth → AUTH

rm -rf $TEST_DIR
mkdir -p $TEST_DIR/{files,descriptions,received}
$XFTP_SERVER init -p $TEST_DIR/files -q 10gb --ip 127.0.0.1
ini_set port 7921
enable_control_port
FP=$(cat $XFTP_SERVER_CFG_PATH/fingerprint)
SRV="xftp://$FP@127.0.0.1:7921"

$XFTP_SERVER start &
SERVER_PID=$!; sleep 2

dd if=/dev/urandom of=$TEST_DIR/ctrldel.bin bs=1M count=1 2>/dev/null
$XFTP send $TEST_DIR/ctrldel.bin $TEST_DIR/descriptions -s "$SRV" -n 1
RCV_ID=$(get_recipient_ids $TEST_DIR/descriptions/ctrldel.bin.xftp/rcv1.xftp | head -1)

# No auth
python3 -c "
import socket, time
s = socket.create_connection(('127.0.0.1', 15230), timeout=5)
s.settimeout(2)
time.sleep(0.3); s.recv(4096)
s.sendall(b'delete $RCV_ID\n')
time.sleep(0.3)
print(s.recv(4096).decode().strip())
s.sendall(b'quit\n'); s.close()
"
# Expected: AUTH

10.2 Wrong password → CPRNone, commands return AUTH

python3 -c "
import socket, time
s = socket.create_connection(('127.0.0.1', 15230), timeout=5)
s.settimeout(2)
time.sleep(0.3); s.recv(4096)
s.sendall(b'auth wrongpassword\n')
time.sleep(0.3)
print('auth:', s.recv(4096).decode().strip())
# Expected: Current role is CPRNone
s.sendall(b'delete $RCV_ID\n')
time.sleep(0.3)
print('delete:', s.recv(4096).decode().strip())
# Expected: AUTH
s.sendall(b'quit\n'); s.close()
"

10.3 stats-rts responds

control_cmd "stats-rts"
# Expected: either GHC RTS stats or "unsupported operation (GHC.Stats.getRTSStats: ...)"

10.4 Delete command removes file

control_cmd "delete $RCV_ID"
# Expected: ok

$XFTP recv $TEST_DIR/descriptions/ctrldel.bin.xftp/rcv1.xftp $TEST_DIR/received -y 2>&1
# Expected: AUTH error

10.5 Invalid block reason → error:

dd if=/dev/urandom of=$TEST_DIR/badblock.bin bs=1M count=1 2>/dev/null
$XFTP send $TEST_DIR/badblock.bin $TEST_DIR/descriptions -s "$SRV" -n 1
RCV_ID2=$(get_recipient_ids $TEST_DIR/descriptions/badblock.bin.xftp/rcv1.xftp | head -1)

control_cmd "block $RCV_ID2 reason=invalid_reason"
# Expected: error:...

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null

11. Blocked file: sender cannot delete

rm -rf $TEST_DIR
mkdir -p $TEST_DIR/{files,descriptions,received}
$XFTP_SERVER init -p $TEST_DIR/files -q 10gb --ip 127.0.0.1
ini_set port 7921
enable_control_port
FP=$(cat $XFTP_SERVER_CFG_PATH/fingerprint)
SRV="xftp://$FP@127.0.0.1:7921"

$XFTP_SERVER start &
SERVER_PID=$!; sleep 2

dd if=/dev/urandom of=$TEST_DIR/blockdel.bin bs=1M count=1 2>/dev/null
$XFTP send $TEST_DIR/blockdel.bin $TEST_DIR/descriptions -s "$SRV" -n 1

RCV_ID=$(get_recipient_ids $TEST_DIR/descriptions/blockdel.bin.xftp/rcv1.xftp | head -1)
control_cmd "block $RCV_ID reason=spam"

# Sender delete should fail with BLOCKED
$XFTP del $TEST_DIR/descriptions/blockdel.bin.xftp/snd.xftp.private -y 2>&1
# Expected: BLOCKED error

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null

12. Recipient cascade and storage accounting

12.1 Recipient cascade delete (PG)

rm -rf $TEST_DIR
mkdir -p $TEST_DIR/{files,descriptions,received}
psql -U postgres -c "DROP DATABASE IF EXISTS xftp_server_store;"
psql -U postgres -c "CREATE DATABASE xftp_server_store OWNER xftp;"

$XFTP_SERVER init -p $TEST_DIR/files -q 10gb --ip 127.0.0.1
ini_set port 7921
ini_set store_files database
ini_uncomment db_connection
ini_uncomment db_schema
ini_uncomment db_pool_size
FP=$(cat $XFTP_SERVER_CFG_PATH/fingerprint)
SRV="xftp://$FP@127.0.0.1:7921"

psql -U xftp -d xftp_server_store -c "CREATE SCHEMA IF NOT EXISTS xftp_server;"
rm -f $XFTP_SERVER_LOG_PATH/file-server-store.log

$XFTP_SERVER start --confirm-migrations up &
SERVER_PID=$!; sleep 2

dd if=/dev/urandom of=$TEST_DIR/cascade.bin bs=1M count=1 2>/dev/null
$XFTP send $TEST_DIR/cascade.bin $TEST_DIR/descriptions -s "$SRV" -n 3

psql -U xftp -d xftp_server_store -c "SET search_path TO xftp_server; SELECT count(*) FROM files;"
# Expected: > 0
psql -U xftp -d xftp_server_store -c "SET search_path TO xftp_server; SELECT count(*) FROM recipients;"
# Expected: > 0

$XFTP del $TEST_DIR/descriptions/cascade.bin.xftp/snd.xftp.private -y

psql -U xftp -d xftp_server_store -c "SET search_path TO xftp_server; SELECT count(*) FROM files;"
# Expected: 0
psql -U xftp -d xftp_server_store -c "SET search_path TO xftp_server; SELECT count(*) FROM recipients;"
# Expected: 0 (cascade delete)

12.2 Storage accounting

dd if=/dev/urandom of=$TEST_DIR/stor1.bin bs=1M count=1 2>/dev/null
$XFTP send $TEST_DIR/stor1.bin $TEST_DIR/descriptions -s "$SRV" -n 1

dd if=/dev/urandom of=$TEST_DIR/stor2.bin bs=1M count=1 2>/dev/null
$XFTP send $TEST_DIR/stor2.bin $TEST_DIR/descriptions -s "$SRV" -n 1

ls $TEST_DIR/files/ | wc -l
# Expected: > 0

$XFTP del $TEST_DIR/descriptions/stor1.bin.xftp/snd.xftp.private -y
$XFTP del $TEST_DIR/descriptions/stor2.bin.xftp/snd.xftp.private -y

ls $TEST_DIR/files/ | wc -l
# Expected: 0

psql -U xftp -d xftp_server_store -c "SET search_path TO xftp_server; SELECT count(*) FROM files;"
# Expected: 0

kill $SERVER_PID; wait $SERVER_PID 2>/dev/null

Cleanup

kill $SERVER_PID 2>/dev/null; wait $SERVER_PID 2>/dev/null
rm -rf $TEST_DIR
psql -U postgres -c "DROP DATABASE IF EXISTS xftp_server_store;"

Summary of expected results

# Scenario Expected
1 Send/receive on memory OK
2 Send/receive on PostgreSQL OK (DB rows match)
3 Memory → PG, receive remaining OK
4 PG → memory, delete round-trip OK
4b Send PG, export, receive on memory OK
5.1 Restart persistence (memory + log) OK
5.2 Restart persistence (memory, no log) AUTH error
5.3 Restart persistence (PostgreSQL) OK
6.1 Receive after server delete AUTH error
6.2 Multiple recipients (n=3) All work
6.3 DB mode + existing store log Server refuses
6.4 DB mode + no schema Server fails
6.5 Dual-write (db_store_log: on) Both DB and log have data
6.6 Import to non-empty DB Error
6.7 Import without store log Error
6.8 Export when store log exists Error
7.1 Block file, receive fails BLOCKED (not AUTH)
7.2 Block survives memory → PG BLOCKED
7.3 Block survives PG → memory BLOCKED
8.1 Acked rcv1 fails, rcv2 works (memory → PG) AUTH + OK
8.2 Acked rcv1 fails, rcv2 works (PG → memory) AUTH + OK
8.3 Deleted file absent, kept file present rcv2_del=AUTH, kept=OK
8.4 Large 20MB multi-chunk migration Integrity preserved
8.5 Double round-trip memory↔PG Intact
9.1 new_files=off Upload rejected
9.2 Basic auth, no password AUTH
9.3 Basic auth, wrong password PCEProtocolError AUTH
9.4 Basic auth, correct password OK
9.5 No server auth, client sends auth OK
9.6 Quota boundary 3rd file QUOTA error
10.1 Control port, no auth AUTH
10.2 Control port, wrong password CPRNone → AUTH
10.3 stats-rts Responds
10.4 Control port delete ok → recv AUTH
10.5 Invalid block reason error:
11 Blocked file, sender delete BLOCKED
12.1 Recipient cascade delete (PG) files=0, recipients=0
12.2 Storage accounting disk=0, DB=0
Reference in New Issue View Git Blame Copy Permalink