mcp server: files, /leave and library methods (#7962)

* bots, nodejs: document chat, connection, member contact and network commands, typed commands in library

* bots, nodejs: restore apiConnect, wrap domain once, test all connect responses

* nodejs: JSDoc for new methods

* docs: plan for bot API commands and typed Node library methods

* tests: channel prepared with a domain has a verified SimpleX name

* docs: apply review fixes to the plan for bot API commands

* docs: apply second review pass to the plan for bot API commands

* docs: refer the bot API plan to the rewritten test commit

* docs: record decisions in the plan for bot API commands

* docs: plan tests of the generated Python command strings

* python: test the generated strings of the documented commands

* docs: plan for files, /leave and library methods in the MCP server

* docs: wait at stop in the MCP plan

* docs: library methods and /leave mechanics in the MCP plan

* mcp: typed library methods for chat commands

* docs: plan the message information command for bots

* mcp: /leave CHAT owner command to leave a chat at once

* docs: file servers, GIF and video choices decided in the MCP plan

* docs: file mechanics in the MCP plan

* mcp: files of received messages

* bots, nodejs: message information with the file servers for bots

* docs: plan the relay approval option of receiving files in Node

* mcp: download of received files with owner approval

* docs: name the xftp-server test helper in the files plan

* nodejs: receive files without approving unknown relays

* docs: plan the user servers command for bots

* bots, nodejs: user servers and relays by operator for bots

* nodejs: document the message information method

* docs: plan the file upload progress event for bots

* mcp: send files with owner approval, refusing private keys

* bots: file upload progress event for bots

* mcp: /leave template in the agent control chat menu

* docs: sent copies are deleted for contacts too, at sndFileCompleteXFTP

* bots: drop the file upload progress event

* docs: drop the upload progress event plan

* nodejs: document user servers and relay approval of received files

* mcp: download cards name unknown file servers after the upload

* docs: record the wait for the file description in the files plan

* mcp: fixed wait at stop for cancelled cards, without /sql

* docs: record decision C4, a fixed wait at stop, in the files plan

* ci: test the MCP server package on pull requests

* ci: state when the MCP workflow can be dispatched

* ci: run the MCP server tests when its libraries change

* mcp: log the errors of image previews and resizing

* mcp: keep files in transfer in the data folder

* mcp: restrict sent files by the real paths of refused folders

* mcp: validate the file at the send by its inode and change time

* mcp: limit ffmpeg and ffprobe to local files and no input commands

* mcp: ask the owner for unknown file servers; read approvals at creation

* mcp: name downloaded files by their ID; return paths of downloads only

* mcp: end each download with a result for the agent and the card

* mcp: show files above their sender's size limit as failed

* mcp: refuse empty files, as without file and captions too long to send

* mcp: tell the owner about failed uploads and unposted received files

* mcp: delete resized copies left by the last run at start

* mcp: name downloads and leaving in the help and greeting, align docs

* mcp: compute the download path for received files only

* mcp: send a /receive file to the owner under its name

* mcp: keep files received without a download in the chat's folder

* mcp: keep a left chat's files and delete them with /delete CHAT files

* mcp: test that sent images are resized by the core

* mcp: wait 30 minutes for a download's progress before cancelling it

* mcp: end a download as deleted only when its message is not found

* mcp: delete the copy of a /receive file whose post fails

* mcp: count the quoted content in a message's length, as the core sends it

* mcp: name received bytes, unknown-server downloads and left chat files plainly

* mcp: test refused folders, file changes and download approvals

* docs: align MCP server docs with refused folders, leaves and download waits

* mcp: move received files only in full, delete partials only of downloads

* mcp: report a received file missing from its folder as failed

* mcp: move received files of a group's member chats into its folder

* mcp: read a video's preview and duration as an MP4 or QuickTime file

* mcp: 0.2.0 on simplex-chat 7.1.0-beta.10.1

* mcp: file folders by chat type, /delete cancels downloads, files reply

* docs: MCP server specs and plan for 0.2.0

* mcp: /receive gives the agent a file, /forward sends it to the owner

* docs: MCP server specs for /receive and /forward of download cards

* docs: MCP plan records the temp folder command as a library exception

* mcp: /delete cancels resumed downloads; /forward quote fits the limit

* docs: MCP specs and plans for /forward quotes and resumed downloads

* docs: MCP specs name the source commit they are checked against

* docs: MCP PLAN states the /forward quote and move rules

* mcp: a download moves its completed file whatever its size

* mcp: /receive N all covers its card and later files, not pending ones

* docs: MCP files approval scope, reply text and README server wording

* mcp: a download approves relays only for a card naming unknown servers

* mcp: files in member chats of a group are tracked as in the main chat

* docs: MCP relay approval of downloads and files in member chats

* mcp: a rejected file gets a card again under the files approval

* docs: MCP rejected files under the files approval, README scope

* mcp: an offered file without a description gets no card or action

* docs: MCP a file without a description is not downloaded

* mcp: 0.2.0 on simplex-chat 7.1.0-beta.10.2

* ci: test the MCP server as a scope of build-linux

scripts/ci/README.md

@@ -130,6 +130,21 @@ The reduced build runs one Linux job, build-linux (ubuntu-22.04 x86_64), for eve
   npm test
   ```
 
+#### mcp
+
+- Globs:
+  - packages/simplex-chat-mcp/**
+  - packages/simplex-chat-nodejs/**
+  - packages/simplex-chat-client/types/typescript/**
+- CI:
+  - in build-linux: `scope-tests.sh mcp` (step "Test changed scopes"):
+    - the types package and the Node.js library built from the branch without the add-on, as package-tests.sh builds them;
+    - `npm ci`, then both installed into the MCP package with `npm install --no-save`;
+    - `npx tsc` and `npx tsc -p test/tsconfig.json --noEmit`;
+    - `npm test`, the unit tests;
+    - `npm run test:e2e`, the end-to-end tests. They download libsimplex and the add-on pinned in packages/simplex-chat-nodejs/src/release.ts, and smp-server and xftp-server of the simplexmq release in test/e2e/smpServer.ts.
+- Local: `scripts/ci/scope-tests.sh mcp`.
+
 #### Scopes lacking CI tests
 
 | Scope | Paths | CI |
@@ -138,7 +153,6 @@ The reduced build runs one Linux job, build-linux (ubuntu-22.04 x86_64), for eve
 | types package | packages/simplex-chat-client/types/typescript/** | compile only |
 | ts-client | packages/simplex-chat-client/typescript/** | - |
 | webrtc | packages/simplex-chat-webrtc/** | - |
-| mcp | packages/simplex-chat-mcp/** | - |
 | calculator-bot | apps/simplex-calculator-bot/** | - |
 | support-bot | apps/simplex-support-bot/** | - |
 | support-bot-light | apps/simplex-support-bot-light/** | - |

scripts/ci/packages_release.py

@@ -83,6 +83,11 @@ SCOPE_CHANGES = {
     "badge-web": ["apps/simplex-badge-service/web/**"],
     "ci-scripts": ["scripts/ci/packages_release.py", "scripts/ci/test_packages_release.py"],
     "website": ["website/src/js/simplex-lib.jsc", "website/test/**", "website/package.json"],
+    "mcp": [
+        "packages/simplex-chat-mcp/**",
+        "packages/simplex-chat-nodejs/**",
+        "packages/simplex-chat-client/types/typescript/**",
+    ],
 }
 CABAL_FILE = "simplex-chat.cabal"
 CABAL_VERSION = re.compile(r"^(version:\s*)(\S+)", re.M)

scripts/ci/scope-tests.sh

@@ -14,8 +14,19 @@ case "${1:-}" in
   website)
     (cd website && npm test)
     ;;
+  mcp)
+    (cd packages/simplex-chat-client/types/typescript && npm install --no-audit --no-fund && npx tsc)
+    (cd packages/simplex-chat-nodejs && npm install --ignore-scripts --no-save --no-audit --no-fund ../simplex-chat-client/types/typescript && npx tsc && cp src/simplex.* dist)
+    cd packages/simplex-chat-mcp
+    npm ci --no-audit --no-fund
+    npm install --no-save --no-audit --no-fund ../simplex-chat-nodejs ../simplex-chat-client/types/typescript
+    npx tsc
+    npx tsc -p test/tsconfig.json --noEmit
+    npm test
+    npm run test:e2e
+    ;;
   *)
-    echo "usage: $0 badge-web | ci-scripts | website" >&2
+    echo "usage: $0 badge-web | ci-scripts | website | mcp" >&2
     exit 1
     ;;
 esac

scripts/ci/test_packages_release.py

@@ -518,6 +518,14 @@ class ChangesTest(GitRepoTest):
         self.assertEqual(self.builds("website/src/js/simplex-lib.jsc"), set())
         self.assertEqual(self.values["scopes"], "website")
 
+    def test_mcp_change_tests_its_scope(self):
+        self.assertEqual(self.builds("packages/simplex-chat-mcp/src/tools.ts"), set())
+        self.assertEqual(self.values["scopes"], "mcp")
+
+    def test_library_change_builds_packages_and_tests_the_mcp_scope(self):
+        self.assertEqual(self.builds("packages/simplex-chat-nodejs/src/api.ts"), {"packages"})
+        self.assertEqual(self.values["scopes"], "mcp")
+
 
 class PackageStateTest(GitRepoTest):
     def setUp(self):