Commit Graph
67 Commits
Author SHA1 Message Date
Quentin Gliech e776d652d9 Fix Clippy lints introduced by Rust 1.86 2025-04-06 16:18:27 +02:00
Quentin Gliech f300eca3ee syn2mas: Track skipped entities in the syn2mas progress (#4225) 2025-03-28 14:58:58 +01:00
Olivier 'reivilibre cf14876270 syn2mas: remove obsolete TODOs
all of these are either solved through implementation or through lack of
necessity.
2025-03-18 16:57:03 +00:00
Olivier 'reivilibre d28b1cc890 syn2mas: fix handling of missing Synapse password_config config
Closes #3929
2025-03-18 15:58:05 +00:00
Olivier 'reivilibre 0f479d0be8 syn2mas: fix handling of Synapse user_consent config
Closes #3928
2025-03-18 15:57:40 +00:00
Olivier 'reivilibre d8b221c76d syn2mas: use ChaCha20 for all operations 2025-03-17 17:14:53 +00:00
dependabot[bot] 01792979ee build(deps): bump uuid from 1.15.1 to 1.16.0
Bumps [uuid](https://github.com/uuid-rs/uuid) from 1.15.1 to 1.16.0.
- [Release notes](https://github.com/uuid-rs/uuid/releases)
- [Commits](https://github.com/uuid-rs/uuid/compare/v1.15.1...v1.16.0)

---
updated-dependencies:
- dependency-name: uuid
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2025-03-17 12:55:37 +00:00
Quentin Gliech 56b7e086cb Track skipped entities in the syn2mas progress 2025-03-14 13:29:19 +00:00
Olivier 'reivilibre 9228f20f2a fixup! syn2mas: Add progress reporting to log and to opentelemetry metrics
Add metrics directly within syn2mas, no background thread
2025-03-13 14:50:32 +00:00
Olivier 'reivilibre ebad8a77aa syn2mas: Add progress reporting to log and to opentelemetry metrics 2025-03-12 18:49:36 +00:00
Olivier 'reivilibre 0afeb89470 Add dependency on arc-swap to syn2mas, moving it to a workspace dependency 2025-03-12 14:55:03 +00:00
Olivier 'reivilibre 19d87e896d Remove TODO on MIGRATOR 2025-03-12 14:38:32 +00:00
Olivier 'reivilibre 0ee9a68e22 syn2mas: improve performance of reading access tokens / refresh tokens 2025-03-12 14:38:32 +00:00
Quentin Gliech 2ae1523a61 Order the OAuth providers in the UI by their order in the config file (#4199) 2025-03-12 12:12:39 +01:00
reivilibre d1a3ef99e2 syn2mas: better performance, output tweaks, tracing tweaks, access token fixes (#4175) 2025-03-12 10:56:56 +00:00
Quentin Gliech 36a9131145 Update test snapshots 2025-03-12 11:47:07 +01:00
Quentin Gliech ea955b88b7 syn2mas: import the deactivation and locked status independently 2025-03-11 17:35:13 +01:00
Quentin Gliech 5a79703943 Better report errors when a writing task fails 2025-03-10 13:53:36 +00:00
Quentin Gliech 03fd1b20b5 Read and write users in different tasks 2025-03-10 13:53:36 +00:00
Quentin Gliech 9d12d0f4d6 Use rustc' FxHasher instead of the std one 2025-03-10 13:36:12 +00:00
Quentin Gliech 06a2ca33fb Better tracing during the migration 2025-03-10 13:36:12 +00:00
Quentin Gliech fe5ca2de87 Make sure tracing spans are propagated in tokio::task::spawn 2025-03-10 13:36:11 +00:00
Olivier 'reivilibre 40e67e4657 Log timings of migrations and index/constraint rebuilds 2025-03-10 13:25:59 +00:00
Olivier 'reivilibre a431ccbb72 Add spans for the constraint/index drop operations 2025-03-10 13:23:59 +00:00
Olivier 'reivilibre 741bc26d92 Don't include access tokens where the referenced device has vanished 2025-03-10 13:23:59 +00:00
Olivier 'reivilibre 1b63615091 Don't read refresh tokens that don't have associated access tokens
These appear to be accidental and should not be migrated.
2025-03-10 13:23:59 +00:00
Olivier 'reivilibre f1e4dc8fe5 For performance, switch to a row count estimate for users and devices 2025-03-10 13:23:59 +00:00
Olivier 'reivilibre 487c53cab3 Replace panic on unfinished buffers with an error
This doesn't get clobbered by the progress bar
2025-03-10 13:23:55 +00:00
Olivier 'reivilibre 669ec70bd2 Downgrade presence of guests and unsupported 3pids to warnings
Since migration is supported, but the data won't be used
2025-03-10 13:20:46 +00:00
Olivier 'reivilibre b95f983fb8 Remove obsolete OIDC provider warning
We now produce an error for unmapped OIDC providers!
2025-03-10 13:20:46 +00:00
dependabot[bot] 35cf30a622 build(deps): bump uuid from 1.14.0 to 1.15.1
Bumps [uuid](https://github.com/uuid-rs/uuid) from 1.14.0 to 1.15.1.
- [Release notes](https://github.com/uuid-rs/uuid/releases)
- [Commits](https://github.com/uuid-rs/uuid/compare/v1.14.0...v1.15.1)

---
updated-dependencies:
- dependency-name: uuid
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2025-03-07 14:05:02 +00:00
Quentin Gliech 93bd6ed2de Handle AS users with invalid localparts edge case 2025-03-04 12:38:51 +01:00
Quentin Gliech 7d060f5785 Properly ignore devices, threepids and access tokens from AS users (#4122) 2025-03-04 12:38:14 +01:00
Quentin Gliech cccb39ac1b Pass the MasWriter as owned to the various migration functions (#4120) 2025-03-04 12:37:23 +01:00
Quentin Gliech 1e99a6b7e2 syn2mas: use NonNilUuid for MAS user IDs 2025-03-04 11:55:59 +01:00
Quentin Gliech b6bb596471 Revert "Ignore colons in localparts when importing users"
This reverts commit 7263bcac45.
2025-03-03 13:52:25 +01:00
Quentin Gliech 2385d09b87 Actualy read appservice users, but don't insert them 2025-02-27 14:11:42 +01:00
Quentin Gliech 1c99829def Ignore 'guest_devices' in synapse 2025-02-27 14:07:23 +01:00
Quentin Gliech 89416c897d Ignore '-' as ip on devices 2025-02-27 14:07:23 +01:00
Quentin Gliech 7263bcac45 Ignore colons in localparts when importing users 2025-02-27 14:07:22 +01:00
Quentin Gliech 65b3741c1a Pass the MasWriter as owned to the various migration functions 2025-02-27 09:51:56 +01:00
Quentin Gliech a538b50233 Bump most Rust dependencies 2025-02-24 12:12:07 +01:00
Quentin Gliech 3d2b67a0b2 Upgrade to Rust 1.85 and edition 2024 2025-02-21 16:15:02 +01:00
dependabot[bot] ed8067aac5 build(deps): bump uuid from 1.13.2 to 1.14.0
Bumps [uuid](https://github.com/uuid-rs/uuid) from 1.13.2 to 1.14.0.
- [Release notes](https://github.com/uuid-rs/uuid/releases)
- [Commits](https://github.com/uuid-rs/uuid/compare/v1.13.2...v1.14.0)

---
updated-dependencies:
- dependency-name: uuid
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2025-02-21 13:53:19 +00:00
dependabot[bot] 8c8c7c5f06 build(deps): bump uuid from 1.13.1 to 1.13.2
Bumps [uuid](https://github.com/uuid-rs/uuid) from 1.13.1 to 1.13.2.
- [Release notes](https://github.com/uuid-rs/uuid/releases)
- [Commits](https://github.com/uuid-rs/uuid/compare/1.13.1...v1.13.2)

---
updated-dependencies:
- dependency-name: uuid
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2025-02-19 16:53:29 +00:00
Quentin Gliech ca651cebd9 Pass the migration state as owned to the various stages 2025-02-10 10:14:20 +01:00
Quentin Gliech 8e9919b381 Encapsulate migration state in a single structure 2025-02-07 15:02:30 +01:00
Quentin Gliech 919c86c86e Remove the lifetime parameter from MasWriter 2025-02-07 12:57:21 +01:00
Quentin Gliech e46cd724f4 Make the MAS connection owned in the locked database struct 2025-02-07 12:53:51 +01:00
dependabot[bot] e1a2c49a84 build(deps): bump uuid from 1.12.1 to 1.13.1
Bumps [uuid](https://github.com/uuid-rs/uuid) from 1.12.1 to 1.13.1.
- [Release notes](https://github.com/uuid-rs/uuid/releases)
- [Commits](https://github.com/uuid-rs/uuid/compare/1.12.1...1.13.1)

---
updated-dependencies:
- dependency-name: uuid
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2025-02-05 13:31:06 +00:00