Erik JohnstonandClaude Opus 5.5 a78b02b55c Load events in Rust for Python too, on the native driver ...

With the main database on the native Postgres driver, every event load
goes through the Rust `EventLoader`. `EventsWorkerStore` sends the events
its own lookups miss to `RustStore.load_events`, and `_get_events_from_db`
to `reload_events`. Loads from Python, sync and state resolution then
coalesce in the shared event cache, and an invalidation during a load
stops it caching a stale entry. Python's fetch threads and in-flight map
stay only for other databases.

- `EventLoader::load` goes through `Cache::get_or_load_many`. The extra
  redaction events it reads are returned but no longer cached.
- `PoolQuerier` checks its connection out before claiming any loads, so
  readers that hold connections while they wait cannot starve a load.
- An unusable event raises `InvalidEventError` or
  `DatabaseCorruptionError`, as from Python, which some callers catch.
- Cancelling a Python caller leaves the load running for the others, and
  `evt_db_fetch_count` counts only what a caller read itself.
- `RustStore` holds the `DatabasePool` weakly and reads its pool per call.

Tests: trial makes the loads block, as it does Python's transactions
(`_BlockingRustCalls`, renamed from `_BlockingRustSyncHandler`). The
cancellation and outage tests get Rust variants. Two tests stop depending
on how far requests advance the clock or on which `DatabasePool` object
a worker store keeps.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01VpBQxvqZTUvHCMm3u6CR7J

2026-10-16 09:34:35 +00:00

..

http

Rename the test_disconnect test helper so that pytest doesn't see it as a test. (#19486)

2026-02-20 15:37:34 +00:00

storage

Port Event class to Rust (#19701)

2026-06-02 11:05:38 +01:00

tcp

Fix state events missing from MSC4222 state_after when the since token falls inside a persist batch (#20171)

2026-09-16 11:07:25 +02:00

__init__.py

Correctly mention previous copyright (#16820)

2024-01-23 11:26:48 +00:00

_base.py

Load events in Rust for Python too, on the native driver

2026-10-16 09:34:35 +00:00

test_auth.py

Introduce Clock.call_when_running(...) to include logcontext by default (#18944)

2025-09-22 10:27:59 -05:00

test_client_reader_shard.py

Correctly mention previous copyright (#16820)

2024-01-23 11:26:48 +00:00

test_federation_ack.py

Update HomeserverTestCase.get_success(...) and friends to drive async Rust (Tokio runtime/thread pool) (#19871)

2026-07-02 15:20:38 -05:00

test_federation_sender_shard.py

Raise default room version to "12" (#20130)

2026-09-17 18:32:51 +00:00

test_module_cache_invalidation.py

Cleanly shutdown SynapseHomeServer object (#18828)

2025-10-01 02:42:09 +00:00

test_multi_media_repo.py

Bump Twisted in poetry.lock from 25.5.0 to 26.4.0 (#20259)

2026-09-29 17:50:55 +00:00

test_pusher_shard.py

Introduce Clock.call_when_running(...) to include logcontext by default (#18944)

2025-09-22 10:27:59 -05:00

test_sharded_event_persister.py

Raise default room version to "12" (#20130)

2026-09-17 18:32:51 +00:00

test_sharded_receipts.py

Introduce Clock.call_when_running(...) to include logcontext by default (#18944)

2025-09-22 10:27:59 -05:00

test_sharded_sticky_events.py

Use sharded tokens in MSC4354: Sticky Events sync and sliding sync, preventing events appearing in multiple sync responses. (#20186)

2026-10-05 12:40:55 +01:00