3 people 53bd383fe8 Report each stream's current position as a metric ...

When a stream advances in the database but stops being replicated to a
process, that process's view of the stream freezes. Requests that wait for
it to catch up to a token issued by another worker then time out and return
empty responses indefinitely (see #20080), and nothing exported said so.

Report `get_current_token` from every ID generator, on every process. The
value is comparable between processes, so a stream that has stopped
reaching one of them shows up as divergence with no client traffic needed.
It is also the position that `wait_for_stream_token` waits on, so its
divergence is the failure itself rather than a proxy for it.

Being a watermark over gapless runs of persisted IDs, it also catches a
single writer of a sharded stream going quiet, which a maximum across
writers would hide behind the writers still being replicated.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>

2026-08-12 14:32:14 +01:00

..

databases

Fix _get_server_keys_json invalidations over replication as JSON (#19966)

2026-07-27 09:29:58 +01:00

util

Use type hinting generics in standard collections (#19046)

2025-10-22 16:48:19 -05:00

__init__.py

Reference Matrix Home Server

2014-08-12 15:10:52 +01:00

test__base.py

Use type hinting generics in standard collections (#19046)

2025-10-22 16:48:19 -05:00

test_account_data.py

Write union types as X | Y where possible (#19111)

2025-11-06 14:02:33 -06:00

test_appservice.py

Use type hinting generics in standard collections (#19046)

2025-10-22 16:48:19 -05:00

test_background_update.py

Update HomeserverTestCase.get_success(...) and friends to drive async Rust (Tokio runtime/thread pool) (#19871)

2026-07-02 15:20:38 -05:00

test_base.py

Remove MockClock() (#18992)

2025-09-30 11:27:29 -05:00

test_cleanup_extrems.py

Introduce Clock.call_when_running(...) to include logcontext by default (#18944)

2025-09-22 10:27:59 -05:00

test_client_ips.py

Update FakeChannel.await_result(...) to drive async Rust (Tokio runtime/thread pool) (#19879)

2026-07-07 04:07:19 -05:00

test_database.py

Always rollback transaction when retrying (#19372)

2026-01-15 19:35:51 -06:00

test_devices.py

Prune old rows in device_lists_changes_in_room table. (#19473)

2026-04-17 11:54:22 +01:00

test_directory.py

Introduce Clock.call_when_running(...) to include logcontext by default (#18944)

2025-09-22 10:27:59 -05:00

test_e2e_room_keys.py

Introduce Clock.call_when_running(...) to include logcontext by default (#18944)

2025-09-22 10:27:59 -05:00

test_end_to_end_keys.py

Introduce Clock.call_when_running(...) to include logcontext by default (#18944)

2025-09-22 10:27:59 -05:00

test_event_chain.py

Update HomeserverTestCase.get_success(...) and friends to drive async Rust (Tokio runtime/thread pool) (#19871)

2026-07-02 15:20:38 -05:00

test_event_federation.py

Replace usage of deprecated assertEquals with assertEqual (#19345)

2026-01-06 17:30:21 +00:00

test_event_push_actions.py

Fix permanent badge inflation from read receipts before first rotation (#19785)

2026-06-23 11:31:32 +00:00

test_events_bg_updates.py

Allow resigning of events with a new signing key (#19668)

2026-04-14 16:44:58 +00:00

test_events.py

Fix up event-construction in tests ahead of the Rust event port (#19781)

2026-05-15 10:12:42 +01:00

test_id_generators.py

Report each stream's current position as a metric

2026-08-12 14:32:14 +01:00

test_invite_rule.py

Implement MSC4380: Invite blocking (#19203)

2025-11-26 16:12:14 +00:00

test_main.py

Introduce support for MSC4429: Profile Updates for Legacy Sync (#19556)

2026-08-06 15:35:07 +01:00

test_monthly_active_users.py

Force keyword-args for clear default_config(server_name="test") usage (#19849)

2026-06-12 09:45:22 -05:00

test_msc4242_state_dag.py

Port Event class to Rust (#19701)

2026-06-02 11:05:38 +01:00

test_profile.py

Introduce support for MSC4429: Profile Updates for Legacy Sync (#19556)

2026-08-06 15:35:07 +01:00

test_purge.py

Fix local events being deleted despite delete_local_events=False in room versions other than 1 and 2. (#19850)

2026-06-17 11:03:59 +01:00

test_receipts.py

Write union types as X | Y where possible (#19111)

2025-11-06 14:02:33 -06:00

test_redaction.py

Port Event class to Rust (#19701)

2026-06-02 11:05:38 +01:00

test_registration.py

Introduce Clock.call_when_running(...) to include logcontext by default (#18944)

2025-09-22 10:27:59 -05:00

test_relations.py

Introduce Clock.call_when_running(...) to include logcontext by default (#18944)

2025-09-22 10:27:59 -05:00

test_rollback_worker.py

Use type hinting generics in standard collections (#19046)

2025-10-22 16:48:19 -05:00

test_room_search.py

Use type hinting generics in standard collections (#19046)

2025-10-22 16:48:19 -05:00

test_room.py

Add an API to list changes to quarantine state of media (#19558)

2026-04-09 11:41:31 -06:00

test_roommember.py

Introduce spam_checker_spammy internal event metadata. (#19453)

2026-04-15 16:53:23 +01:00

test_sliding_sync_tables.py

Fix up event-construction in tests ahead of the Rust event port (#19781)

2026-05-15 10:12:42 +01:00

test_state_deletion.py

Introduce Clock.call_when_running(...) to include logcontext by default (#18944)

2025-09-22 10:27:59 -05:00

test_state.py

Fix storage type mismatches where values didn't match their column types (#19911)

2026-07-10 10:38:43 +01:00

test_sticky_events.py

Introduce spam_checker_spammy internal event metadata. (#19453)

2026-04-15 16:53:23 +01:00

test_stream.py

Fix parsing events that have large integers (#19819)

2026-06-03 14:52:05 +01:00

test_thread_subscriptions.py

Write union types as X | Y where possible (#19111)

2025-11-06 14:02:33 -06:00

test_transactions.py

Introduce Clock.call_when_running(...) to include logcontext by default (#18944)

2025-09-22 10:27:59 -05:00

test_txn_limit.py

Introduce Clock.call_when_running(...) to include logcontext by default (#18944)

2025-09-22 10:27:59 -05:00

test_unsafe_locale.py

Refactor Histogram metrics to be homeserver-scoped (#18724)

2025-07-29 15:35:38 -05:00

test_user_directory.py

Write union types as X | Y where possible (#19111)

2025-11-06 14:02:33 -06:00

test_user_filters.py

Introduce Clock.call_when_running(...) to include logcontext by default (#18944)

2025-09-22 10:27:59 -05:00