Commit Graph
156 Commits
Author SHA1 Message Date
gadgethd f808298dfd fix RF race test on mobile 2026-08-02 18:52:54 +01:00
gadgethd 31dfe37b1f fix RF overlay initial load race 2026-08-02 18:49:03 +01:00
gadgethd 708d07288c Merge pull request #34 from gadgethd/agent/fix-release-compat-mounts
fix: mount live data in compatibility probe
2026-08-02 18:04:21 +01:00
gadgethd 2dca6cf0df fix: mount live data in compatibility probe 2026-08-02 17:51:33 +01:00
gadgethd 80a511faed Merge pull request #33 from gadgethd/agent/harden-hopreach-release
fix: harden HopReach release image
2026-08-02 17:41:44 +01:00
gadgethd 09366e7dec fix: harden HopReach release image 2026-08-02 17:27:48 +01:00
gadgethd 94799df048 feat: integrate HopReach RF coverage and reliability upgrades (#23)
Deploy the optimized, accuracy-gated HopReach RF pipeline and native progressive map layer after all CI, performance, full-stack, mobile, and secret-scan gates passed.
2026-08-02 17:05:01 +01:00
gadgethd ec2d32c25c ci: handle finite backfill worker in smoke test 2026-08-02 16:47:37 +01:00
gadgethd 864a2b20cd fix: reserve Compose proxy addresses 2026-08-02 16:32:28 +01:00
gadgethd 89041b6632 ci: use valid synthetic reloader token 2026-08-02 16:17:51 +01:00
gadgethd 6479529106 perf: vendor optimized HopReach release 2026-08-02 15:59:39 +01:00
gadgethd c0f81ff0c8 ci: avoid Mosquitto password update crash 2026-08-02 15:28:51 +01:00
gadgethd 6a42de3e0b ci: stabilize deployment gates 2026-08-02 15:15:13 +01:00
gadgethd c652fa30df ci: allow documented public MeshCore key 2026-08-02 14:22:53 +01:00
gadgethd 4553647f54 feat: integrate HopReach RF coverage 2026-08-02 14:11:11 +01:00
gadgethd e6439fa435 chore: clean upgrade formatting 2026-08-02 03:40:53 +01:00
gadgethd 30b1117f31 fix: restore IATA metadata and lazy path resolution 2026-08-02 03:40:11 +01:00
gadgethd 5db382e181 feat: complete codebase reliability upgrade 2026-08-02 03:40:11 +01:00
gadgethd d93e817313 fix(ui): restore and improve UKMesh repeater tree modal
- Extract shared path-modal styles into pages/path-modal.css so the feed
  modal regains its panel styling (regression from 83d770a: rules only in
  stats-page.css, which the feed page never imports)
- Embed the path map in the modal above the tree
- Tree readability: Unknown hop for unresolved trace hops, matched/ambiguous/
  unmatched dot variants, decluttered meta, honest hop summary header
- Include the July-29 feed refactor (FeedDialogs/FeedPathViews/feedModel/
  feedState/PacketPathMap) already live in the deployed build
2026-08-01 22:42:45 +01:00
gadgethd 83d770a2b2 fix(ui): UKMesh visual QA fixes — cookie banner, map labels, feed, charts, site pages
Deployed fixes from visual QA of ukmesh.com / app.ukmesh.com / healthcheck.ukmesh.com:

- Cookie consent: static full-width bottom bar with reserved page spacing (no longer overlays content)
- Landing: Live Map nav marked external with arrow, hero buttons and secondary text contrast
- Map app: readable place labels in both themes, packet feed top row no longer clipped,
  aligned feed columns, bordered header tool buttons
- Site pages: dark-themed Region select, brighter topology graph, Repeaters empty state,
  Companions bar scale legend, themed Spam controls/checkbox, Install badges
- Health: firmware chart label dedupe/rotation with Include Unknown toggle
- Docs: mobile code blocks scrollable
- Health Check: No data yet empty states, contrast, status pill a11y
- Healthcheck overrides: merged empty-state and a11y changes into deployed bind-mounted files
2026-08-01 16:48:27 +01:00
gadgethd b9b2ecdbfa Harden CI and background worker reliability 2026-07-28 23:17:49 +01:00
gadgethd 8404a72fbc Harden runtime and monitoring configuration 2026-07-28 23:17:39 +01:00
gadgethd 24d49198c6 Add Prometheus-backed Grafana dashboards 2026-07-28 23:17:33 +01:00
gadgethd 1c8aadb339 Expand owner, packet, and map experiences 2026-07-28 23:17:28 +01:00
gadgethd 14a345296a Expand backend products, ownership, ingest, and metrics 2026-07-28 23:17:23 +01:00
gadgethd 657917142a Add visibility, product, and owner data migrations 2026-07-28 23:17:18 +01:00
gadgethd 1ebc496965 Map UI redesign, live-path visibility, feed latency, and security hardening (#19)
* Fix map node freshness consistency

* Harden output, ingest, caches, and WebSocket limits

* Enforce public visibility across derived data

* Harden proxy and operator deployment boundary

* Make owner grants authoritative and reconcile ACLs safely

* Bound path, spam, and statistics analysis

* Make link and coverage jobs crash-safe

* Implement strategic security remediation

* Fix production cutover configuration

* Fix disabled viewshed worker health signal

* Serve stale stats during background refresh

* Retain stale stats through refresh windows

* Bound analytics work to protect ingestion

* Prioritize summary warmup over chart scans

* Throttle path history rebuilds

* Bound path history result memory

* Stream path history aggregation

* Give bounded path rebuild one CPU

* Serve stale charts during bounded refresh

* Prioritize startup stats before chart scans

* Bound path history segment cardinality

* Pin path rebuild context to privacy generation

* Self-host original frontend fonts

* Allow bounded path rebuild to complete

* Improve live map UI and low-latency group feed

- Dock node details on the right with selection highlight and collapsible layers
- Add node legend, 24h activity sparkline, copy-link, and layout/overlap fixes
- Keep all repeaters visible during Live Path focus
- Send GroupText feed packets immediately over WebSocket (no batch delay)
- Cache expensive stats/observer activity more aggressively to protect ingest
- Remove stale local planning/audit markdown from the tree

* fix(ci): supply OPERATOR_SITE_TOKEN for compose validation

Workers/Compose CI failed because docker-compose requires
OPERATOR_SITE_TOKEN. Add CI placeholders for that and MQTT_PASSWORD.
2026-07-27 02:39:12 +01:00
gadgethdandClaude Opus 4.8 5ea700c485 Improve text contrast for accessibility (issue #3) (#16)
Keep the dark theme but fix low-contrast, small text reported in the
repeater tree window and elsewhere:

- globals.css: --text-muted #71839b -> #8697b0. It was the only text
  token failing WCAG AA (down to 3.8:1 on the lighter panels); now
  5.0-6.6:1 on every background. primary/secondary left unchanged.
- Bump 9-10px muted/secondary labels to 11-12px (repeater-tree
  metadata, node drawer, timeline, watchlist, planner, detail panel).
- Replace hard-coded greys (#9ca3af zoom hint, #aaa popup label) with
  var(--text-muted) so they track the palette.
- Add an axe color-contrast e2e assertion on /feed to guard regressions.

Fixes #3

Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-07-24 00:58:14 +01:00
dependabot[bot] 363380fca8 Bump GitHub Actions dependencies (#13)
Updates actions/checkout, actions/setup-node, and actions/setup-python to their current v7 releases after all repository checks passed.
2026-07-23 20:53:17 +01:00
gadgethd 93cc3e1b38 Expand network intelligence and harden operations (#9)
Consolidates the stacked backend, privacy, network-intelligence, frontend, operations, mobile, and owner-cache changes after resolving main conflicts and passing the full CI suite.
2026-07-23 20:50:47 +01:00
gadgethd e49b9bfb1a fix(frontend): give mobile layouts room (#12) 2026-07-19 20:21:06 +01:00
gadgethd 0b62c3b6e6 fix(frontend): keep mobile navigation collapsible (#11) 2026-07-19 19:51:40 +01:00
gadgethd 12da1689e4 Fix mobile layouts across frontend (#10)
Bound mobile navigation, controls, searches, and overlays while adding route-wide responsive browser coverage.
2026-07-18 19:16:01 +01:00
Ben 69acf7aa55 Add beta path neighbor affinity scoring 2026-05-03 02:02:40 +00:00
BenandClaude Sonnet 4.6 edc8206a22 Add ML path learner, Anubis bot protection, planned coverage, companion page, and misc improvements
- ml-path-learner: new Python worker that trains a prefix→node ML model from gold paths and writes scores to ml_path_prefix_scores
- lazyResolver: integrate ML scores and edge priors into tiered candidate ranking; bidirectional pass-2 propagation; global cross-group direct anchors
- Anubis: add sidecar bot-protection containers for all public HTTP services; botPolicy.yaml
- Planned coverage: new API route + frontend map layers for placing hypothetical repeaters and computing coverage
- Map: light/dark theme toggle; map-tools button group (LOS, Repeater, theme); plan-repeater mode with click-to-place/remove and polling
- Frontend: remove inferred nodes from map display (backend inference kept for internal use)
- Stats page: observer region summary, channel traffic, companion activity endpoints and UI
- UKCompanionPage: new companion activity page
- Teesside site: extracted into standalone build context (teesside-site/)
- healthcheck overrides: share.html, sw.js, region filter support, SVG score ring updates
- DB: dedicated analytics pool; DATABASE_SKIP_SCHEMA_INIT flag; path hash prefix indexes; lateral join fixes for node_link_radio_reports
- docker-compose: ml-path-learner service; anubis sidecars; DATABASE_SKIP_SCHEMA_INIT on all workers; OBSERVER_RETENTION_SECONDS; REGIONS_FILE
- backend-site: internal operator dashboard routes
- docker/mesh-health-check-entrypoint.sh: extract channel secret from MESHCORE_CHANNEL_SECRETS at startup
- scripts: observer key generation, observer registration, healthcheck tunnel check
- vacuum-compressed-chunks.sh: maintenance script

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-05-03 01:33:48 +00:00
BenandClaude Sonnet 4.6 e965ecaecd Add region filter button support to healthcheck overrides
- index.html: add #region-filter div above observer list, cache-busting
  query strings on CSS/JS, data-map-observer-scope="expected" on body
- ukmesh-theme.css: add .region-btn styles (UKMesh blue/cyan colour scheme),
  remove now-redundant .score-ring__track override (SVG ring handles it)

The region filter UI is implemented in the gadgethd/meshcore-health-check fork
and activated server-side via REGIONS_FILE env var.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-04-14 16:55:54 +00:00
Ben d01f5ae529 Update healthcheck overrides: SVG score ring and fix ukmesh theme 2026-04-13 22:44:18 +00:00
Ben 4bf515b735 Switch mesh-health-check build to gadgethd fork, track main branch 2026-04-13 22:32:57 +00:00
Ben 38e2273574 Switch mesh-health-check to gadgethd fork with improved score ring 2026-04-13 22:29:57 +00:00
Ben 9dd1e7ae62 Add feed repeater tree modal 2026-04-13 17:13:33 +00:00
BenandClaude Opus 4.6 7994e13175 Add SEO, improve path resolution, per-node antenna heights, and UI refinements
Backend: derive observer IATA from packet topic instead of node table,
send messages separately in WS initial state, add tiered prefix/edge
priors to lazy path resolver for more accurate hash disambiguation.

Frontend: add SeoHead, JsonLd, and vite-seo plugin for per-route meta
tags and structured data. Add earth-curvature correction to custom LOS
tool. Owner portal last-hop chart supports hiding/showing individual
series with cookie persistence. Feed page and path map refactored.
Cache-busting build filenames. Track firstSeenTs on aggregated packets.

Infra: serve robots.txt and sitemap.xml via nginx, add manifest.json,
reduce Mosquitto log verbosity. Viewshed worker supports per-node
antenna heights, configurable profile step, and SNR-median calibration.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-27 17:22:31 +00:00
BenandClaude Opus 4.6 7ba12893b9 Remove gitignored TeessieDashboard import that breaks fresh builds
The teesside page directory is gitignored but main.tsx still imported
TeessieDashboard, causing TS2307 on any clean clone. Remove the import
and redirect the teesside index route to /install inside Layout.

Fixes #1

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-27 17:20:30 +00:00
BenandClaude Sonnet 4.6 a0622c9861 Replace hardcoded terrain tiles path with env var default
Use ${TERRAIN_TILES_PATH:-./terrain-tiles} so the path is configurable
per-host without leaking machine-specific paths in the repo.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-03-24 01:22:34 +00:00
BenandClaude Sonnet 4.6 587093d48a Add multi-node LOS overlay with terrain profile and custom LOS tool
- Multi-node LOS: multiple repeaters can have LOS active simultaneously,
  each auto-expiring after 15 seconds; LOS persists after popup closes
- Custom LOS tool: desktop-only map button to sample terrain between two
  points (click map or repeater); renders per-segment green/clear or
  red/obstructed based on terrain height; prohibited nodes are excluded
- Terrain exaggeration: deck.gl altitudes multiplied by exaggeration factor
  (2×) to match MapLibre's visual terrain mesh
- LOS line rendering: bloom+core PathLayer tube effect with ScatterplotLayer
  endpoint markers; popup z-index fix so it renders above deck.gl canvas
- Terrain sampler: client-side Terrarium PNG tile decoder for elevation sampling
- DB schema: terrain_profile_json JSONB column added to node_links
- Nginx: terrain tile serving block added
- Docker: terrain tiles volume mount added

Excluded: PacketDetailPanel, UKFeedPage, styles/globals.css (unrelated local
changes), backfill_profiles.py (server-side utility, not intended for repo)

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-03-24 01:15:39 +00:00
BenandClaude Sonnet 4.6 015dfd2bab Fix terrain toggle, preference restore, and low-zoom crash
- Load terrain source and hillshade dynamically (only when 3D mode is on)
  to prevent tile loading at idle, fixing low-zoom WebGL crash
- Restore terrain correctly on page reload by applying inside map load handler
- Clean up source, hillshade, and sky layers fully when terrain is toggled off
- Raise minZoom to 6 to prevent crash at extreme zoom-out
- Reduce terrain exaggeration to 3x as a stable middle ground

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-03-23 01:12:41 +00:00
BenandClaude Sonnet 4.6 370348d9a1 Add UK terrain heightmap with hillshade to map
- Add SRTM raster-dem terrain source (AWS Terrarium tiles) to map style
- Add hillshade layer always visible for terrain relief in 2D and 3D
- Add sky layer for atmosphere effect in 3D mode
- Replace Links filter row with 3D Terrain toggle in the Layers panel
- Lock map pitch to 0 by default; terrain toggle unlocks and tilts to 45°
- Wire showTerrain prop through Filters → App → MapLibreMap via useEffect

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-03-23 00:38:47 +00:00
BenandClaude Sonnet 4.6 f8e8717454 Add lazy path resolver, ACL watcher, feed map, and observability stack
- Lazy path resolver: geographic hop reconstruction from path_hashes without
  pre-training data; fixes observer self-hash trimming bug
- ACL watcher worker: auto-provisions Mosquitto ACL entries when PUBLISH is
  denied for a known user; eliminates the recurring gnomemoe ACL removal issue
- connectionMonitor: increase historical scan to 50 MB; fix OOM by streaming
  lines instead of buffering; fixes missed backfill on restart
- Feed page: replace path-beta with lazy paths; add clickable node markers
  showing name and public key; observer column nowrap; summary text unclipped
- PacketFeed: GRP-only message store protected from ADV eviction; scroll to
  bottom on new message; 24-hour message backfill on initial load
- getRecentMessages: separate DB query for last 50 GRP messages last 24h
- getPacketDetail: new endpoint for full packet detail including observations
- Grafana/Loki/Promtail observability stack with Docker log collection

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-03-22 23:28:57 +00:00
BenandClaude Sonnet 4.6 490171c16b Auto-provision Mosquitto ACL and refresh owner session from DB
- New aclManager.ts rewrites a user's ACL block (all linked nodes) and
  sends SIGHUP to the Mosquitto container whenever autoLinkOwnerNodeIds
  runs at owner login, eliminating the need to manually edit the ACL
  file when a user connects a second node.
- requireOwnerSession now resolves node IDs from owner_account_nodes
  on every request instead of using the frozen session cookie list,
  so manually- or auto-linked nodes are visible without re-login.
- docker-compose: mount mosquitto config dir (rw) and Docker socket
  into backend so it can update the ACL file and signal Mosquitto.
- Add dockerode dependency for container SIGHUP signalling.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-03-22 19:18:55 +00:00
Ben 89f06ca275 Refine path resolution and owner telemetry 2026-03-22 11:27:09 +00:00
Ben 3877c562b0 Refine owner last-hop caching
- limit owner last-hop data to selected-node cached queries
- replace broad owner-node prewarm with rolling per-node cache updates
- incrementally refresh the latest cached hour and drop data outside the 7-day window
2026-03-21 00:22:04 +00:00